-- Logs begin at Tue 2022-08-23 06:27:44 UTC, end at Tue 2022-08-23 07:34:37 UTC. -- Aug 23 07:03:52.875451 dv-cinder-854092-1-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 23 07:03:52.884892 dv-cinder-854092-1-iscsi devstack@n-api.service[105715]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 23 07:03:52.888029 dv-cinder-854092-1-iscsi devstack@n-api.service[105715]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Aug 23 07:03:52 2022] *** Aug 23 07:03:52.888029 dv-cinder-854092-1-iscsi devstack@n-api.service[105715]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 23 07:03:52.888029 dv-cinder-854092-1-iscsi devstack@n-api.service[105715]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 23 07:03:52.888029 dv-cinder-854092-1-iscsi devstack@n-api.service[105715]: nodename: dv-cinder-854092-1-iscsi Aug 23 07:03:52.888029 dv-cinder-854092-1-iscsi devstack@n-api.service[105715]: machine: x86_64 Aug 23 07:03:52.888029 dv-cinder-854092-1-iscsi devstack@n-api.service[105715]: clock source: unix Aug 23 07:03:52.888029 dv-cinder-854092-1-iscsi devstack@n-api.service[105715]: pcre jit disabled Aug 23 07:03:52.888029 dv-cinder-854092-1-iscsi devstack@n-api.service[105715]: detected number of CPU cores: 4 Aug 23 07:03:52.888029 dv-cinder-854092-1-iscsi devstack@n-api.service[105715]: current working directory: / Aug 23 07:03:52.888029 dv-cinder-854092-1-iscsi devstack@n-api.service[105715]: detected binary path: /usr/bin/uwsgi-core Aug 23 07:03:52.888706 dv-cinder-854092-1-iscsi devstack@n-api.service[105715]: your processes number limit is 47680 Aug 23 07:03:52.888706 dv-cinder-854092-1-iscsi devstack@n-api.service[105715]: your memory page size is 4096 bytes Aug 23 07:03:52.888706 dv-cinder-854092-1-iscsi devstack@n-api.service[105715]: detected max file descriptor number: 2048 Aug 23 07:03:52.888706 dv-cinder-854092-1-iscsi devstack@n-api.service[105715]: lock engine: pthread robust mutexes Aug 23 07:03:52.888706 dv-cinder-854092-1-iscsi devstack@n-api.service[105715]: thunder lock: enabled Aug 23 07:03:52.888706 dv-cinder-854092-1-iscsi devstack@n-api.service[105715]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 23 07:03:52.888706 dv-cinder-854092-1-iscsi devstack@n-api.service[105715]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 23 07:03:52.927457 dv-cinder-854092-1-iscsi devstack@n-api.service[105715]: Python main interpreter initialized at 0x562a5aa579c0 Aug 23 07:03:52.927457 dv-cinder-854092-1-iscsi devstack@n-api.service[105715]: python threads support enabled Aug 23 07:03:52.927457 dv-cinder-854092-1-iscsi devstack@n-api.service[105715]: your server socket listen backlog is limited to 100 connections Aug 23 07:03:52.927457 dv-cinder-854092-1-iscsi devstack@n-api.service[105715]: your mercy for graceful operations on workers is 90 seconds Aug 23 07:03:52.927806 dv-cinder-854092-1-iscsi devstack@n-api.service[105715]: mapped 403077 bytes (393 KB) for 2 cores Aug 23 07:03:52.927806 dv-cinder-854092-1-iscsi devstack@n-api.service[105715]: *** Operational MODE: preforking *** Aug 23 07:03:52.928040 dv-cinder-854092-1-iscsi devstack@n-api.service[105715]: *** uWSGI is running in multiple interpreter mode *** Aug 23 07:03:52.928040 dv-cinder-854092-1-iscsi devstack@n-api.service[105715]: spawned uWSGI master process (pid: 105715) Aug 23 07:03:52.928261 dv-cinder-854092-1-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 23 07:03:52.929278 dv-cinder-854092-1-iscsi devstack@n-api.service[105715]: spawned uWSGI worker 1 (pid: 105716, cores: 1) Aug 23 07:03:52.929278 dv-cinder-854092-1-iscsi devstack@n-api.service[105715]: spawned uWSGI worker 2 (pid: 105717, cores: 1) Aug 23 07:03:52.929278 dv-cinder-854092-1-iscsi devstack@n-api.service[105715]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 23 07:03:53.576644 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 23 07:03:53.579452 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 23 07:03:54.645779 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 23 07:03:54.645779 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: from cryptography.utils import int_from_bytes Aug 23 07:03:54.646571 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 23 07:03:54.646571 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: from cryptography.utils import int_from_bytes Aug 23 07:03:54.646941 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 23 07:03:54.646941 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: from cryptography.utils import int_from_bytes Aug 23 07:03:54.647050 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 23 07:03:54.647050 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: from cryptography.utils import int_from_bytes Aug 23 07:03:57.119436 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 23 07:03:57.119979 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 23 07:03:57.120069 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 23 07:03:57.120431 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 23 07:03:57.120681 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 23 07:03:57.120808 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 23 07:03:57.121177 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 23 07:03:57.121263 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:03:57.121336 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:03:57.121491 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 23 07:03:57.121656 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:03:57.121847 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 23 07:03:57.121988 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:03:57.122079 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 23 07:03:57.122217 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:03:57.122479 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:03:57.122622 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:03:57.122777 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:03:57.122876 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:03:57.123130 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:03:57.123283 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:03:57.123440 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:03:57.123534 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:03:57.123829 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:03:57.123969 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:03:57.124122 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:03:57.124269 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:03:57.124476 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:03:57.124606 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-854092-1-iscsi {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:03:57.124785 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:03:57.124983 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:03:57.125090 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:03:57.125225 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:03:57.125312 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:03:57.125400 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:03:57.125640 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:03:57.125734 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:03:57.125962 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-854092-1-iscsi {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:03:57.126051 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:03:57.126277 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:03:57.126363 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:03:57.126577 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:03:57.126665 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:03:57.126887 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:03:57.127064 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:03:57.127175 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:03:57.127512 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:03:57.127800 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:03:57.127947 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:03:57.128146 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:03:57.128277 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:03:57.128381 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:03:57.128608 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:03:57.128758 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:03:57.128910 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:03:57.129040 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:03:57.129219 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:03:57.129350 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:03:57.129530 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:03:57.129668 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:03:57.129862 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:03:57.129998 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:03:57.130174 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:03:57.130314 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:03:57.130471 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:03:57.130609 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:03:57.130791 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:03:57.130920 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-854092-1-iscsi {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:03:57.131100 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:03:57.131233 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:03:57.131402 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:03:57.131576 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:03:57.131746 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:03:57.131902 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:03:57.132148 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:03:57.132268 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-854092-1-iscsi {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:03:57.132454 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:03:57.132544 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:03:57.132757 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:03:57.132892 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:03:57.133064 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:03:57.133189 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:03:57.133374 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:03:57.133477 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:03:57.133675 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:03:57.133779 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:03:57.133991 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:03:57.134093 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:03:57.134301 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:03:57.134405 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:03:57.134609 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:03:57.134717 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:03:57.134923 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:03:57.135018 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:03:57.135217 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:03:57.135311 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:03:57.135539 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:03:57.135642 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:03:57.135842 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:03:57.135961 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:03:57.136154 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:03:57.136253 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:03:57.136449 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:03:57.136536 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:03:57.136745 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:03:57.136840 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:03:57.136987 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:03:57.137074 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:03:57.137285 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:03:57.137383 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:03:57.137599 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:03:57.137698 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:03:57.137911 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:03:57.137998 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:03:57.138199 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:03:57.138293 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:03:57.138457 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:03:57.138552 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:03:57.138701 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:03:57.138798 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:03:57.139009 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:03:57.139096 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:03:57.139378 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:03:57.139483 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:03:57.139705 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:03:57.139799 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:03:57.139954 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:03:57.140071 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:03:57.140270 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:03:57.140405 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:03:57.140573 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:03:57.140664 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:03:57.140870 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:03:57.140969 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:03:57.141167 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:03:57.141262 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:03:57.141464 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:03:57.141561 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:03:57.141761 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:03:57.141856 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:03:57.142063 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:03:57.142161 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:03:57.142366 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:03:57.142453 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:03:57.142671 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:03:57.142765 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:03:57.142969 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:03:57.143052 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:03:57.143279 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:03:57.143371 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:03:57.143616 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:03:57.143712 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.17 {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:03:57.143922 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.17 {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:03:57.144016 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:03:57.144220 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:03:57.144308 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:03:57.144535 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:03:57.144627 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:03:57.144845 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:03:57.144941 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.17 {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:03:57.145143 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:03:57.145233 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.17 {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:03:57.145452 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:03:57.145539 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:03:57.145761 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:03:57.145855 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:03:57.146057 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:03:57.146179 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:03:57.146354 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:03:57.146452 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:03:57.146651 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:03:57.146744 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:03:57.146965 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:03:57.147065 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:03:57.147267 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:03:57.147352 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:03:57.147594 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:03:57.147696 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:03:57.147846 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:03:57.147981 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:03:57.148127 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:03:57.148218 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:03:57.148423 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:03:57.148511 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:03:57.148730 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:03:57.148825 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:03:57.149029 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:03:57.149122 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:03:57.149322 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:03:57.149417 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:03:57.149624 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:03:57.149721 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:03:57.149915 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:03:57.150009 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:03:57.150211 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:03:57.150296 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:03:57.150507 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:03:57.150593 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:03:57.150802 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:03:57.150895 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:03:57.151096 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:03:57.151181 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:03:57.151388 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:03:57.151542 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:03:57.151706 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:03:57.151794 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:03:57.152002 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:03:57.152090 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:03:57.152300 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:03:57.152389 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:03:57.152597 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:03:57.152683 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:03:57.152897 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:03:57.152982 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:03:57.153201 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:03:57.153294 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:03:57.153496 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:03:57.153616 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:03:57.153793 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:03:57.153888 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:03:57.154089 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:03:57.154175 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:03:57.154387 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:03:57.154483 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:03:57.154697 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:03:57.154825 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:03:57.155054 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:03:57.155144 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:03:57.155357 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:03:57.155622 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:03:57.155787 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:03:57.155951 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:03:57.156133 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:03:57.156258 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:03:57.156449 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:03:57.156563 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:03:57.156757 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:03:57.156875 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:03:57.157083 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:03:57.157178 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:03:57.157391 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:03:57.157478 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:03:57.157698 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:03:57.157792 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:03:57.158016 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:03:57.158103 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:03:57.158324 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:03:57.158411 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:03:57.158629 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:03:57.158728 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:03:57.158926 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:03:57.159020 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:03:57.159226 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:03:57.159317 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:03:57.159551 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:03:57.159654 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:03:57.159852 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:03:57.159945 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:03:57.160150 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:03:57.160238 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:03:57.160448 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:03:57.160547 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:03:57.160743 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:03:57.160837 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:03:57.161040 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:03:57.161126 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:03:57.161331 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:03:57.161419 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:03:57.161633 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:03:57.161718 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:03:57.161935 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:03:57.162034 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:03:57.162236 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:03:57.162321 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:03:57.162529 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:03:57.162612 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:03:57.162826 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:03:57.162917 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:03:57.163139 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:03:57.163235 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:03:57.163463 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:03:57.163550 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.163775 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:03:57.163871 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.164082 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:03:57.164170 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.164400 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:03:57.164487 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.164733 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.164831 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.165062 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.165162 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.165374 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.165467 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.165679 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.165782 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.165983 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.166069 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.166301 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.166401 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.166608 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.166705 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.166912 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.166998 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.167215 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.167301 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.167554 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.167655 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.167867 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.167953 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.168187 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.168281 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.168496 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.168602 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.168805 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.168897 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.169115 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.169210 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.169419 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.169527 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.169733 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.169827 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.170047 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.170131 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.170360 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.170453 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.170753 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.170848 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.171092 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.171177 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.171446 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.171536 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.171757 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.171845 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.172074 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.172165 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.172387 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.172472 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.172694 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.172781 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.173000 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.173085 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.173307 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.173406 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.173621 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.173717 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.173949 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.174048 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.174256 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.174348 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.174563 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.174659 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.174869 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.174964 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.175173 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.175262 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.175502 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.175646 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.175809 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.175912 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.176112 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.176204 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.176433 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.176525 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.176737 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.176834 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.177047 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.177131 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.177348 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.177433 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.177655 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.177750 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.177957 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.178043 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.178260 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.178345 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.178562 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.178649 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.178858 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.178955 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.179157 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.179242 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.179475 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.179566 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.179786 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.179874 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.180082 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.180168 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.180396 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.180483 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.180712 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.180806 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.181009 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.181101 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.181317 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.181403 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.181616 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.181701 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.181918 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.182017 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.182220 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.182305 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.182522 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.182609 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.182816 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.182916 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.183118 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.183204 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.183438 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.183528 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.183738 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.183836 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.184056 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.184156 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.184354 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.184440 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.184650 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.184744 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.184957 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.185048 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.185252 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.185346 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.185548 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.185641 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.185855 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.185941 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.186201 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.186288 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.186505 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.186592 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.186807 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.186899 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.187110 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.187196 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.187437 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.187528 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.187747 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.187833 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.188050 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.188148 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.188360 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.188446 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.188685 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.188782 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.188984 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.189078 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.189296 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.189384 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.189617 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.189701 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.189927 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.190027 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.190222 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.190316 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.190526 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.190612 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.190819 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.190918 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.191114 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.191200 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.191427 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.191523 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.191726 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.191829 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.192021 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.192107 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.192317 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.192402 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.192612 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.192705 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.192907 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.193000 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.193201 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.193296 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.193517 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.193603 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.193816 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.193901 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.194112 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.194199 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.194410 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.194497 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.194705 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.194799 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.195033 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.195117 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.195325 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.195429 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.195654 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.195788 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.195963 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.196062 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.196290 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.196374 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.196601 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.196693 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.196900 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.197002 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.197208 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.197300 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.197509 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.197603 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.197809 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.197904 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.198108 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.198194 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.198408 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.198502 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.198723 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.198826 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.199023 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.199126 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.199331 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.199453 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.199659 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.199749 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.200280 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.200378 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.200582 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.200668 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.200894 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.200981 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.201189 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.201284 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.201496 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.201589 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.201848 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.201945 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.202172 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.202265 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.202479 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.202565 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.202791 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.202888 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.203091 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.203177 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.203398 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.203525 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.203719 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.203818 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.204020 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.204146 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.204320 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.204416 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.204619 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.204728 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.204928 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.205040 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.205229 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.205350 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.205537 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.205659 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.205836 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.205969 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.206147 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.206288 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.206446 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.206597 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.206753 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.206915 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.207047 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.207225 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.207355 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.207570 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.207695 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.207881 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.208016 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.208199 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.208318 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.208503 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.208618 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.208818 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.208921 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.209147 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.209241 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.209480 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.209566 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.209792 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.209890 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.210083 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.210168 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.210377 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.210471 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.210676 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.210774 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.210978 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.211064 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.211278 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.211365 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.211618 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.211713 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.211916 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.212001 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.212224 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.212320 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.212523 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.212609 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.212819 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.212904 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.213113 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.213200 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.213415 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.213503 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.213727 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.213813 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.214028 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.214115 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.214328 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.214414 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.214637 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.214738 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.214928 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.215025 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.215221 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.215314 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.215556 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.215649 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.215859 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.215958 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.216156 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.216242 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.216453 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.216548 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.216747 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.216847 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.217069 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.217198 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.217407 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.217495 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.217709 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.217805 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.218031 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.218185 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.218335 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.218507 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.218680 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.218813 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.218994 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.219122 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.219301 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.219443 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.219644 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.219755 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.219970 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.220068 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.220282 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.220377 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.220595 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.220690 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.220907 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.220993 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.221218 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.221305 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.221517 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.221605 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.221822 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.221918 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.222131 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.222224 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.222429 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.222514 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.222732 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.222827 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.223035 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.223129 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.223332 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.223436 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.223656 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.223742 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.223967 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.224065 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.224278 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.224534 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.224624 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.224863 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.224949 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.225174 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.225260 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.225488 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.225574 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.225799 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.226057 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.226145 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.226391 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.226484 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.226708 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.226796 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.227028 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.227123 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.227329 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.227452 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.227663 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.227751 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.227962 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.228129 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.228261 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.228355 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.228564 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.228651 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.228863 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.228959 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.229161 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.229250 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.229459 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.229545 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.229767 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.229853 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.230061 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.230155 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.230356 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.230443 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.230652 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.230739 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.230948 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.231044 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.231253 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.231340 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.231572 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.231673 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.231879 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.231966 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.232172 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.232256 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.232477 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.232563 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.232778 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.232920 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.233190 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.233283 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.233520 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.233614 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.233828 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.233914 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.234154 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.234248 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.234461 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.234545 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.234771 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.234856 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.235076 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.235162 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.235383 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.235537 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.235729 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.235860 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.236028 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.236114 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.236342 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.236437 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.236640 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.236726 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.236936 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.237023 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.237229 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.237360 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.237532 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.237618 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.237832 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.237918 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.238129 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.238215 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.238430 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.238523 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.238728 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.238817 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.239029 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.239116 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.239327 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.239432 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.239651 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.239751 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.239956 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.240051 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.240252 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.240338 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.240556 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.240653 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.240855 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.240949 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.241147 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.241233 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.241439 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.241534 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.241741 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.241837 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.242038 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.242132 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.242330 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.242424 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.242631 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.242717 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.242924 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.243010 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.243228 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.243330 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.243556 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.243658 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.243855 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.243944 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.244153 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.244240 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.244450 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.244580 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.244745 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.244831 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.245037 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.245124 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.245349 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.245434 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.245650 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.245736 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.245947 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.246034 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.246240 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.246326 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.246540 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.246632 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.246830 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.246928 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.247123 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.247209 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.247466 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.247576 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.247748 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.247858 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.248058 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.248145 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.248351 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.248449 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.248697 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.248792 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.249010 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.249098 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.249333 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.249429 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.249650 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.249738 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.249955 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.250041 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.250260 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.250346 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.250557 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.250643 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.250856 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.250951 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.251149 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.251237 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.251474 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.251606 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.251777 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.251865 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.252076 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.252163 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.252371 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.252458 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.252664 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.252750 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.252957 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.253044 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.253274 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.253359 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.253572 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.253738 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.253875 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.253960 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.254180 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.254270 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.254481 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.254576 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.254789 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.254883 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.255091 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.255237 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.255391 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.255515 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.255719 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.255806 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.256012 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.256107 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.256318 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.256413 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.256621 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.256708 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.256923 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.257011 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.257217 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.257316 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.257511 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.257597 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.257822 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.257909 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.258121 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.258208 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.258420 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.258507 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.258731 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.258826 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.259032 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.259119 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.259341 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.259440 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.259666 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.259752 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.259967 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.260056 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.260266 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.260352 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.260566 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.260660 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.260866 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.260953 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.261167 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.261254 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.261469 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.261563 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.261770 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.261856 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.262074 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.262160 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.262376 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.262469 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.262676 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.262762 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.262973 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.263059 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.263275 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.263368 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.263600 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.263688 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.263898 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.263984 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.264223 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.264377 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.264546 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.264662 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.264881 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.264964 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.265129 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.265218 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.265423 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.265509 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.265721 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.265807 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.266014 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.266142 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.266340 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.266432 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.266651 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.266749 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.266956 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.267045 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.267267 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.267353 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.267594 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.267682 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.267896 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.268021 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.268200 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.268331 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.268503 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.268640 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.268797 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.268928 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.269206 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.269292 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.269514 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.269609 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.269814 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.269900 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.270113 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.270200 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.270407 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.270504 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.270698 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.270828 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.270996 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.271140 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.271306 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.271471 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.271632 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.271786 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.271925 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.272088 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.272218 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.272391 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.272530 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.272701 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.272825 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.273024 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.273123 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.273330 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.273528 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.273625 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.273832 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.273918 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.274126 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.274233 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.274532 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.274618 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.274832 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.274918 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.275132 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.275258 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.275532 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.275633 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.275848 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.275948 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.276162 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.276291 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.276457 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.276604 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.276761 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.276913 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.277061 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.277234 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.277374 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.277553 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.277685 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.277879 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.277975 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.278183 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.278271 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.278495 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.278581 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.278804 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.278890 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.279125 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.279213 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.279469 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.279560 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.279781 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.279904 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.280147 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.280242 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.280449 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.280538 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.280772 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.280867 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.281091 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.281178 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.281402 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.281492 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.281697 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.281791 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.281993 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.282128 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.282296 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.282450 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.282594 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.282764 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.282893 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.283084 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.283208 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.283406 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.283557 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.283736 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.283838 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.284033 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.284128 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.284344 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.284441 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.284653 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.284740 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.284959 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.285045 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.285267 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.285363 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.285564 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.285654 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.285872 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.285957 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.286170 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.286263 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.286475 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.286568 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.286779 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.286875 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.287070 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.287169 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.287381 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.287526 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.287709 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.287805 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.288009 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.288097 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.288304 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.288399 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.288600 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.288686 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.288931 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.289026 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.289227 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.289313 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.289546 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.289631 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.289856 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.289951 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.290161 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.290247 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.290462 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.290546 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.290762 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.290854 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.291090 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.291175 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.291393 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.291561 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.291731 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.291817 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.292048 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.292142 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.292343 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.292474 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.292639 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.292726 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.292940 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.293034 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.293235 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.293332 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.293529 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.293653 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.293824 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.293920 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.294124 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.294220 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.294418 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.294504 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.294710 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.294798 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.295004 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.295092 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.295314 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.295429 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.295738 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.295828 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.296036 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.296129 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.296338 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.296474 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.296638 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.296726 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.296940 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.297028 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.297234 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.297321 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.297551 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.297636 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.297849 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.297979 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.298167 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.298254 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.298466 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.298561 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.298768 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.298860 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.299073 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.299168 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.299375 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.299597 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.299705 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.299799 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.300012 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.300115 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.300319 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.300419 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.300626 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.300720 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.300932 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.301021 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.301232 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.301328 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.301540 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.301628 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.301846 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.301932 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.302156 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.302251 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.302467 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.302665 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.302781 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.302984 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.303079 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.303290 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.303377 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.303621 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.303746 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.303928 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.304025 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.304232 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.304319 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.304534 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.304829 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.304923 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.305127 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.305213 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.305427 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.305512 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.305729 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.305826 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.306046 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.306132 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.306353 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.306438 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.306664 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.306826 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.306971 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.307063 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.307280 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.307365 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.307614 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.307711 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.307925 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.308013 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.308249 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.308335 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.308570 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.308658 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.308883 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.308970 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.309180 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.309266 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.309490 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.309584 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.309794 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.309886 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.310100 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.310198 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.310402 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.310488 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.310702 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.310798 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.311004 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.311306 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.311469 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.311543 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.311671 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.311749 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.312002 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.312091 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.312317 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.312417 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.312669 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.312755 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.312978 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.313075 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.313291 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.313386 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.313601 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.313689 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.313902 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.313988 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.314206 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.314300 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.314514 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.314609 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.314832 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.315019 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.315156 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.315327 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.315512 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.315675 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.315834 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.315991 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.316147 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.316307 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.316458 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.316617 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.316773 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.316928 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.317249 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.317334 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.317549 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.317644 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.317847 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.317933 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.318150 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.318237 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.318454 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.318542 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.318751 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.318845 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.319064 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.319151 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.319373 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.319479 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.319692 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.319779 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.320005 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.320090 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.320306 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.320441 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.320649 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.320828 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.320958 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.321173 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.321283 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.321487 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.321581 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.321808 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.321895 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.322128 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.322215 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.322440 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.322526 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.322743 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.322997 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.323092 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.323344 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.323475 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.323667 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.323753 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.323977 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.324076 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.324282 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.324369 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.324579 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.324665 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.325195 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.325290 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.325500 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.325593 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.325806 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.325891 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.326102 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.326197 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.326405 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.326492 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.326714 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.326848 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.327081 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.327183 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.327481 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.327570 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.327789 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.327876 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.328089 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.328186 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.328396 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.328483 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.328691 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.328790 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.328989 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.329076 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.329291 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.329379 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.329589 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.329683 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.329896 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.329981 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.330190 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.330275 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.330494 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.330589 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.330790 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.330883 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.331090 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.331182 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.331383 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.331540 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.331707 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.331803 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.332005 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.332091 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.332309 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.332402 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.332608 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.332694 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.332911 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.332997 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.333221 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.333309 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.333524 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.333611 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.333834 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.333920 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.334137 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.334223 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.334441 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.334527 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.334756 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.334840 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.335076 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.335170 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.335400 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.335625 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.335737 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.335953 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.336124 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.336271 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.336360 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.336598 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.336685 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.336921 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.337009 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.337222 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.337321 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.337520 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.337815 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.337910 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.338128 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.338214 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.338433 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.338519 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.338736 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.338832 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.339040 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.339135 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.339348 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.339464 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.339687 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.339775 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.339988 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.340075 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.340293 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.340380 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.340596 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.340723 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.340897 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.341011 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.341197 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.341294 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.341499 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.341587 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.341800 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.341885 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.342101 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.342196 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.342425 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.342527 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.342730 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.342880 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.343061 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.343198 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.343373 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.343539 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.343704 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.343853 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.344015 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.344166 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.344322 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.344479 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.344625 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.344797 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.344926 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.345112 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.345229 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.345454 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.345541 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.345778 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.345874 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.346099 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.346187 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.346417 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.346504 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.346711 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.346809 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.347036 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.347124 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.347348 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.347454 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.347709 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.347824 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.348002 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.348091 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.348319 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.348403 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.348633 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.348721 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.348948 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.349034 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.349250 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.349336 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.349559 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.349671 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.349866 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.349985 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.350187 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.350305 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.350520 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.350628 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.350839 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.350927 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.351156 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.351255 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.351476 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.351583 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.351778 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.351869 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.352076 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.352181 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.352376 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.352488 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.352685 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.352822 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.352985 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.353164 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.353279 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.353494 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.353581 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.353822 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.353918 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.354130 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.354217 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.354421 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.354505 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.354713 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.354807 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.355008 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.355096 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.355307 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.355392 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.355623 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.355756 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.355918 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.356005 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.356213 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.356298 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.356507 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.356605 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.356803 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.356890 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.357095 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.357181 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.357397 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.357490 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.357691 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.357776 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.358026 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.358130 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.358322 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.358428 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.358624 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.358724 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.358910 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.359006 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.359226 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.359320 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.359554 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.359645 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.359861 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.359951 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.360172 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.360261 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.360477 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.360562 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.360782 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.360880 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.361083 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.361168 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.361382 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.361467 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.361682 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.361776 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.361987 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.362072 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.362291 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.362379 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.362616 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.362712 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.362921 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.363007 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.363223 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.363309 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.363546 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.363650 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.363852 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.363940 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.364156 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.364243 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.364460 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.364551 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.364776 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.364864 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.365086 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.365171 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.365383 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.365469 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.365700 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.365837 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.366011 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.366106 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.366322 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.366409 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.366625 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.366711 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.366928 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.367023 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.367236 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.367321 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.367561 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.367651 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.367866 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.367965 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.368169 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.368256 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.368471 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.368566 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.368770 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.368865 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.369081 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.369170 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.369381 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.369512 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.369682 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.369772 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.369987 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.370073 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.370296 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.370384 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.370612 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.370697 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.370923 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.371009 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.371222 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.371308 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.371553 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.371643 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.371870 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.371973 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.372180 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.372276 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.372489 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.372575 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.372805 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.372899 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.373123 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.373217 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.373427 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.373512 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.373754 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.373871 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.374051 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.374151 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.374284 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 23 07:03:57.374395 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.374707 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.375052 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.375365 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.375735 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.376064 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.376379 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.376691 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.376995 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:03:57.377238 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 23 07:03:57.526890 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: INFO dbcounter [None req-0a78adbe-06ba-423a-b308-2bd03b5b838f None None] Registered counter for database nova_api Aug 23 07:03:57.529500 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: INFO dbcounter [None req-d7d2a6ae-a60c-4cf7-a9b4-bbde05003983 None None] Registered counter for database nova_api Aug 23 07:03:57.549652 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG oslo_db.sqlalchemy.engines [None req-0a78adbe-06ba-423a-b308-2bd03b5b838f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105716) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 23 07:03:57.551395 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG oslo_db.sqlalchemy.engines [None req-d7d2a6ae-a60c-4cf7-a9b4-bbde05003983 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105717) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 23 07:03:57.557300 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG dbcounter [-] [105716] Writer thread running {{(pid=105716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 23 07:03:57.558295 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG dbcounter [-] [105717] Writer thread running {{(pid=105717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 23 07:03:57.615120 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.context [None req-0a78adbe-06ba-423a-b308-2bd03b5b838f None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),f504f095-246c-45ec-9346-3a7c88a97f22(cell1) {{(pid=105716) load_cells /opt/stack/nova/nova/context.py:464}} Aug 23 07:03:57.615505 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.context [None req-d7d2a6ae-a60c-4cf7-a9b4-bbde05003983 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),f504f095-246c-45ec-9346-3a7c88a97f22(cell1) {{(pid=105717) load_cells /opt/stack/nova/nova/context.py:464}} Aug 23 07:03:57.619011 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG oslo_concurrency.lockutils [None req-0a78adbe-06ba-423a-b308-2bd03b5b838f None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:03:57.619323 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG oslo_concurrency.lockutils [None req-d7d2a6ae-a60c-4cf7-a9b4-bbde05003983 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:03:57.619505 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG oslo_concurrency.lockutils [None req-0a78adbe-06ba-423a-b308-2bd03b5b838f None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:03:57.619903 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG oslo_concurrency.lockutils [None req-d7d2a6ae-a60c-4cf7-a9b4-bbde05003983 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:03:57.621089 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG oslo_concurrency.lockutils [None req-0a78adbe-06ba-423a-b308-2bd03b5b838f None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:03:57.621403 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG oslo_concurrency.lockutils [None req-d7d2a6ae-a60c-4cf7-a9b4-bbde05003983 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:03:57.621818 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG oslo_concurrency.lockutils [None req-0a78adbe-06ba-423a-b308-2bd03b5b838f None None] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:03:57.622137 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG oslo_concurrency.lockutils [None req-d7d2a6ae-a60c-4cf7-a9b4-bbde05003983 None None] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:03:57.622269 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG oslo_concurrency.lockutils [None req-0a78adbe-06ba-423a-b308-2bd03b5b838f None None] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:03:57.622579 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG oslo_concurrency.lockutils [None req-d7d2a6ae-a60c-4cf7-a9b4-bbde05003983 None None] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:03:57.624300 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG oslo_concurrency.lockutils [None req-0a78adbe-06ba-423a-b308-2bd03b5b838f None None] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:03:57.624659 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG oslo_concurrency.lockutils [None req-d7d2a6ae-a60c-4cf7-a9b4-bbde05003983 None None] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:03:57.626288 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: INFO dbcounter [None req-0a78adbe-06ba-423a-b308-2bd03b5b838f None None] Registered counter for database nova_cell0 Aug 23 07:03:57.626676 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: INFO dbcounter [None req-d7d2a6ae-a60c-4cf7-a9b4-bbde05003983 None None] Registered counter for database nova_cell0 Aug 23 07:03:57.631806 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: INFO dbcounter [None req-0a78adbe-06ba-423a-b308-2bd03b5b838f None None] Registered counter for database nova_cell1 Aug 23 07:03:57.632183 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: INFO dbcounter [None req-d7d2a6ae-a60c-4cf7-a9b4-bbde05003983 None None] Registered counter for database nova_cell1 Aug 23 07:03:57.641247 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG oslo_db.sqlalchemy.engines [None req-0a78adbe-06ba-423a-b308-2bd03b5b838f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105716) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 23 07:03:57.642956 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG oslo_db.sqlalchemy.engines [None req-0a78adbe-06ba-423a-b308-2bd03b5b838f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105716) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 23 07:03:57.646692 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG oslo_db.sqlalchemy.engines [None req-d7d2a6ae-a60c-4cf7-a9b4-bbde05003983 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105717) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 23 07:03:57.647818 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG oslo_db.sqlalchemy.engines [None req-d7d2a6ae-a60c-4cf7-a9b4-bbde05003983 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105717) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 23 07:03:57.649001 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG dbcounter [-] [105716] Writer thread running {{(pid=105716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 23 07:03:57.650837 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG dbcounter [-] [105716] Writer thread running {{(pid=105716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 23 07:03:57.654825 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG dbcounter [-] [105717] Writer thread running {{(pid=105717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 23 07:03:57.657323 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG dbcounter [-] [105717] Writer thread running {{(pid=105717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 23 07:03:57.795737 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: INFO dbcounter [None req-0a78adbe-06ba-423a-b308-2bd03b5b838f None None] Registered counter for database nova_cell0 Aug 23 07:03:57.800739 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: INFO dbcounter [None req-d7d2a6ae-a60c-4cf7-a9b4-bbde05003983 None None] Registered counter for database nova_cell0 Aug 23 07:03:57.805721 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG oslo_db.sqlalchemy.engines [None req-0a78adbe-06ba-423a-b308-2bd03b5b838f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105716) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 23 07:03:57.809911 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG oslo_db.sqlalchemy.engines [None req-d7d2a6ae-a60c-4cf7-a9b4-bbde05003983 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105717) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 23 07:03:57.810311 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG dbcounter [-] [105716] Writer thread running {{(pid=105716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 23 07:03:57.815143 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG dbcounter [-] [105717] Writer thread running {{(pid=105717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 23 07:03:58.149013 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: WARNING keystonemiddleware.auth_token [None req-0a78adbe-06ba-423a-b308-2bd03b5b838f None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 23 07:03:58.149757 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: WARNING keystonemiddleware.auth_token [None req-d7d2a6ae-a60c-4cf7-a9b4-bbde05003983 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 23 07:03:58.156356 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: WARNING keystonemiddleware.auth_token [None req-0a78adbe-06ba-423a-b308-2bd03b5b838f None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 23 07:03:58.157060 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: WARNING keystonemiddleware.auth_token [None req-d7d2a6ae-a60c-4cf7-a9b4-bbde05003983 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 23 07:03:58.500967 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: WARNING keystonemiddleware.auth_token [None req-0a78adbe-06ba-423a-b308-2bd03b5b838f None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 23 07:03:58.504024 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: WARNING keystonemiddleware.auth_token [None req-d7d2a6ae-a60c-4cf7-a9b4-bbde05003983 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 23 07:03:58.506903 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: WARNING keystonemiddleware.auth_token [None req-0a78adbe-06ba-423a-b308-2bd03b5b838f None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 23 07:03:58.510023 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: WARNING keystonemiddleware.auth_token [None req-d7d2a6ae-a60c-4cf7-a9b4-bbde05003983 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 23 07:03:58.512239 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x562a5aa579c0 pid: 105716 (default app) Aug 23 07:03:58.514414 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi [None req-0a78adbe-06ba-423a-b308-2bd03b5b838f None None] Calling method '>' {{(pid=105716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:03:58.515788 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: INFO nova.api.openstack.requestlog [None req-0a78adbe-06ba-423a-b308-2bd03b5b838f None None] 10.222.0.17 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.002002 Aug 23 07:03:58.515936 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x562a5aa579c0 pid: 105717 (default app) Aug 23 07:03:58.516194 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: [pid: 105716|app: 0|req: 1/1] 10.222.0.17 () {50 vars in 788 bytes} [Tue Aug 23 07:03:58 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 07:05:17.470377 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi [None req-d7d2a6ae-a60c-4cf7-a9b4-bbde05003983 None None] Calling method '>' {{(pid=105717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:05:17.471643 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: INFO nova.api.openstack.requestlog [None req-d7d2a6ae-a60c-4cf7-a9b4-bbde05003983 None None] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002121 Aug 23 07:05:17.472277 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: [pid: 105717|app: 0|req: 1/2] 10.222.0.17 () {54 vars in 931 bytes} [Tue Aug 23 07:05:17 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 07:05:17.484301 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG dbcounter [-] [105716] Writing DB stats nova_api:SELECT=3 {{(pid=105716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:05:17.485445 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG dbcounter [-] [105716] Writing DB stats nova_cell0:SELECT=3 {{(pid=105716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:05:17.486827 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG dbcounter [-] [105716] Writing DB stats nova_cell1:SELECT=3 {{(pid=105716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:05:17.487678 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG dbcounter [-] [105716] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=105716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:05:18.360748 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi [None req-a66baf19-e1da-42f2-80e9-0abda116a423 admin admin] Calling method '>' {{(pid=105716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:05:18.394892 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: INFO nova.api.openstack.requestlog [None req-a66baf19-e1da-42f2-80e9-0abda116a423 admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.916239 Aug 23 07:05:18.395812 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: [pid: 105716|app: 0|req: 2/3] 10.222.0.17 () {60 vars in 1292 bytes} [Tue Aug 23 07:05:17 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 918 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:05:20.742289 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi [None req-d7d2a6ae-a60c-4cf7-a9b4-bbde05003983 None None] Calling method '>' {{(pid=105717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:05:20.743935 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: INFO nova.api.openstack.requestlog [None req-d7d2a6ae-a60c-4cf7-a9b4-bbde05003983 None None] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002187 Aug 23 07:05:20.744610 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: [pid: 105717|app: 0|req: 2/4] 10.222.0.17 () {54 vars in 931 bytes} [Tue Aug 23 07:05:20 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 07:05:21.178094 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi [None req-b405658f-6f40-4d26-b3ea-4ed2411e70d2 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "name": "cirros256", "rxtx_factor": 1.0, "id": "c1", "os-flavor-access:is_public": true, "ram": 256, "swap": 0}} {{(pid=105716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 07:05:21.197983 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 07:05:21.197983 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: warnings.warn(msg) Aug 23 07:05:21.229775 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: INFO nova.api.openstack.requestlog [None req-b405658f-6f40-4d26-b3ea-4ed2411e70d2 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.478411 Aug 23 07:05:21.231496 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: [pid: 105716|app: 0|req: 3/5] 10.222.0.17 () {64 vars in 1283 bytes} [Tue Aug 23 07:05:20 2022] POST /compute/v2.1/flavors => generated 407 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 23 07:05:21.244412 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG dbcounter [-] [105717] Writing DB stats nova_api:SELECT=3 {{(pid=105717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:05:21.246228 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG dbcounter [-] [105717] Writing DB stats nova_cell1:SELECT=3 {{(pid=105717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:05:21.247318 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG dbcounter [-] [105717] Writing DB stats nova_cell0:SELECT=3 {{(pid=105717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:05:21.248501 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG dbcounter [-] [105717] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=105717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:05:21.454381 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi [None req-674873d9-3c16-4649-833a-089297d444aa admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 07:05:21.458739 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 07:05:21.458739 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: warnings.warn(msg) Aug 23 07:05:21.518182 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: INFO nova.api.openstack.requestlog [None req-674873d9-3c16-4649-833a-089297d444aa admin admin] 10.222.0.17 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.279028 Aug 23 07:05:21.518798 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: [pid: 105717|app: 0|req: 3/6] 10.222.0.17 () {64 vars in 1336 bytes} [Tue Aug 23 07:05:21 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:05:23.846057 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi [None req-b405658f-6f40-4d26-b3ea-4ed2411e70d2 admin admin] Calling method '>' {{(pid=105716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:05:23.847263 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: INFO nova.api.openstack.requestlog [None req-b405658f-6f40-4d26-b3ea-4ed2411e70d2 admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001637 Aug 23 07:05:23.847924 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: [pid: 105716|app: 0|req: 4/7] 10.222.0.17 () {54 vars in 931 bytes} [Tue Aug 23 07:05:23 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 07:05:24.522215 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi [None req-a8626508-2885-409e-93c0-e53354a168bf admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "name": "ds512M", "ram": 512, "rxtx_factor": 1.0, "vcpus": 1, "id": "d1", "disk": 5, "swap": 0}} {{(pid=105717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 07:05:24.541021 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 07:05:24.541021 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: warnings.warn(msg) Aug 23 07:05:24.565058 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: INFO nova.api.openstack.requestlog [None req-a8626508-2885-409e-93c0-e53354a168bf admin admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.710755 Aug 23 07:05:24.565987 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: [pid: 105717|app: 0|req: 4/8] 10.222.0.17 () {64 vars in 1283 bytes} [Tue Aug 23 07:05:23 2022] POST /compute/v2.1/flavors => generated 404 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 23 07:05:24.578813 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi [None req-1a6ad04d-7e0e-4238-85e4-f86e790d1800 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 07:05:24.581845 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 07:05:24.581845 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: warnings.warn(msg) Aug 23 07:05:24.615528 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: INFO nova.api.openstack.requestlog [None req-1a6ad04d-7e0e-4238-85e4-f86e790d1800 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.041190 Aug 23 07:05:24.616115 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: [pid: 105716|app: 0|req: 5/9] 10.222.0.17 () {64 vars in 1336 bytes} [Tue Aug 23 07:05:24 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 07:05:26.962898 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi [None req-a8626508-2885-409e-93c0-e53354a168bf admin admin] Calling method '>' {{(pid=105717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:05:26.963935 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: INFO nova.api.openstack.requestlog [None req-a8626508-2885-409e-93c0-e53354a168bf admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001477 Aug 23 07:05:26.964328 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: [pid: 105717|app: 0|req: 5/10] 10.222.0.17 () {54 vars in 931 bytes} [Tue Aug 23 07:05:26 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 07:05:27.365784 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi [None req-042b72f6-934a-471c-b232-49598b179a1f admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d2", "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "disk": 10, "name": "ds1G", "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "ram": 1024}} {{(pid=105716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 07:05:27.386814 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: INFO nova.api.openstack.requestlog [None req-042b72f6-934a-471c-b232-49598b179a1f admin admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.416141 Aug 23 07:05:27.387645 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: [pid: 105716|app: 0|req: 6/11] 10.222.0.17 () {64 vars in 1283 bytes} [Tue Aug 23 07:05:26 2022] POST /compute/v2.1/flavors => generated 404 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 23 07:05:27.399930 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi [None req-937df113-d8be-4646-8924-bbc5c7808982 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 07:05:27.425278 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: INFO nova.api.openstack.requestlog [None req-937df113-d8be-4646-8924-bbc5c7808982 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029135 Aug 23 07:05:27.425928 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: [pid: 105717|app: 0|req: 6/12] 10.222.0.17 () {64 vars in 1336 bytes} [Tue Aug 23 07:05:27 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:05:29.788367 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi [None req-042b72f6-934a-471c-b232-49598b179a1f admin admin] Calling method '>' {{(pid=105716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:05:29.789369 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: INFO nova.api.openstack.requestlog [None req-042b72f6-934a-471c-b232-49598b179a1f admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001455 Aug 23 07:05:29.789762 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: [pid: 105716|app: 0|req: 7/13] 10.222.0.17 () {54 vars in 931 bytes} [Tue Aug 23 07:05:29 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 07:05:30.227141 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi [None req-bd91085e-5b73-4ec9-bcb0-72b8cd78a971 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "ram": 2048, "disk": 10, "rxtx_factor": 1.0, "name": "ds2G", "id": "d3", "swap": 0, "vcpus": 2, "os-flavor-access:is_public": true}} {{(pid=105717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 07:05:30.247154 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: INFO nova.api.openstack.requestlog [None req-bd91085e-5b73-4ec9-bcb0-72b8cd78a971 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.450890 Aug 23 07:05:30.247604 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: [pid: 105717|app: 0|req: 7/14] 10.222.0.17 () {64 vars in 1283 bytes} [Tue Aug 23 07:05:29 2022] POST /compute/v2.1/flavors => generated 404 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 23 07:05:30.260426 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi [None req-6fabe80f-4f1b-4d2f-a01f-25e53c32add2 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 07:05:30.284152 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: INFO nova.api.openstack.requestlog [None req-6fabe80f-4f1b-4d2f-a01f-25e53c32add2 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028325 Aug 23 07:05:30.284726 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: [pid: 105716|app: 0|req: 8/15] 10.222.0.17 () {64 vars in 1336 bytes} [Tue Aug 23 07:05:30 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 07:05:32.619247 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi [None req-bd91085e-5b73-4ec9-bcb0-72b8cd78a971 admin admin] Calling method '>' {{(pid=105717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:05:32.620190 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: INFO nova.api.openstack.requestlog [None req-bd91085e-5b73-4ec9-bcb0-72b8cd78a971 admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001476 Aug 23 07:05:32.620763 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: [pid: 105717|app: 0|req: 8/16] 10.222.0.17 () {54 vars in 931 bytes} [Tue Aug 23 07:05:32 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 07:05:33.074311 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi [None req-b0ed4149-7229-4c31-b1ab-a6dd0b32f649 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 20, "os-flavor-access:is_public": true, "id": "d4", "name": "ds4G", "vcpus": 4, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 4096, "swap": 0, "rxtx_factor": 1.0}} {{(pid=105716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 07:05:33.096384 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: INFO nova.api.openstack.requestlog [None req-b0ed4149-7229-4c31-b1ab-a6dd0b32f649 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.469354 Aug 23 07:05:33.097633 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: [pid: 105716|app: 0|req: 9/17] 10.222.0.17 () {64 vars in 1283 bytes} [Tue Aug 23 07:05:32 2022] POST /compute/v2.1/flavors => generated 404 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 23 07:05:33.109522 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi [None req-79893b03-8e4d-4a55-8aa3-6b3e1f2ec156 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 07:05:33.134732 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: INFO nova.api.openstack.requestlog [None req-79893b03-8e4d-4a55-8aa3-6b3e1f2ec156 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029021 Aug 23 07:05:33.135650 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: [pid: 105717|app: 0|req: 9/18] 10.222.0.17 () {64 vars in 1336 bytes} [Tue Aug 23 07:05:33 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:05:35.566273 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi [None req-b0ed4149-7229-4c31-b1ab-a6dd0b32f649 admin admin] Calling method '>' {{(pid=105716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:05:35.568032 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: INFO nova.api.openstack.requestlog [None req-b0ed4149-7229-4c31-b1ab-a6dd0b32f649 admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002208 Aug 23 07:05:35.568399 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: [pid: 105716|app: 0|req: 10/19] 10.222.0.17 () {54 vars in 931 bytes} [Tue Aug 23 07:05:35 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 07:05:36.038548 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi [None req-5de1dc7e-e2d0-42ab-9ca9-f984ebc4b06e admin admin] Calling method '>' {{(pid=105717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:05:36.068544 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: INFO nova.api.openstack.requestlog [None req-5de1dc7e-e2d0-42ab-9ca9-f984ebc4b06e admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.493413 Aug 23 07:05:36.069130 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: [pid: 105717|app: 0|req: 10/20] 10.222.0.17 () {60 vars in 1292 bytes} [Tue Aug 23 07:05:35 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 07:05:38.462349 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi [None req-b0ed4149-7229-4c31-b1ab-a6dd0b32f649 admin admin] Calling method '>' {{(pid=105716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:05:38.463667 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: INFO nova.api.openstack.requestlog [None req-b0ed4149-7229-4c31-b1ab-a6dd0b32f649 admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001900 Aug 23 07:05:38.464222 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: [pid: 105716|app: 0|req: 11/21] 10.222.0.17 () {54 vars in 931 bytes} [Tue Aug 23 07:05:38 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 07:05:38.943729 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi [None req-7d1944f6-f775-462d-a7dc-28167d9609a6 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "id": "1", "ram": 512, "swap": 0, "name": "m1.tiny", "rxtx_factor": 1.0, "vcpus": 1, "disk": 1}} {{(pid=105717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 07:05:38.966971 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: INFO nova.api.openstack.requestlog [None req-7d1944f6-f775-462d-a7dc-28167d9609a6 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.495382 Aug 23 07:05:38.967699 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: [pid: 105717|app: 0|req: 11/22] 10.222.0.17 () {64 vars in 1283 bytes} [Tue Aug 23 07:05:38 2022] POST /compute/v2.1/flavors => generated 402 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 23 07:05:38.982056 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi [None req-6c24e8a9-797c-4fae-9ddb-a7597e342965 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 07:05:39.006363 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: INFO nova.api.openstack.requestlog [None req-6c24e8a9-797c-4fae-9ddb-a7597e342965 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028175 Aug 23 07:05:39.006931 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: [pid: 105716|app: 0|req: 12/23] 10.222.0.17 () {64 vars in 1333 bytes} [Tue Aug 23 07:05:38 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 07:05:41.379938 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi [None req-7d1944f6-f775-462d-a7dc-28167d9609a6 admin admin] Calling method '>' {{(pid=105717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:05:41.380757 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: INFO nova.api.openstack.requestlog [None req-7d1944f6-f775-462d-a7dc-28167d9609a6 admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001468 Aug 23 07:05:41.381156 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: [pid: 105717|app: 0|req: 12/24] 10.222.0.17 () {54 vars in 931 bytes} [Tue Aug 23 07:05:41 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 07:05:41.792284 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi [None req-77517178-84b2-4b2c-b718-768163b9dcdd admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "swap": 0, "disk": 20, "id": "2", "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.small", "vcpus": 1, "ram": 2048}} {{(pid=105716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 07:05:41.812847 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: INFO nova.api.openstack.requestlog [None req-77517178-84b2-4b2c-b718-768163b9dcdd admin admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.425121 Aug 23 07:05:41.813516 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: [pid: 105716|app: 0|req: 13/25] 10.222.0.17 () {64 vars in 1283 bytes} [Tue Aug 23 07:05:41 2022] POST /compute/v2.1/flavors => generated 405 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 23 07:05:41.826784 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi [None req-c8b2b2cb-55e2-43da-8c70-f6901dced2cc admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 07:05:41.852492 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: INFO nova.api.openstack.requestlog [None req-c8b2b2cb-55e2-43da-8c70-f6901dced2cc admin admin] 10.222.0.17 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030563 Aug 23 07:05:41.853347 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: [pid: 105717|app: 0|req: 13/26] 10.222.0.17 () {64 vars in 1333 bytes} [Tue Aug 23 07:05:41 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:05:44.187878 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi [None req-77517178-84b2-4b2c-b718-768163b9dcdd admin admin] Calling method '>' {{(pid=105716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:05:44.188900 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: INFO nova.api.openstack.requestlog [None req-77517178-84b2-4b2c-b718-768163b9dcdd admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001555 Aug 23 07:05:44.189308 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: [pid: 105716|app: 0|req: 14/27] 10.222.0.17 () {54 vars in 931 bytes} [Tue Aug 23 07:05:44 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 07:05:44.632469 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi [None req-74cc8c41-fa11-43e8-a7fd-03cbae68d16e admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "vcpus": 2, "disk": 40, "name": "m1.medium", "ram": 4096, "swap": 0, "id": "3"}} {{(pid=105717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 07:05:44.652895 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: INFO nova.api.openstack.requestlog [None req-74cc8c41-fa11-43e8-a7fd-03cbae68d16e admin admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.457484 Aug 23 07:05:44.659639 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: [pid: 105717|app: 0|req: 14/28] 10.222.0.17 () {64 vars in 1283 bytes} [Tue Aug 23 07:05:44 2022] POST /compute/v2.1/flavors => generated 406 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 23 07:05:44.666376 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi [None req-ae451f4d-fd46-42b7-91b2-89513d68787a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 07:05:44.699675 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: INFO nova.api.openstack.requestlog [None req-ae451f4d-fd46-42b7-91b2-89513d68787a admin admin] 10.222.0.17 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.036708 Aug 23 07:05:44.701128 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: [pid: 105716|app: 0|req: 15/29] 10.222.0.17 () {64 vars in 1333 bytes} [Tue Aug 23 07:05:44 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:05:47.148126 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi [None req-74cc8c41-fa11-43e8-a7fd-03cbae68d16e admin admin] Calling method '>' {{(pid=105717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:05:47.150012 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: INFO nova.api.openstack.requestlog [None req-74cc8c41-fa11-43e8-a7fd-03cbae68d16e admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002386 Aug 23 07:05:47.150575 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: [pid: 105717|app: 0|req: 15/30] 10.222.0.17 () {54 vars in 931 bytes} [Tue Aug 23 07:05:47 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 07:05:47.643718 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi [None req-cfb20790-aab3-4008-b42d-d8dfc59c8a2d admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.large", "vcpus": 4, "disk": 80, "ram": 8192, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "4"}} {{(pid=105716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 07:05:47.652205 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG dbcounter [-] [105716] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=8,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=105716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:05:47.664999 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: INFO nova.api.openstack.requestlog [None req-cfb20790-aab3-4008-b42d-d8dfc59c8a2d admin admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.507956 Aug 23 07:05:47.665628 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: [pid: 105716|app: 0|req: 16/31] 10.222.0.17 () {64 vars in 1283 bytes} [Tue Aug 23 07:05:47 2022] POST /compute/v2.1/flavors => generated 405 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 23 07:05:47.679395 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi [None req-7ad377f0-056b-44ed-8168-2d9eca899b51 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 07:05:47.705719 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: INFO nova.api.openstack.requestlog [None req-7ad377f0-056b-44ed-8168-2d9eca899b51 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030143 Aug 23 07:05:47.706126 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: [pid: 105717|app: 0|req: 16/32] 10.222.0.17 () {64 vars in 1333 bytes} [Tue Aug 23 07:05:47 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:05:50.111143 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi [None req-cfb20790-aab3-4008-b42d-d8dfc59c8a2d admin admin] Calling method '>' {{(pid=105716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:05:50.113370 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: INFO nova.api.openstack.requestlog [None req-cfb20790-aab3-4008-b42d-d8dfc59c8a2d admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002440 Aug 23 07:05:50.114271 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: [pid: 105716|app: 0|req: 17/33] 10.222.0.17 () {54 vars in 931 bytes} [Tue Aug 23 07:05:50 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 07:05:50.561948 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi [None req-c4337141-e7c1-4d6f-a98e-387a94765ac3 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "5", "disk": 160, "vcpus": 8, "rxtx_factor": 1.0, "ram": 16384, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "name": "m1.xlarge"}} {{(pid=105717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 07:05:50.587996 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: INFO nova.api.openstack.requestlog [None req-c4337141-e7c1-4d6f-a98e-387a94765ac3 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.467214 Aug 23 07:05:50.595548 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: [pid: 105717|app: 0|req: 17/34] 10.222.0.17 () {64 vars in 1283 bytes} [Tue Aug 23 07:05:50 2022] POST /compute/v2.1/flavors => generated 408 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 23 07:05:50.602994 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi [None req-d27830d5-dfea-4fa9-9a95-eafebc39b1ec admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 07:05:50.630675 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: INFO nova.api.openstack.requestlog [None req-d27830d5-dfea-4fa9-9a95-eafebc39b1ec admin admin] 10.222.0.17 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031816 Aug 23 07:05:50.631253 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: [pid: 105716|app: 0|req: 18/35] 10.222.0.17 () {64 vars in 1333 bytes} [Tue Aug 23 07:05:50 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:06:09.578067 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi [None req-c4337141-e7c1-4d6f-a98e-387a94765ac3 admin admin] Calling method '>' {{(pid=105717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:06:09.579100 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: INFO nova.api.openstack.requestlog [None req-c4337141-e7c1-4d6f-a98e-387a94765ac3 admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001494 Aug 23 07:06:09.579530 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: [pid: 105717|app: 0|req: 18/36] 10.222.0.17 () {54 vars in 931 bytes} [Tue Aug 23 07:06:09 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 07:06:09.593764 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG dbcounter [-] [105716] Writing DB stats nova_api:INSERT=2,nova_api:SELECT=8,nova_api:SAVEPOINT=1,nova_api:RELEASE=1 {{(pid=105716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:06:10.011309 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi [None req-233fcb06-445d-4f38-985d-eab5a8d07309 admin admin] Calling method '>' {{(pid=105716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:06:10.029835 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: INFO nova.api.openstack.requestlog [None req-233fcb06-445d-4f38-985d-eab5a8d07309 admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.443692 Aug 23 07:06:10.030347 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: [pid: 105716|app: 0|req: 19/37] 10.222.0.17 () {60 vars in 1292 bytes} [Tue Aug 23 07:06:09 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 07:06:11.121359 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi [None req-c4337141-e7c1-4d6f-a98e-387a94765ac3 admin admin] Calling method '>' {{(pid=105717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:06:11.122445 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: INFO nova.api.openstack.requestlog [None req-c4337141-e7c1-4d6f-a98e-387a94765ac3 admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001536 Aug 23 07:06:11.122837 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: [pid: 105717|app: 0|req: 19/38] 10.222.0.17 () {56 vars in 1074 bytes} [Tue Aug 23 07:06:11 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 07:06:11.685107 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi [None req-cc4251be-0737-4c9a-937d-38bf0ec4dbe6 admin admin] Calling method '>' {{(pid=105716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:06:11.690872 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: INFO nova.api.openstack.wsgi [None req-cc4251be-0737-4c9a-937d-38bf0ec4dbe6 admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 23 07:06:11.694193 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi [None req-cc4251be-0737-4c9a-937d-38bf0ec4dbe6 admin admin] Request method failure captured: Aug 23 07:06:11.694193 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 23 07:06:11.694193 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: Accept: application/json Aug 23 07:06:11.694193 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: Accept-Encoding: gzip, deflate Aug 23 07:06:11.694193 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: Connection: keep-alive Aug 23 07:06:11.694193 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: Content-Length: 0 Aug 23 07:06:11.694193 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: Host: 10.222.0.17 Aug 23 07:06:11.694193 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: Openstack-Api-Version: compute 2.90 Aug 23 07:06:11.694193 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: Openstack-System-Scope: None Aug 23 07:06:11.694193 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: User-Agent: python-novaclient Aug 23 07:06:11.694193 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: X-Auth-Token: gAAAAABjBHxjHvZdS903Hjax5orY7pH7pBN-9zqv0auH1zlVtV6jUx0-Aa0dGqMIOJKZwOPwIywCb_BDdxfFGav9qc3UJYPThwxXHuTZNPPQ5TXp67Tp8o77mRddtpBC0OeBlNh7PoEJZw9RCrq9Y9qI9RC-cr5vZTJTiUXNAvyrPsm96y8KdzA Aug 23 07:06:11.694193 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: X-Domain-Id: None Aug 23 07:06:11.694193 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: X-Domain-Name: None Aug 23 07:06:11.694193 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: X-Identity-Status: Confirmed Aug 23 07:06:11.694193 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: X-Is-Admin-Project: True Aug 23 07:06:11.694193 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: X-Openstack-Nova-Api-Version: 2.90 Aug 23 07:06:11.694193 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: X-Project-Domain-Id: default Aug 23 07:06:11.694193 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: X-Project-Domain-Name: Default Aug 23 07:06:11.694193 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: X-Project-Id: c7014afbcdaa44f68b1b75e344808f41 Aug 23 07:06:11.694193 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: X-Project-Name: admin Aug 23 07:06:11.694193 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: X-Role: reader,admin,member Aug 23 07:06:11.694193 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: X-Roles: reader,admin,member Aug 23 07:06:11.695784 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/c7014afbcdaa44f68b1b75e344808f41"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/c7014afbcdaa44f68b1b75e344808f41"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_c7014afbcdaa44f68b1b75e344808f41"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/c7014afbcdaa44f68b1b75e344808f41"}]}] Aug 23 07:06:11.695784 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: X-Tenant: admin Aug 23 07:06:11.695784 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: X-Tenant-Id: c7014afbcdaa44f68b1b75e344808f41 Aug 23 07:06:11.695784 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: X-Tenant-Name: admin Aug 23 07:06:11.695784 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: X-User: admin Aug 23 07:06:11.695784 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: X-User-Domain-Id: default Aug 23 07:06:11.695784 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: X-User-Domain-Name: Default Aug 23 07:06:11.695784 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: X-User-Id: 2ff4f07bfac14f428ece0dfbc5ec3579 Aug 23 07:06:11.695784 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: X-User-Name: admin Aug 23 07:06:11.695784 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: method: > Aug 23 07:06:11.695784 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: exception: Flavor 42 could not be found. Aug 23 07:06:11.695784 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: action_args: {'id': '42'} Aug 23 07:06:11.695784 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: {{(pid=105716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 07:06:11.695784 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 07:06:11.696635 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 23 07:06:11.696635 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 23 07:06:11.696635 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 23 07:06:11.696635 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 23 07:06:11.696635 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 23 07:06:11.696635 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 23 07:06:11.696635 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 23 07:06:11.696635 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 23 07:06:11.696635 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 23 07:06:11.696635 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 07:06:11.696635 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 23 07:06:11.696635 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 23 07:06:11.696635 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 23 07:06:11.696635 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: ERROR nova.api.openstack.wsgi Aug 23 07:06:11.696635 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 07:06:11.696635 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: ERROR nova.api.openstack.wsgi Aug 23 07:06:11.696635 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 07:06:11.696635 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 07:06:11.696635 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 07:06:11.697815 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 07:06:11.697815 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 07:06:11.697815 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 07:06:11.697815 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 07:06:11.697815 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 23 07:06:11.697815 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 23 07:06:11.697815 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 23 07:06:11.697815 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: ERROR nova.api.openstack.wsgi Aug 23 07:06:11.697815 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 07:06:11.697815 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: ERROR nova.api.openstack.wsgi Aug 23 07:06:11.697815 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 07:06:11.697815 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 07:06:11.697815 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 07:06:11.697815 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 07:06:11.697815 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 07:06:11.697815 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 23 07:06:11.697815 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: ERROR nova.api.openstack.wsgi Aug 23 07:06:11.697815 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi [None req-cc4251be-0737-4c9a-937d-38bf0ec4dbe6 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=105716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 07:06:11.698840 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: INFO nova.api.openstack.requestlog [None req-cc4251be-0737-4c9a-937d-38bf0ec4dbe6 admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.431376 Aug 23 07:06:11.698840 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: [pid: 105716|app: 0|req: 20/39] 10.222.0.17 () {60 vars in 1190 bytes} [Tue Aug 23 07:06:11 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 432 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 23 07:06:11.706015 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi [None req-78e5c0c8-8364-421d-8bb0-a1946462132d admin admin] Calling method '>' {{(pid=105717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:06:11.710198 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG dbcounter [-] [105717] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=105717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:06:11.730474 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: INFO nova.api.openstack.requestlog [None req-78e5c0c8-8364-421d-8bb0-a1946462132d admin admin] 10.222.0.17 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.028012 Aug 23 07:06:11.731218 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: [pid: 105717|app: 0|req: 20/40] 10.222.0.17 () {60 vars in 1210 bytes} [Tue Aug 23 07:06:11 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 07:06:11.741143 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi [None req-a6bf5860-9c46-49bc-a77f-fda55139806b admin admin] Calling method '>' {{(pid=105716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:06:11.764934 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: INFO nova.api.openstack.requestlog [None req-a6bf5860-9c46-49bc-a77f-fda55139806b admin admin] 10.222.0.17 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.027346 Aug 23 07:06:11.765462 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: [pid: 105716|app: 0|req: 21/41] 10.222.0.17 () {60 vars in 1210 bytes} [Tue Aug 23 07:06:11 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 07:06:11.774926 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi [None req-f681e401-e2eb-4e4f-bdf2-07c38ceea19b admin admin] Calling method '>' {{(pid=105717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:06:11.781351 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: INFO nova.api.openstack.wsgi [None req-f681e401-e2eb-4e4f-bdf2-07c38ceea19b admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 23 07:06:11.784650 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi [None req-f681e401-e2eb-4e4f-bdf2-07c38ceea19b admin admin] Request method failure captured: Aug 23 07:06:11.784650 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 23 07:06:11.784650 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: Accept: application/json Aug 23 07:06:11.784650 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: Accept-Encoding: gzip, deflate Aug 23 07:06:11.784650 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: Connection: keep-alive Aug 23 07:06:11.784650 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: Content-Length: 0 Aug 23 07:06:11.784650 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: Host: 10.222.0.17 Aug 23 07:06:11.784650 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: Openstack-Api-Version: compute 2.90 Aug 23 07:06:11.784650 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: Openstack-System-Scope: None Aug 23 07:06:11.784650 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: User-Agent: python-novaclient Aug 23 07:06:11.784650 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: X-Auth-Token: gAAAAABjBHxjHvZdS903Hjax5orY7pH7pBN-9zqv0auH1zlVtV6jUx0-Aa0dGqMIOJKZwOPwIywCb_BDdxfFGav9qc3UJYPThwxXHuTZNPPQ5TXp67Tp8o77mRddtpBC0OeBlNh7PoEJZw9RCrq9Y9qI9RC-cr5vZTJTiUXNAvyrPsm96y8KdzA Aug 23 07:06:11.784650 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: X-Domain-Id: None Aug 23 07:06:11.784650 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: X-Domain-Name: None Aug 23 07:06:11.784650 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: X-Identity-Status: Confirmed Aug 23 07:06:11.784650 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: X-Is-Admin-Project: True Aug 23 07:06:11.784650 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: X-Openstack-Nova-Api-Version: 2.90 Aug 23 07:06:11.784650 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: X-Project-Domain-Id: default Aug 23 07:06:11.784650 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: X-Project-Domain-Name: Default Aug 23 07:06:11.784650 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: X-Project-Id: c7014afbcdaa44f68b1b75e344808f41 Aug 23 07:06:11.784650 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: X-Project-Name: admin Aug 23 07:06:11.784650 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: X-Role: reader,admin,member Aug 23 07:06:11.784650 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: X-Roles: reader,admin,member Aug 23 07:06:11.786114 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/c7014afbcdaa44f68b1b75e344808f41"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/c7014afbcdaa44f68b1b75e344808f41"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_c7014afbcdaa44f68b1b75e344808f41"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/c7014afbcdaa44f68b1b75e344808f41"}]}] Aug 23 07:06:11.786114 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: X-Tenant: admin Aug 23 07:06:11.786114 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: X-Tenant-Id: c7014afbcdaa44f68b1b75e344808f41 Aug 23 07:06:11.786114 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: X-Tenant-Name: admin Aug 23 07:06:11.786114 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: X-User: admin Aug 23 07:06:11.786114 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: X-User-Domain-Id: default Aug 23 07:06:11.786114 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: X-User-Domain-Name: Default Aug 23 07:06:11.786114 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: X-User-Id: 2ff4f07bfac14f428ece0dfbc5ec3579 Aug 23 07:06:11.786114 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: X-User-Name: admin Aug 23 07:06:11.786114 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: method: > Aug 23 07:06:11.786114 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: exception: Flavor 42 could not be found. Aug 23 07:06:11.786114 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: action_args: {'id': '42'} Aug 23 07:06:11.786114 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: {{(pid=105717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 07:06:11.786114 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 07:06:11.787137 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 23 07:06:11.787137 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 23 07:06:11.787137 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 23 07:06:11.787137 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 23 07:06:11.787137 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 23 07:06:11.787137 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 23 07:06:11.787137 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 23 07:06:11.787137 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 23 07:06:11.787137 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 23 07:06:11.787137 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 07:06:11.787137 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 23 07:06:11.787137 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 23 07:06:11.787137 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 23 07:06:11.787137 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: ERROR nova.api.openstack.wsgi Aug 23 07:06:11.787137 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 07:06:11.787137 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: ERROR nova.api.openstack.wsgi Aug 23 07:06:11.787137 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 07:06:11.787137 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 07:06:11.787137 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 07:06:11.788530 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 07:06:11.788530 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 07:06:11.788530 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 07:06:11.788530 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 07:06:11.788530 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 23 07:06:11.788530 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 23 07:06:11.788530 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 23 07:06:11.788530 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: ERROR nova.api.openstack.wsgi Aug 23 07:06:11.788530 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 07:06:11.788530 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: ERROR nova.api.openstack.wsgi Aug 23 07:06:11.788530 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 07:06:11.788530 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 07:06:11.788530 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 07:06:11.788530 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 07:06:11.788530 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 07:06:11.788530 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 23 07:06:11.788530 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: ERROR nova.api.openstack.wsgi Aug 23 07:06:11.788530 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi [None req-f681e401-e2eb-4e4f-bdf2-07c38ceea19b admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=105717) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 07:06:11.789705 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: INFO nova.api.openstack.requestlog [None req-f681e401-e2eb-4e4f-bdf2-07c38ceea19b admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.014709 Aug 23 07:06:11.789705 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: [pid: 105717|app: 0|req: 21/42] 10.222.0.17 () {60 vars in 1190 bytes} [Tue Aug 23 07:06:11 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 23 07:06:12.769840 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi [None req-a6bf5860-9c46-49bc-a77f-fda55139806b admin admin] Calling method '>' {{(pid=105716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:06:12.770848 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: INFO nova.api.openstack.requestlog [None req-a6bf5860-9c46-49bc-a77f-fda55139806b admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001487 Aug 23 07:06:12.771255 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: [pid: 105716|app: 0|req: 22/43] 10.222.0.17 () {56 vars in 1074 bytes} [Tue Aug 23 07:06:12 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 07:06:13.340546 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi [None req-89de794c-a4ce-4eb5-860c-54fc2a3eec33 admin admin] Calling method '>' {{(pid=105717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:06:13.345947 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: INFO nova.api.openstack.wsgi [None req-89de794c-a4ce-4eb5-860c-54fc2a3eec33 admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 23 07:06:13.347443 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi [None req-89de794c-a4ce-4eb5-860c-54fc2a3eec33 admin admin] Request method failure captured: Aug 23 07:06:13.347443 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 23 07:06:13.347443 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: Accept: application/json Aug 23 07:06:13.347443 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: Accept-Encoding: gzip, deflate Aug 23 07:06:13.347443 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: Connection: keep-alive Aug 23 07:06:13.347443 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: Content-Length: 0 Aug 23 07:06:13.347443 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: Host: 10.222.0.17 Aug 23 07:06:13.347443 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: Openstack-Api-Version: compute 2.90 Aug 23 07:06:13.347443 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: Openstack-System-Scope: None Aug 23 07:06:13.347443 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: User-Agent: python-novaclient Aug 23 07:06:13.347443 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: X-Auth-Token: gAAAAABjBHxkpekgi17uAmELzsaw67ldBQ9Aru2AE4vqBUE9wfycjRFyaSElMs0rW9ToOGQdDvT8lq5egXnaGuoiahbQJYfpf09sC3MvscnFCP9ioE19JXhCXe9Y-ULgeM72tk51wAfK-agWIy9Ta5gxreqI1BbDvDmTep4IWN9a_1kpKrRCefo Aug 23 07:06:13.347443 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: X-Domain-Id: None Aug 23 07:06:13.347443 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: X-Domain-Name: None Aug 23 07:06:13.347443 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: X-Identity-Status: Confirmed Aug 23 07:06:13.347443 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: X-Is-Admin-Project: True Aug 23 07:06:13.347443 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: X-Openstack-Nova-Api-Version: 2.90 Aug 23 07:06:13.347443 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: X-Project-Domain-Id: default Aug 23 07:06:13.347443 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: X-Project-Domain-Name: Default Aug 23 07:06:13.347443 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: X-Project-Id: c7014afbcdaa44f68b1b75e344808f41 Aug 23 07:06:13.347443 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: X-Project-Name: admin Aug 23 07:06:13.347443 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: X-Role: reader,admin,member Aug 23 07:06:13.347443 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: X-Roles: reader,admin,member Aug 23 07:06:13.349055 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/c7014afbcdaa44f68b1b75e344808f41"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/c7014afbcdaa44f68b1b75e344808f41"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_c7014afbcdaa44f68b1b75e344808f41"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/c7014afbcdaa44f68b1b75e344808f41"}]}] Aug 23 07:06:13.349055 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: X-Tenant: admin Aug 23 07:06:13.349055 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: X-Tenant-Id: c7014afbcdaa44f68b1b75e344808f41 Aug 23 07:06:13.349055 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: X-Tenant-Name: admin Aug 23 07:06:13.349055 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: X-User: admin Aug 23 07:06:13.349055 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: X-User-Domain-Id: default Aug 23 07:06:13.349055 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: X-User-Domain-Name: Default Aug 23 07:06:13.349055 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: X-User-Id: 2ff4f07bfac14f428ece0dfbc5ec3579 Aug 23 07:06:13.349055 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: X-User-Name: admin Aug 23 07:06:13.349055 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: method: > Aug 23 07:06:13.349055 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: exception: Flavor 84 could not be found. Aug 23 07:06:13.349055 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: action_args: {'id': '84'} Aug 23 07:06:13.349055 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: {{(pid=105717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 07:06:13.349055 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 07:06:13.350018 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 23 07:06:13.350018 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 23 07:06:13.350018 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 23 07:06:13.350018 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 23 07:06:13.350018 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 23 07:06:13.350018 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 23 07:06:13.350018 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 23 07:06:13.350018 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 23 07:06:13.350018 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 23 07:06:13.350018 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 07:06:13.350018 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 23 07:06:13.350018 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 23 07:06:13.350018 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 23 07:06:13.350018 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: ERROR nova.api.openstack.wsgi Aug 23 07:06:13.350018 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 07:06:13.350018 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: ERROR nova.api.openstack.wsgi Aug 23 07:06:13.350018 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 07:06:13.350018 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 07:06:13.350018 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 07:06:13.351397 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 07:06:13.351397 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 07:06:13.351397 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 07:06:13.351397 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 07:06:13.351397 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 23 07:06:13.351397 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 23 07:06:13.351397 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 23 07:06:13.351397 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: ERROR nova.api.openstack.wsgi Aug 23 07:06:13.351397 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 07:06:13.351397 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: ERROR nova.api.openstack.wsgi Aug 23 07:06:13.351397 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 07:06:13.351397 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 07:06:13.351397 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 07:06:13.351397 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 07:06:13.351397 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 07:06:13.351397 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 23 07:06:13.351397 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: ERROR nova.api.openstack.wsgi Aug 23 07:06:13.351397 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi [None req-89de794c-a4ce-4eb5-860c-54fc2a3eec33 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=105717) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 07:06:13.352685 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: INFO nova.api.openstack.requestlog [None req-89de794c-a4ce-4eb5-860c-54fc2a3eec33 admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.441728 Aug 23 07:06:13.352685 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: [pid: 105717|app: 0|req: 22/44] 10.222.0.17 () {60 vars in 1190 bytes} [Tue Aug 23 07:06:12 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 443 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 23 07:06:13.358907 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi [None req-f2002061-a56b-4d12-a2fa-5ec1e702f19d admin admin] Calling method '>' {{(pid=105716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:06:13.374065 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: INFO nova.api.openstack.requestlog [None req-f2002061-a56b-4d12-a2fa-5ec1e702f19d admin admin] 10.222.0.17 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018812 Aug 23 07:06:13.374552 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: [pid: 105716|app: 0|req: 23/45] 10.222.0.17 () {60 vars in 1210 bytes} [Tue Aug 23 07:06:13 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 07:06:13.384112 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi [None req-621e44e2-87ed-4682-87fb-f2954a123d9f admin admin] Calling method '>' {{(pid=105717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:06:13.399847 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: INFO nova.api.openstack.requestlog [None req-621e44e2-87ed-4682-87fb-f2954a123d9f admin admin] 10.222.0.17 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019233 Aug 23 07:06:13.400388 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: [pid: 105717|app: 0|req: 23/46] 10.222.0.17 () {60 vars in 1210 bytes} [Tue Aug 23 07:06:13 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 07:06:13.409757 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi [None req-fde51416-e867-40c0-880e-f235a6dde5c2 admin admin] Calling method '>' {{(pid=105716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:06:13.415306 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: INFO nova.api.openstack.wsgi [None req-fde51416-e867-40c0-880e-f235a6dde5c2 admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 23 07:06:13.416820 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi [None req-fde51416-e867-40c0-880e-f235a6dde5c2 admin admin] Request method failure captured: Aug 23 07:06:13.416820 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 23 07:06:13.416820 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: Accept: application/json Aug 23 07:06:13.416820 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: Accept-Encoding: gzip, deflate Aug 23 07:06:13.416820 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: Connection: keep-alive Aug 23 07:06:13.416820 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: Content-Length: 0 Aug 23 07:06:13.416820 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: Host: 10.222.0.17 Aug 23 07:06:13.416820 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: Openstack-Api-Version: compute 2.90 Aug 23 07:06:13.416820 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: Openstack-System-Scope: None Aug 23 07:06:13.416820 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: User-Agent: python-novaclient Aug 23 07:06:13.416820 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: X-Auth-Token: gAAAAABjBHxkpekgi17uAmELzsaw67ldBQ9Aru2AE4vqBUE9wfycjRFyaSElMs0rW9ToOGQdDvT8lq5egXnaGuoiahbQJYfpf09sC3MvscnFCP9ioE19JXhCXe9Y-ULgeM72tk51wAfK-agWIy9Ta5gxreqI1BbDvDmTep4IWN9a_1kpKrRCefo Aug 23 07:06:13.416820 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: X-Domain-Id: None Aug 23 07:06:13.416820 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: X-Domain-Name: None Aug 23 07:06:13.416820 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: X-Identity-Status: Confirmed Aug 23 07:06:13.416820 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: X-Is-Admin-Project: True Aug 23 07:06:13.416820 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: X-Openstack-Nova-Api-Version: 2.90 Aug 23 07:06:13.416820 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: X-Project-Domain-Id: default Aug 23 07:06:13.416820 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: X-Project-Domain-Name: Default Aug 23 07:06:13.416820 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: X-Project-Id: c7014afbcdaa44f68b1b75e344808f41 Aug 23 07:06:13.416820 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: X-Project-Name: admin Aug 23 07:06:13.416820 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: X-Role: reader,admin,member Aug 23 07:06:13.416820 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: X-Roles: reader,admin,member Aug 23 07:06:13.418258 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/c7014afbcdaa44f68b1b75e344808f41"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/c7014afbcdaa44f68b1b75e344808f41"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_c7014afbcdaa44f68b1b75e344808f41"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/c7014afbcdaa44f68b1b75e344808f41"}]}] Aug 23 07:06:13.418258 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: X-Tenant: admin Aug 23 07:06:13.418258 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: X-Tenant-Id: c7014afbcdaa44f68b1b75e344808f41 Aug 23 07:06:13.418258 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: X-Tenant-Name: admin Aug 23 07:06:13.418258 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: X-User: admin Aug 23 07:06:13.418258 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: X-User-Domain-Id: default Aug 23 07:06:13.418258 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: X-User-Domain-Name: Default Aug 23 07:06:13.418258 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: X-User-Id: 2ff4f07bfac14f428ece0dfbc5ec3579 Aug 23 07:06:13.418258 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: X-User-Name: admin Aug 23 07:06:13.418258 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: method: > Aug 23 07:06:13.418258 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: exception: Flavor 84 could not be found. Aug 23 07:06:13.418258 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: action_args: {'id': '84'} Aug 23 07:06:13.418258 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: {{(pid=105716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 07:06:13.418258 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 07:06:13.419208 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 23 07:06:13.419208 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 23 07:06:13.419208 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 23 07:06:13.419208 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 23 07:06:13.419208 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 23 07:06:13.419208 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 23 07:06:13.419208 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 23 07:06:13.419208 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 23 07:06:13.419208 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 23 07:06:13.419208 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 07:06:13.419208 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 23 07:06:13.419208 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 23 07:06:13.419208 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 23 07:06:13.419208 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: ERROR nova.api.openstack.wsgi Aug 23 07:06:13.419208 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 07:06:13.419208 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: ERROR nova.api.openstack.wsgi Aug 23 07:06:13.419208 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 07:06:13.419208 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 07:06:13.419208 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 07:06:13.420470 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 07:06:13.420470 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 07:06:13.420470 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 07:06:13.420470 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 07:06:13.420470 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 23 07:06:13.420470 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 23 07:06:13.420470 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 23 07:06:13.420470 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: ERROR nova.api.openstack.wsgi Aug 23 07:06:13.420470 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 07:06:13.420470 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: ERROR nova.api.openstack.wsgi Aug 23 07:06:13.420470 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 07:06:13.420470 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 07:06:13.420470 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 07:06:13.420470 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 07:06:13.420470 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 07:06:13.420470 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 23 07:06:13.420470 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: ERROR nova.api.openstack.wsgi Aug 23 07:06:13.420470 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi [None req-fde51416-e867-40c0-880e-f235a6dde5c2 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=105716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 07:06:13.421460 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: INFO nova.api.openstack.requestlog [None req-fde51416-e867-40c0-880e-f235a6dde5c2 admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.011947 Aug 23 07:06:13.421460 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: [pid: 105716|app: 0|req: 24/47] 10.222.0.17 () {60 vars in 1190 bytes} [Tue Aug 23 07:06:13 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 23 07:06:14.409496 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi [None req-621e44e2-87ed-4682-87fb-f2954a123d9f admin admin] Calling method '>' {{(pid=105717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:06:14.410512 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: INFO nova.api.openstack.requestlog [None req-621e44e2-87ed-4682-87fb-f2954a123d9f admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001439 Aug 23 07:06:14.410902 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: [pid: 105717|app: 0|req: 24/48] 10.222.0.17 () {56 vars in 1074 bytes} [Tue Aug 23 07:06:14 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 07:06:14.968087 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi [None req-a9772f8d-a3b8-44aa-b9fe-a796b5ec42f9 admin admin] Calling method '>' {{(pid=105716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:06:14.974013 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: INFO nova.api.openstack.wsgi [None req-a9772f8d-a3b8-44aa-b9fe-a796b5ec42f9 admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 23 07:06:14.975630 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi [None req-a9772f8d-a3b8-44aa-b9fe-a796b5ec42f9 admin admin] Request method failure captured: Aug 23 07:06:14.975630 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 23 07:06:14.975630 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: Accept: application/json Aug 23 07:06:14.975630 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: Accept-Encoding: gzip, deflate Aug 23 07:06:14.975630 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: Connection: keep-alive Aug 23 07:06:14.975630 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: Content-Length: 0 Aug 23 07:06:14.975630 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: Host: 10.222.0.17 Aug 23 07:06:14.975630 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: Openstack-Api-Version: compute 2.90 Aug 23 07:06:14.975630 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: Openstack-System-Scope: None Aug 23 07:06:14.975630 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: User-Agent: python-novaclient Aug 23 07:06:14.975630 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: X-Auth-Token: gAAAAABjBHxmB71nmNaQSpA4nYCBzyfQ7rzi9NaTycove9JFDAlLjmknQzXOgbbt1X7hCRZdI0ORxSl02m8AMtVlyPOKF3x_fpwo_w6eyLITHxDfgCSnNf9mQHGcFYc9yE9Ro9HfHY8q_XbDWka_Sbs3duqu4_sUQ4q5RnrIRr_F5mrdReQH5nE Aug 23 07:06:14.975630 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: X-Domain-Id: None Aug 23 07:06:14.975630 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: X-Domain-Name: None Aug 23 07:06:14.975630 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: X-Identity-Status: Confirmed Aug 23 07:06:14.975630 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: X-Is-Admin-Project: True Aug 23 07:06:14.975630 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: X-Openstack-Nova-Api-Version: 2.90 Aug 23 07:06:14.975630 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: X-Project-Domain-Id: default Aug 23 07:06:14.975630 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: X-Project-Domain-Name: Default Aug 23 07:06:14.975630 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: X-Project-Id: c7014afbcdaa44f68b1b75e344808f41 Aug 23 07:06:14.975630 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: X-Project-Name: admin Aug 23 07:06:14.975630 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: X-Role: reader,admin,member Aug 23 07:06:14.975630 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: X-Roles: reader,admin,member Aug 23 07:06:14.977161 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/c7014afbcdaa44f68b1b75e344808f41"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/c7014afbcdaa44f68b1b75e344808f41"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_c7014afbcdaa44f68b1b75e344808f41"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/c7014afbcdaa44f68b1b75e344808f41"}]}] Aug 23 07:06:14.977161 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: X-Tenant: admin Aug 23 07:06:14.977161 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: X-Tenant-Id: c7014afbcdaa44f68b1b75e344808f41 Aug 23 07:06:14.977161 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: X-Tenant-Name: admin Aug 23 07:06:14.977161 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: X-User: admin Aug 23 07:06:14.977161 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: X-User-Domain-Id: default Aug 23 07:06:14.977161 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: X-User-Domain-Name: Default Aug 23 07:06:14.977161 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: X-User-Id: 2ff4f07bfac14f428ece0dfbc5ec3579 Aug 23 07:06:14.977161 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: X-User-Name: admin Aug 23 07:06:14.977161 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: method: > Aug 23 07:06:14.977161 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: exception: Flavor 451 could not be found. Aug 23 07:06:14.977161 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: action_args: {'id': '451'} Aug 23 07:06:14.977161 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: {{(pid=105716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 07:06:14.977161 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 07:06:14.977991 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 23 07:06:14.977991 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 23 07:06:14.977991 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 23 07:06:14.977991 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 23 07:06:14.977991 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 23 07:06:14.977991 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 23 07:06:14.977991 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 23 07:06:14.977991 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 23 07:06:14.977991 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 23 07:06:14.977991 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 07:06:14.977991 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 23 07:06:14.977991 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 23 07:06:14.977991 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 23 07:06:14.977991 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: ERROR nova.api.openstack.wsgi Aug 23 07:06:14.977991 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 07:06:14.977991 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: ERROR nova.api.openstack.wsgi Aug 23 07:06:14.977991 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 07:06:14.977991 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 07:06:14.977991 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 07:06:14.979092 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 07:06:14.979092 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 07:06:14.979092 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 07:06:14.979092 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 07:06:14.979092 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 23 07:06:14.979092 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 23 07:06:14.979092 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 23 07:06:14.979092 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: ERROR nova.api.openstack.wsgi Aug 23 07:06:14.979092 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 07:06:14.979092 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: ERROR nova.api.openstack.wsgi Aug 23 07:06:14.979092 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 07:06:14.979092 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 07:06:14.979092 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 07:06:14.979092 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 07:06:14.979092 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 07:06:14.979092 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 23 07:06:14.979092 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: ERROR nova.api.openstack.wsgi Aug 23 07:06:14.979092 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi [None req-a9772f8d-a3b8-44aa-b9fe-a796b5ec42f9 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=105716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 07:06:14.980585 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: INFO nova.api.openstack.requestlog [None req-a9772f8d-a3b8-44aa-b9fe-a796b5ec42f9 admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.428800 Aug 23 07:06:14.980585 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: [pid: 105716|app: 0|req: 25/49] 10.222.0.17 () {60 vars in 1193 bytes} [Tue Aug 23 07:06:14 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 430 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 23 07:06:14.990316 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi [None req-172b940f-71fc-479d-b8e2-16abd9e23eff admin admin] Calling method '>' {{(pid=105717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:06:15.007260 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: INFO nova.api.openstack.requestlog [None req-172b940f-71fc-479d-b8e2-16abd9e23eff admin admin] 10.222.0.17 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.022785 Aug 23 07:06:15.007807 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: [pid: 105717|app: 0|req: 25/50] 10.222.0.17 () {60 vars in 1210 bytes} [Tue Aug 23 07:06:14 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 07:06:15.017888 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi [None req-765625d6-6482-4f5b-a761-237928115dcc admin admin] Calling method '>' {{(pid=105716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:06:15.033352 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: INFO nova.api.openstack.requestlog [None req-765625d6-6482-4f5b-a761-237928115dcc admin admin] 10.222.0.17 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019297 Aug 23 07:06:15.034196 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: [pid: 105716|app: 0|req: 26/51] 10.222.0.17 () {60 vars in 1210 bytes} [Tue Aug 23 07:06:15 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 07:06:15.043632 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi [None req-6a0b2bb1-bf72-49e3-9c73-ee3b1027eb58 admin admin] Calling method '>' {{(pid=105717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:06:15.049336 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: INFO nova.api.openstack.wsgi [None req-6a0b2bb1-bf72-49e3-9c73-ee3b1027eb58 admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 23 07:06:15.050824 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi [None req-6a0b2bb1-bf72-49e3-9c73-ee3b1027eb58 admin admin] Request method failure captured: Aug 23 07:06:15.050824 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 23 07:06:15.050824 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: Accept: application/json Aug 23 07:06:15.050824 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: Accept-Encoding: gzip, deflate Aug 23 07:06:15.050824 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: Connection: keep-alive Aug 23 07:06:15.050824 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: Content-Length: 0 Aug 23 07:06:15.050824 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: Host: 10.222.0.17 Aug 23 07:06:15.050824 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: Openstack-Api-Version: compute 2.90 Aug 23 07:06:15.050824 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: Openstack-System-Scope: None Aug 23 07:06:15.050824 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: User-Agent: python-novaclient Aug 23 07:06:15.050824 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: X-Auth-Token: gAAAAABjBHxmB71nmNaQSpA4nYCBzyfQ7rzi9NaTycove9JFDAlLjmknQzXOgbbt1X7hCRZdI0ORxSl02m8AMtVlyPOKF3x_fpwo_w6eyLITHxDfgCSnNf9mQHGcFYc9yE9Ro9HfHY8q_XbDWka_Sbs3duqu4_sUQ4q5RnrIRr_F5mrdReQH5nE Aug 23 07:06:15.050824 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: X-Domain-Id: None Aug 23 07:06:15.050824 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: X-Domain-Name: None Aug 23 07:06:15.050824 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: X-Identity-Status: Confirmed Aug 23 07:06:15.050824 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: X-Is-Admin-Project: True Aug 23 07:06:15.050824 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: X-Openstack-Nova-Api-Version: 2.90 Aug 23 07:06:15.050824 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: X-Project-Domain-Id: default Aug 23 07:06:15.050824 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: X-Project-Domain-Name: Default Aug 23 07:06:15.050824 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: X-Project-Id: c7014afbcdaa44f68b1b75e344808f41 Aug 23 07:06:15.050824 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: X-Project-Name: admin Aug 23 07:06:15.050824 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: X-Role: reader,admin,member Aug 23 07:06:15.050824 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: X-Roles: reader,admin,member Aug 23 07:06:15.052294 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/c7014afbcdaa44f68b1b75e344808f41"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/c7014afbcdaa44f68b1b75e344808f41"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_c7014afbcdaa44f68b1b75e344808f41"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/c7014afbcdaa44f68b1b75e344808f41"}]}] Aug 23 07:06:15.052294 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: X-Tenant: admin Aug 23 07:06:15.052294 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: X-Tenant-Id: c7014afbcdaa44f68b1b75e344808f41 Aug 23 07:06:15.052294 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: X-Tenant-Name: admin Aug 23 07:06:15.052294 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: X-User: admin Aug 23 07:06:15.052294 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: X-User-Domain-Id: default Aug 23 07:06:15.052294 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: X-User-Domain-Name: Default Aug 23 07:06:15.052294 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: X-User-Id: 2ff4f07bfac14f428ece0dfbc5ec3579 Aug 23 07:06:15.052294 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: X-User-Name: admin Aug 23 07:06:15.052294 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: method: > Aug 23 07:06:15.052294 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: exception: Flavor 451 could not be found. Aug 23 07:06:15.052294 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: action_args: {'id': '451'} Aug 23 07:06:15.052294 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: {{(pid=105717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 07:06:15.052294 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 07:06:15.053100 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 23 07:06:15.053100 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 23 07:06:15.053100 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 23 07:06:15.053100 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 23 07:06:15.053100 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 23 07:06:15.053100 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 23 07:06:15.053100 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 23 07:06:15.053100 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 23 07:06:15.053100 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 23 07:06:15.053100 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 07:06:15.053100 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 23 07:06:15.053100 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 23 07:06:15.053100 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 23 07:06:15.053100 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: ERROR nova.api.openstack.wsgi Aug 23 07:06:15.053100 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 07:06:15.053100 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: ERROR nova.api.openstack.wsgi Aug 23 07:06:15.053100 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 07:06:15.053100 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 07:06:15.053100 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 07:06:15.054141 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 07:06:15.054141 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 07:06:15.054141 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 07:06:15.054141 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 07:06:15.054141 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 23 07:06:15.054141 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 23 07:06:15.054141 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 23 07:06:15.054141 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: ERROR nova.api.openstack.wsgi Aug 23 07:06:15.054141 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 07:06:15.054141 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: ERROR nova.api.openstack.wsgi Aug 23 07:06:15.054141 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 07:06:15.054141 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 07:06:15.054141 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 07:06:15.054141 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 07:06:15.054141 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 07:06:15.054141 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 23 07:06:15.054141 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: ERROR nova.api.openstack.wsgi Aug 23 07:06:15.054141 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi [None req-6a0b2bb1-bf72-49e3-9c73-ee3b1027eb58 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=105717) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 07:06:15.055146 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: INFO nova.api.openstack.requestlog [None req-6a0b2bb1-bf72-49e3-9c73-ee3b1027eb58 admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.012109 Aug 23 07:06:15.055146 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: [pid: 105717|app: 0|req: 26/52] 10.222.0.17 () {60 vars in 1193 bytes} [Tue Aug 23 07:06:15 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 23 07:06:16.071298 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi [None req-765625d6-6482-4f5b-a761-237928115dcc admin admin] Calling method '>' {{(pid=105716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:06:16.072332 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: INFO nova.api.openstack.requestlog [None req-765625d6-6482-4f5b-a761-237928115dcc admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001478 Aug 23 07:06:16.072733 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: [pid: 105716|app: 0|req: 27/53] 10.222.0.17 () {56 vars in 1074 bytes} [Tue Aug 23 07:06:16 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 07:06:16.639320 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi [None req-c04edc79-27f8-443b-96b8-3e584d0e350f admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 07:06:16.660871 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: INFO nova.api.openstack.requestlog [None req-c04edc79-27f8-443b-96b8-3e584d0e350f admin admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.449750 Aug 23 07:06:16.661412 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: [pid: 105717|app: 0|req: 27/54] 10.222.0.17 () {64 vars in 1235 bytes} [Tue Aug 23 07:06:16 2022] POST /compute/v2.1/flavors => generated 404 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 23 07:06:17.668250 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi [None req-765625d6-6482-4f5b-a761-237928115dcc admin admin] Calling method '>' {{(pid=105716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:06:17.669210 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: INFO nova.api.openstack.requestlog [None req-765625d6-6482-4f5b-a761-237928115dcc admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001937 Aug 23 07:06:17.669601 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: [pid: 105716|app: 0|req: 28/55] 10.222.0.17 () {56 vars in 1074 bytes} [Tue Aug 23 07:06:17 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 07:06:18.255358 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi [None req-abd461cd-47f2-41ab-b718-3b01fec5925a admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 07:06:18.278711 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: INFO nova.api.openstack.requestlog [None req-abd461cd-47f2-41ab-b718-3b01fec5925a admin admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.464494 Aug 23 07:06:18.279250 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: [pid: 105717|app: 0|req: 28/56] 10.222.0.17 () {64 vars in 1235 bytes} [Tue Aug 23 07:06:17 2022] POST /compute/v2.1/flavors => generated 405 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 23 07:06:19.322097 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi [None req-765625d6-6482-4f5b-a761-237928115dcc admin admin] Calling method '>' {{(pid=105716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:06:19.323106 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: INFO nova.api.openstack.requestlog [None req-765625d6-6482-4f5b-a761-237928115dcc admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001447 Aug 23 07:06:19.323523 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: [pid: 105716|app: 0|req: 29/57] 10.222.0.17 () {56 vars in 1074 bytes} [Tue Aug 23 07:06:19 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 07:06:19.931838 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi [None req-e23e4acd-fa76-4468-a564-a011df2bca8b admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 07:06:19.957108 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: INFO nova.api.openstack.requestlog [None req-e23e4acd-fa76-4468-a564-a011df2bca8b admin admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.491126 Aug 23 07:06:19.957603 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: [pid: 105717|app: 0|req: 29/58] 10.222.0.17 () {64 vars in 1235 bytes} [Tue Aug 23 07:06:19 2022] POST /compute/v2.1/flavors => generated 407 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 23 07:06:20.940532 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi [None req-765625d6-6482-4f5b-a761-237928115dcc admin admin] Calling method '>' {{(pid=105716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:06:20.941536 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: INFO nova.api.openstack.requestlog [None req-765625d6-6482-4f5b-a761-237928115dcc admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001447 Aug 23 07:06:20.941932 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: [pid: 105716|app: 0|req: 30/59] 10.222.0.17 () {56 vars in 1074 bytes} [Tue Aug 23 07:06:20 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 07:06:21.506051 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi [None req-d2873999-f59a-4a50-a7e9-e054f15f8e2c admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 07:06:21.533480 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: INFO nova.api.openstack.requestlog [None req-d2873999-f59a-4a50-a7e9-e054f15f8e2c admin admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.450737 Aug 23 07:06:21.533941 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: [pid: 105717|app: 0|req: 30/60] 10.222.0.17 () {64 vars in 1235 bytes} [Tue Aug 23 07:06:21 2022] POST /compute/v2.1/flavors => generated 409 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 23 07:06:22.524920 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi [None req-765625d6-6482-4f5b-a761-237928115dcc admin admin] Calling method '>' {{(pid=105716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:06:22.525957 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: INFO nova.api.openstack.requestlog [None req-765625d6-6482-4f5b-a761-237928115dcc admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001481 Aug 23 07:06:22.526343 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: [pid: 105716|app: 0|req: 31/61] 10.222.0.17 () {56 vars in 1074 bytes} [Tue Aug 23 07:06:22 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 07:06:23.086916 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi [None req-3ee6037a-d508-4f2a-91f1-6cd5ccb8428a admin admin] Calling method '>' {{(pid=105717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:06:23.108254 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: INFO nova.api.openstack.requestlog [None req-3ee6037a-d508-4f2a-91f1-6cd5ccb8428a admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.446952 Aug 23 07:06:23.108818 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: [pid: 105717|app: 0|req: 31/62] 10.222.0.17 () {60 vars in 1202 bytes} [Tue Aug 23 07:06:22 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 07:07:17.050273 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi [None req-765625d6-6482-4f5b-a761-237928115dcc admin admin] Calling method '>' {{(pid=105716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:07:17.051275 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: INFO nova.api.openstack.requestlog [None req-765625d6-6482-4f5b-a761-237928115dcc admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001470 Aug 23 07:07:17.051739 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: [pid: 105716|app: 0|req: 32/63] 10.222.0.17 () {54 vars in 931 bytes} [Tue Aug 23 07:07:17 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 07:07:17.062739 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG dbcounter [-] [105717] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=105717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:07:17.499103 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi [None req-f71316bd-70d2-45ee-87bb-038df6aba733 admin admin] Calling method '>' {{(pid=105717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:07:17.519588 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: INFO nova.api.openstack.requestlog [None req-f71316bd-70d2-45ee-87bb-038df6aba733 admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.461710 Aug 23 07:07:17.520118 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: [pid: 105717|app: 0|req: 32/64] 10.222.0.17 () {60 vars in 1292 bytes} [Tue Aug 23 07:07:17 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 07:07:17.551376 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG dbcounter [-] [105716] Writing DB stats nova_api:SELECT=14 {{(pid=105716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:07:17.556792 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi [None req-dc56daec-6dbe-4b9d-a3f4-93ec76861af9 admin admin] Calling method '>' {{(pid=105716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:07:17.568957 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: INFO nova.api.openstack.requestlog [None req-dc56daec-6dbe-4b9d-a3f4-93ec76861af9 admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.019580 Aug 23 07:07:17.569653 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: [pid: 105716|app: 0|req: 33/65] 10.222.0.17 () {60 vars in 1283 bytes} [Tue Aug 23 07:07:17 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:07:17.585834 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi [None req-6c949764-f7a3-4125-8840-f8c4d8835d61 admin admin] Calling method '>' {{(pid=105717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:07:17.593813 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: INFO nova.api.openstack.requestlog [None req-6c949764-f7a3-4125-8840-f8c4d8835d61 admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011729 Aug 23 07:07:17.594332 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: [pid: 105717|app: 0|req: 33/66] 10.222.0.17 () {60 vars in 1286 bytes} [Tue Aug 23 07:07:17 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:07:17.606234 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi [None req-080eeea0-3ae5-4936-ace8-d978fd87b4ca admin admin] Calling method '>' {{(pid=105716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:07:17.614015 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: INFO nova.api.openstack.requestlog [None req-080eeea0-3ae5-4936-ace8-d978fd87b4ca admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011447 Aug 23 07:07:17.614518 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: [pid: 105716|app: 0|req: 34/67] 10.222.0.17 () {60 vars in 1286 bytes} [Tue Aug 23 07:07:17 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:07:17.634030 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi [None req-22240b2f-12ed-41c4-897c-965c753f7b5c admin admin] Calling method '>' {{(pid=105717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:07:17.644449 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: INFO nova.api.openstack.requestlog [None req-22240b2f-12ed-41c4-897c-965c753f7b5c admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.020009 Aug 23 07:07:17.645014 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: [pid: 105717|app: 0|req: 34/68] 10.222.0.17 () {60 vars in 1283 bytes} [Tue Aug 23 07:07:17 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:10:17.528890 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi [None req-080eeea0-3ae5-4936-ace8-d978fd87b4ca admin admin] Calling method '>' {{(pid=105716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:10:17.529935 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: INFO nova.api.openstack.requestlog [None req-080eeea0-3ae5-4936-ace8-d978fd87b4ca admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001490 Aug 23 07:10:17.530328 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: [pid: 105716|app: 0|req: 35/69] 10.222.0.17 () {56 vars in 1074 bytes} [Tue Aug 23 07:10:17 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 07:10:17.674620 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG dbcounter [-] [105717] Writing DB stats nova_api:SELECT=6 {{(pid=105717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:10:17.869343 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi [None req-abbc59ec-2a4b-48a1-84b4-6dfcea3afde9 admin admin] Calling method '>' {{(pid=105717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:10:17.871782 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 07:10:17.871782 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: warnings.warn(msg) Aug 23 07:10:17.872888 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG oslo_concurrency.lockutils [None req-abbc59ec-2a4b-48a1-84b4-6dfcea3afde9 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:10:17.873350 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG oslo_concurrency.lockutils [None req-abbc59ec-2a4b-48a1-84b4-6dfcea3afde9 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:10:17.873760 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG oslo_concurrency.lockutils [None req-abbc59ec-2a4b-48a1-84b4-6dfcea3afde9 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:10:17.874446 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG oslo_concurrency.lockutils [None req-abbc59ec-2a4b-48a1-84b4-6dfcea3afde9 admin admin] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:10:17.874874 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG oslo_concurrency.lockutils [None req-abbc59ec-2a4b-48a1-84b4-6dfcea3afde9 admin admin] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:10:17.875272 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG oslo_concurrency.lockutils [None req-abbc59ec-2a4b-48a1-84b4-6dfcea3afde9 admin admin] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:10:17.908959 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: INFO nova.api.openstack.requestlog [None req-abbc59ec-2a4b-48a1-84b4-6dfcea3afde9 admin admin] 10.222.0.17 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.235708 Aug 23 07:10:17.909427 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: [pid: 105717|app: 0|req: 35/70] 10.222.0.17 () {60 vars in 1193 bytes} [Tue Aug 23 07:10:17 2022] GET /compute/v2.1/os-services => generated 791 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 23 07:10:18.735850 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi [None req-080eeea0-3ae5-4936-ace8-d978fd87b4ca admin admin] Calling method '>' {{(pid=105716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:10:18.736858 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: INFO nova.api.openstack.requestlog [None req-080eeea0-3ae5-4936-ace8-d978fd87b4ca admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001490 Aug 23 07:10:18.737259 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: [pid: 105716|app: 0|req: 36/71] 10.222.0.17 () {56 vars in 1074 bytes} [Tue Aug 23 07:10:18 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 07:10:18.940372 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi [None req-60ad01d4-44d8-400f-8442-e6420580c28e admin admin] Calling method '>' {{(pid=105717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:10:18.942780 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 07:10:18.942780 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: warnings.warn(msg) Aug 23 07:10:18.943907 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG oslo_concurrency.lockutils [None req-60ad01d4-44d8-400f-8442-e6420580c28e admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:10:18.944442 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG oslo_concurrency.lockutils [None req-60ad01d4-44d8-400f-8442-e6420580c28e admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:10:18.944776 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG oslo_concurrency.lockutils [None req-60ad01d4-44d8-400f-8442-e6420580c28e admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:10:18.945507 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG oslo_concurrency.lockutils [None req-60ad01d4-44d8-400f-8442-e6420580c28e admin admin] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:10:18.945919 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG oslo_concurrency.lockutils [None req-60ad01d4-44d8-400f-8442-e6420580c28e admin admin] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:10:18.946319 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG oslo_concurrency.lockutils [None req-60ad01d4-44d8-400f-8442-e6420580c28e admin admin] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:10:18.966509 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: INFO nova.api.openstack.requestlog [None req-60ad01d4-44d8-400f-8442-e6420580c28e admin admin] 10.222.0.17 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.086530 Aug 23 07:10:18.967083 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: [pid: 105717|app: 0|req: 36/72] 10.222.0.17 () {60 vars in 1193 bytes} [Tue Aug 23 07:10:18 2022] GET /compute/v2.1/os-services => generated 791 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 23 07:10:30.272339 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi [None req-080eeea0-3ae5-4936-ace8-d978fd87b4ca admin admin] Calling method '>' {{(pid=105716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:10:30.273327 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: INFO nova.api.openstack.requestlog [None req-080eeea0-3ae5-4936-ace8-d978fd87b4ca admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001435 Aug 23 07:10:30.273714 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: [pid: 105716|app: 0|req: 37/73] 10.222.0.17 () {56 vars in 1074 bytes} [Tue Aug 23 07:10:30 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 07:10:30.418700 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG dbcounter [-] [105717] Writing DB stats nova_cell0:SELECT=4 {{(pid=105717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:10:30.419589 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG dbcounter [-] [105717] Writing DB stats nova_cell1:SELECT=4 {{(pid=105717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:10:30.420724 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG dbcounter [-] [105717] Writing DB stats nova_api:SELECT=8 {{(pid=105717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:10:30.475745 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi [None req-fc3ed6e2-4ca9-48b1-b962-85c90d532c2a admin admin] Calling method '>' {{(pid=105717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:10:30.478120 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 07:10:30.478120 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: warnings.warn(msg) Aug 23 07:10:30.479212 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG oslo_concurrency.lockutils [None req-fc3ed6e2-4ca9-48b1-b962-85c90d532c2a admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:10:30.479891 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG oslo_concurrency.lockutils [None req-fc3ed6e2-4ca9-48b1-b962-85c90d532c2a admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:10:30.480343 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG oslo_concurrency.lockutils [None req-fc3ed6e2-4ca9-48b1-b962-85c90d532c2a admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=105717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:10:30.481068 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG oslo_concurrency.lockutils [None req-fc3ed6e2-4ca9-48b1-b962-85c90d532c2a admin admin] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:10:30.481498 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG oslo_concurrency.lockutils [None req-fc3ed6e2-4ca9-48b1-b962-85c90d532c2a admin admin] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:10:30.481900 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG oslo_concurrency.lockutils [None req-fc3ed6e2-4ca9-48b1-b962-85c90d532c2a admin admin] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:10:30.507030 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: INFO nova.api.openstack.requestlog [None req-fc3ed6e2-4ca9-48b1-b962-85c90d532c2a admin admin] 10.222.0.17 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.096434 Aug 23 07:10:30.507614 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: [pid: 105717|app: 0|req: 37/74] 10.222.0.17 () {60 vars in 1193 bytes} [Tue Aug 23 07:10:30 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 07:10:31.348105 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: DEBUG nova.api.openstack.wsgi [None req-080eeea0-3ae5-4936-ace8-d978fd87b4ca admin admin] Calling method '>' {{(pid=105716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:10:31.349114 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: INFO nova.api.openstack.requestlog [None req-080eeea0-3ae5-4936-ace8-d978fd87b4ca admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001450 Aug 23 07:10:31.349507 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: [pid: 105716|app: 0|req: 38/75] 10.222.0.17 () {56 vars in 1074 bytes} [Tue Aug 23 07:10:31 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 07:10:31.554765 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG nova.api.openstack.wsgi [None req-25881b9c-66d4-4f66-9466-3e6015f0f4d9 admin admin] Calling method '>' {{(pid=105717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:10:31.557921 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 07:10:31.557921 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: warnings.warn(msg) Aug 23 07:10:31.559018 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG oslo_concurrency.lockutils [None req-25881b9c-66d4-4f66-9466-3e6015f0f4d9 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:10:31.559507 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG oslo_concurrency.lockutils [None req-25881b9c-66d4-4f66-9466-3e6015f0f4d9 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:10:31.559929 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG oslo_concurrency.lockutils [None req-25881b9c-66d4-4f66-9466-3e6015f0f4d9 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:10:31.560634 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG oslo_concurrency.lockutils [None req-25881b9c-66d4-4f66-9466-3e6015f0f4d9 admin admin] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:10:31.561063 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG oslo_concurrency.lockutils [None req-25881b9c-66d4-4f66-9466-3e6015f0f4d9 admin admin] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:10:31.561467 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: DEBUG oslo_concurrency.lockutils [None req-25881b9c-66d4-4f66-9466-3e6015f0f4d9 admin admin] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:10:31.583201 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: INFO nova.api.openstack.requestlog [None req-25881b9c-66d4-4f66-9466-3e6015f0f4d9 admin admin] 10.222.0.17 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.094353 Aug 23 07:10:31.583794 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: [pid: 105717|app: 0|req: 38/76] 10.222.0.17 () {60 vars in 1193 bytes} [Tue Aug 23 07:10:31 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 07:11:28.550958 dv-cinder-854092-1-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Aug 23 07:11:28.551563 dv-cinder-854092-1-iscsi devstack@n-api.service[105715]: Tue Aug 23 07:11:28 2022 - graceful shutdown triggered... Aug 23 07:11:28.552257 dv-cinder-854092-1-iscsi devstack@n-api.service[105716]: Gracefully killing worker 1 (pid: 105716)... Aug 23 07:11:28.553118 dv-cinder-854092-1-iscsi devstack@n-api.service[105717]: Gracefully killing worker 2 (pid: 105717)... Aug 23 07:11:29.552567 dv-cinder-854092-1-iscsi devstack@n-api.service[105715]: worker 1 buried after 1 seconds Aug 23 07:11:29.552567 dv-cinder-854092-1-iscsi devstack@n-api.service[105715]: worker 2 buried after 1 seconds Aug 23 07:11:29.552567 dv-cinder-854092-1-iscsi devstack@n-api.service[105715]: goodbye to uWSGI. Aug 23 07:11:29.555071 dv-cinder-854092-1-iscsi systemd[1]: devstack@n-api.service: Succeeded. Aug 23 07:11:29.556063 dv-cinder-854092-1-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Aug 23 07:11:29.560003 dv-cinder-854092-1-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 23 07:11:29.571577 dv-cinder-854092-1-iscsi devstack@n-api.service[120785]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 23 07:11:29.574006 dv-cinder-854092-1-iscsi devstack@n-api.service[120785]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Aug 23 07:11:29 2022] *** Aug 23 07:11:29.574006 dv-cinder-854092-1-iscsi devstack@n-api.service[120785]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 23 07:11:29.574006 dv-cinder-854092-1-iscsi devstack@n-api.service[120785]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 23 07:11:29.574006 dv-cinder-854092-1-iscsi devstack@n-api.service[120785]: nodename: dv-cinder-854092-1-iscsi Aug 23 07:11:29.574006 dv-cinder-854092-1-iscsi devstack@n-api.service[120785]: machine: x86_64 Aug 23 07:11:29.574006 dv-cinder-854092-1-iscsi devstack@n-api.service[120785]: clock source: unix Aug 23 07:11:29.574006 dv-cinder-854092-1-iscsi devstack@n-api.service[120785]: pcre jit disabled Aug 23 07:11:29.574006 dv-cinder-854092-1-iscsi devstack@n-api.service[120785]: detected number of CPU cores: 4 Aug 23 07:11:29.574006 dv-cinder-854092-1-iscsi devstack@n-api.service[120785]: current working directory: / Aug 23 07:11:29.574006 dv-cinder-854092-1-iscsi devstack@n-api.service[120785]: detected binary path: /usr/bin/uwsgi-core Aug 23 07:11:29.574006 dv-cinder-854092-1-iscsi devstack@n-api.service[120785]: your processes number limit is 47680 Aug 23 07:11:29.574893 dv-cinder-854092-1-iscsi devstack@n-api.service[120785]: your memory page size is 4096 bytes Aug 23 07:11:29.574893 dv-cinder-854092-1-iscsi devstack@n-api.service[120785]: detected max file descriptor number: 2048 Aug 23 07:11:29.574893 dv-cinder-854092-1-iscsi devstack@n-api.service[120785]: lock engine: pthread robust mutexes Aug 23 07:11:29.574893 dv-cinder-854092-1-iscsi devstack@n-api.service[120785]: thunder lock: enabled Aug 23 07:11:29.574893 dv-cinder-854092-1-iscsi devstack@n-api.service[120785]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 23 07:11:29.574893 dv-cinder-854092-1-iscsi devstack@n-api.service[120785]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 23 07:11:29.620903 dv-cinder-854092-1-iscsi devstack@n-api.service[120785]: Python main interpreter initialized at 0x55a81a1309c0 Aug 23 07:11:29.620903 dv-cinder-854092-1-iscsi devstack@n-api.service[120785]: python threads support enabled Aug 23 07:11:29.620903 dv-cinder-854092-1-iscsi devstack@n-api.service[120785]: your server socket listen backlog is limited to 100 connections Aug 23 07:11:29.620903 dv-cinder-854092-1-iscsi devstack@n-api.service[120785]: your mercy for graceful operations on workers is 90 seconds Aug 23 07:11:29.620903 dv-cinder-854092-1-iscsi devstack@n-api.service[120785]: mapped 403077 bytes (393 KB) for 2 cores Aug 23 07:11:29.620903 dv-cinder-854092-1-iscsi devstack@n-api.service[120785]: *** Operational MODE: preforking *** Aug 23 07:11:29.620903 dv-cinder-854092-1-iscsi devstack@n-api.service[120785]: *** uWSGI is running in multiple interpreter mode *** Aug 23 07:11:29.620903 dv-cinder-854092-1-iscsi devstack@n-api.service[120785]: spawned uWSGI master process (pid: 120785) Aug 23 07:11:29.620903 dv-cinder-854092-1-iscsi devstack@n-api.service[120785]: spawned uWSGI worker 1 (pid: 120798, cores: 1) Aug 23 07:11:29.620903 dv-cinder-854092-1-iscsi devstack@n-api.service[120785]: spawned uWSGI worker 2 (pid: 120799, cores: 1) Aug 23 07:11:29.620903 dv-cinder-854092-1-iscsi devstack@n-api.service[120785]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 23 07:11:29.617171 dv-cinder-854092-1-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 23 07:11:30.276261 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 23 07:11:30.276873 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 23 07:11:31.422036 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 23 07:11:31.422036 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: from cryptography.utils import int_from_bytes Aug 23 07:11:31.422741 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 23 07:11:31.422741 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: from cryptography.utils import int_from_bytes Aug 23 07:11:31.436745 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 23 07:11:31.436745 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: from cryptography.utils import int_from_bytes Aug 23 07:11:31.437307 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 23 07:11:31.437307 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: from cryptography.utils import int_from_bytes Aug 23 07:11:33.795726 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 23 07:11:33.796323 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 23 07:11:33.796593 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 23 07:11:33.796881 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 23 07:11:33.797135 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 23 07:11:33.797534 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:11:33.797849 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:11:33.798172 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:11:33.798487 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:11:33.798952 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:11:33.799269 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:11:33.799603 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:11:33.799926 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:11:33.800261 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:11:33.800523 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:11:33.800838 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:11:33.801201 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-854092-1-iscsi {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:11:33.801495 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:11:33.801885 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:11:33.802105 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:11:33.802405 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:11:33.802550 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 23 07:11:33.802938 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 23 07:11:33.803240 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 23 07:11:33.803469 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:11:33.803592 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 23 07:11:33.803819 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:11:33.803938 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 23 07:11:33.804134 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:11:33.804232 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:11:33.804537 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:11:33.804639 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:11:33.811563 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:11:33.811732 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:11:33.811818 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:11:33.811906 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:11:33.811989 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:11:33.812071 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:11:33.812157 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:11:33.812230 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:11:33.812308 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:11:33.812406 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:11:33.812480 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:11:33.812556 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:11:33.812642 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:11:33.812727 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:11:33.812806 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:11:33.812884 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:11:33.812955 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:11:33.813032 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:11:33.813103 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-854092-1-iscsi {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:11:33.813180 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:11:33.813260 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:11:33.813343 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-854092-1-iscsi {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:11:33.813430 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:11:33.813508 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:11:33.813586 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:11:33.813663 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:11:33.813741 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:11:33.813812 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:11:33.813889 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:11:33.813889 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:11:33.814028 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:11:33.814108 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:11:33.814185 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:11:33.814185 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:11:33.814326 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:11:33.814411 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:11:33.814487 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:11:33.814569 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:11:33.814645 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:11:33.814727 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:11:33.814798 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:11:33.814867 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:11:33.814943 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:11:33.815019 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:11:33.815095 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:11:33.815176 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:11:33.815262 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:11:33.815794 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:11:33.816042 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:11:33.816225 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:11:33.816440 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:11:33.816647 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:11:33.816822 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:11:33.816965 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:11:33.817205 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:11:33.817376 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:11:33.817624 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-854092-1-iscsi {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:11:33.817805 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:11:33.817983 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:11:33.818161 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:11:33.818341 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:11:33.818523 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:11:33.818748 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:11:33.818929 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:11:33.819097 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:11:33.819272 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:11:33.819465 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:11:33.819658 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:11:33.819859 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:11:33.820056 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:11:33.820220 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:11:33.820479 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:11:33.820479 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:11:33.820875 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:11:33.821057 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:11:33.821208 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:11:33.821360 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:11:33.821516 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:11:33.821669 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:11:33.821893 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:11:33.822043 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:11:33.822188 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:11:33.822363 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:11:33.822556 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:11:33.822781 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:11:33.822969 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:11:33.823153 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:11:33.823375 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:11:33.823598 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:11:33.823778 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:11:33.823939 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:11:33.824083 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:11:33.824227 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:11:33.824382 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:11:33.824534 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:11:33.824716 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:11:33.824869 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:11:33.825022 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:11:33.825175 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:11:33.825320 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:11:33.825472 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:11:33.825625 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:11:33.825769 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:11:33.825913 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:11:33.825913 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:11:33.826801 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.17 {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:11:33.826972 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:11:33.827192 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.17 {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:11:33.827354 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:11:33.827554 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:11:33.827708 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:11:33.827855 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:11:33.828026 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:11:33.828181 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:11:33.828326 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:11:33.828469 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:11:33.828612 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:11:33.828755 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:11:33.828913 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:11:33.829077 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:11:33.829221 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:11:33.829365 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:11:33.829514 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:11:33.829658 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:11:33.829811 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:11:33.829962 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:11:33.830415 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:11:33.830560 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:11:33.830704 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:11:33.830704 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:11:33.830989 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:11:33.831132 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:11:33.831285 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:11:33.831461 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:11:33.831617 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:11:33.831775 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:11:33.831927 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:11:33.832077 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:11:33.832230 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:11:33.832380 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.17 {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:11:33.832532 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:11:33.832694 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.17 {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:11:33.832838 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:11:33.832981 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:11:33.833135 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:11:33.833298 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:11:33.833444 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:11:33.833597 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:11:33.833742 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:11:33.833885 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:11:33.834028 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:11:33.834179 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:11:33.834329 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:11:33.834485 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:11:33.834640 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:11:33.834784 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:11:33.834933 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:11:33.835076 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:11:33.835242 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:11:33.835392 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:11:33.835558 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:11:33.835700 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:11:33.835856 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:11:33.835999 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:11:33.836155 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:11:33.836454 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:11:33.837113 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:11:33.837310 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:11:33.837465 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:11:33.837610 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:11:33.837769 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:11:33.837926 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:11:33.838119 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:11:33.838264 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:11:33.838264 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:11:33.838553 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:11:33.838707 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:11:33.838858 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:11:33.839014 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:11:33.839168 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:11:33.839319 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:11:33.840083 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:11:33.840254 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:11:33.840413 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:11:33.840558 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:11:33.840712 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:11:33.840866 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:11:33.841025 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:11:33.841170 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:11:33.841313 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:11:33.841466 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:11:33.841621 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:11:33.841765 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:11:33.841916 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:11:33.842075 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:11:33.842220 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:11:33.842387 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:11:33.842532 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:11:33.842683 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:11:33.842834 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:11:33.842984 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:11:33.843137 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:11:33.843290 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:11:33.843454 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:11:33.843603 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:11:33.843760 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:11:33.843911 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:11:33.844054 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:11:33.844207 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:11:33.844371 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:11:33.844522 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:11:33.844680 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:11:33.844830 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:11:33.844982 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:11:33.845125 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:11:33.845276 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:11:33.845481 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:11:33.845639 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:11:33.845793 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:11:33.845937 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:11:33.846080 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:11:33.846231 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:11:33.846619 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:11:33.847040 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:11:33.847402 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:11:33.847607 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:11:33.847838 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:11:33.847838 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:11:33.848135 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:11:33.848280 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:11:33.848432 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:11:33.848574 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:11:33.848717 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:11:33.848860 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:11:33.849093 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:11:33.849253 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:11:33.849405 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:11:33.849550 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:11:33.849702 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.849844 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:11:33.849996 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.850148 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:11:33.850148 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:11:33.850427 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.850579 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:11:33.850735 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.850878 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:11:33.851042 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.851195 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:11:33.851346 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.851513 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:11:33.851513 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:11:33.851812 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.851956 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:11:33.852108 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.852259 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:11:33.852401 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.852558 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:11:33.852703 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.852854 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:11:33.853012 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.853155 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:11:33.853310 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.853459 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:11:33.853738 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.853933 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.854134 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.854294 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.854480 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.854630 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.854775 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.854928 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.855083 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.855226 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.855385 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.855599 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.855755 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.855901 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.856052 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.856196 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.856353 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.856512 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.856783 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.857214 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.857556 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.857729 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.857878 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.858042 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.858188 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.858339 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.858484 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.858634 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.858787 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.858933 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.859084 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.859228 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.859371 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.859546 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.859719 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.859872 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.860017 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.860160 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.860303 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.860445 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.860597 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.860748 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.860748 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.861022 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.861164 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.861307 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.861550 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.861711 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.861855 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.862006 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.862158 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.862312 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.862464 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.862607 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.862757 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.862908 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.863052 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.863204 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.863357 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.863598 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.863751 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.863905 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.864059 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.864216 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.864366 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.864510 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.864660 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.864804 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.864947 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.865099 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.865243 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.865387 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.865548 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.865703 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.865855 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.866012 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.866164 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.866317 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.866468 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.866619 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.866793 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.867268 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.867444 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.867807 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.867958 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.868127 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.868281 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.868436 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.868587 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.868738 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.868883 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.869027 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.869250 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.869404 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.869558 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.869558 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.869839 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.870001 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.870160 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.870304 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.870448 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.870598 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.870742 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.870893 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.871045 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.871195 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.871339 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.871502 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.871648 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.871803 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.871803 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.872094 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.872094 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.872370 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.872370 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.872652 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.872803 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.872957 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.873100 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.873243 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.873392 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.873548 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.873700 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.873862 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.874013 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.874164 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.874316 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.874466 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.874611 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.874760 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.874911 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.875060 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.875213 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.875363 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.875583 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.875738 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.875892 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.876047 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.876283 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.876437 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.876590 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.876736 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.876877 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.877379 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.877546 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.877824 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.878070 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.878219 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.878381 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.878536 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.878680 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.878832 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.878984 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.879136 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.879279 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.879451 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.879611 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.879611 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.879896 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.879896 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.880181 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.880343 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.880487 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.880630 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.880781 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.880925 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.881076 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.881232 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.881383 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.881532 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.881676 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.881826 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.881983 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.881983 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.882284 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.882436 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.882579 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.882722 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.882879 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.883203 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.883949 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.885100 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.885407 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.886070 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.888935 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.889105 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.889260 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.889424 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.889626 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.889783 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.889946 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.890098 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.890243 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.890397 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.890397 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.890738 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.890892 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.891043 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.891190 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.891353 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.891524 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.891723 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.891879 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.892032 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.892175 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.892326 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.892326 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.892616 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.892768 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.892910 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.893053 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.893203 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.893364 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.893531 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.893531 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.893813 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.893956 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.894099 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.894251 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.894395 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.894557 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.894964 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.895116 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.895261 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.895523 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.895688 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.895833 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.896006 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.896284 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.896443 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.896602 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.896748 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.896956 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.897119 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.897272 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.897424 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.897582 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.897838 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.898016 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.898016 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.898299 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.898954 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.899118 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.899272 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.899434 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.899596 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.899741 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.899896 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.900047 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.900190 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.900333 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.900550 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.900700 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.900854 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.901070 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.901325 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.901325 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.901599 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.901743 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.901901 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.902053 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.902207 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.902358 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.902509 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.902670 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.902825 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.902978 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.903122 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.903272 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.903433 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.903598 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.903743 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.903893 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.904045 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.904197 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.904340 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.904502 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.904655 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.904798 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.904941 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.905085 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.905236 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.905390 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.905542 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.905692 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.905835 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.905979 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.906123 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.906290 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.906444 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.906597 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.906742 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.906892 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.907045 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.907204 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.907356 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.907547 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.907547 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.907842 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.908083 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.908234 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.908234 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.908535 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.908535 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.909349 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.909504 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.909656 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.909807 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.909807 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.910086 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.910229 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.910383 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.910527 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.910670 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.910820 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.910987 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.911131 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.911288 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.911451 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.911611 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.911767 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.911918 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.912152 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.912306 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.912450 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.912602 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.912754 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.912912 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.913079 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.913232 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.913376 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.913519 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.913662 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.913812 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.913967 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.914118 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.914261 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.914404 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.914547 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.914690 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.914856 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.915002 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.915155 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.915305 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.915522 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.915685 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.915831 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.916010 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.916425 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.916739 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.916899 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.917055 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.917207 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.917371 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.917515 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.917660 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.917802 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.917954 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.918205 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.918382 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.918546 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.918701 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.919530 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.919687 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.919833 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.919978 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.920133 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.920277 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.920429 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.920429 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.920724 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.920969 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.921127 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.921272 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.921436 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.921581 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.921724 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.921869 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.921869 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.922167 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.922326 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.922480 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.922480 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.922760 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.922907 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.923065 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.923212 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.923364 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.923531 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.923676 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.923676 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.923973 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.924126 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.924282 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.924435 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.924587 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.924587 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.924879 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.925032 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.925184 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.925338 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.925491 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.925637 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.925780 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.925943 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.926089 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.926248 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.926405 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.926405 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.926685 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.926838 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.926990 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.927143 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.927289 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.927460 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.927622 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.927767 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.927929 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.928075 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.928244 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.928469 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.928641 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.928795 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.928966 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.929415 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.929771 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.929927 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.930085 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.930239 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.930395 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.930546 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.930698 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.930848 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.931000 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.931153 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.931153 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.931564 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.931774 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.931943 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.932090 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.932234 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.932378 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.932542 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.932695 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.932850 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.935320 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.935539 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.935709 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.935871 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.936020 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.936193 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.936349 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.936498 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.936658 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.936805 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.936963 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.937119 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.937265 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.937410 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.937557 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.937710 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.937910 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.938066 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.938211 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.938357 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.938596 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.938758 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.938758 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.939068 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.939235 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.939924 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.940085 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.940230 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.940384 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.940384 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.940671 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.940816 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.940967 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.941111 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.941264 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.941427 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.941581 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.941742 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.941894 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.942053 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.942198 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.942350 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.942495 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.942640 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.942792 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.942945 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.943090 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.943235 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.943397 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.943567 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.943722 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.943879 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.944024 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.944024 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.944297 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.944441 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.944593 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.944745 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.944892 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.945036 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.945181 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.945343 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.945573 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.945723 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.945723 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.946008 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.946149 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.946296 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.946443 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.946713 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.946823 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.946898 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.946968 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.947039 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.947124 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.947392 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.947512 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.947586 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.947686 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.947763 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.947847 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.947922 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.947993 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.948064 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.948135 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.948214 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.948287 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.948365 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.948444 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.948517 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.948775 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.948874 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.948949 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.949028 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.949105 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.949179 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.949251 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.949330 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.949606 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.950048 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.950124 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.950195 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.950275 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.950358 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.950431 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.950503 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.950573 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.950646 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.950800 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.950876 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.950947 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.951026 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.951105 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.951184 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.951264 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.951345 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.951441 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.951656 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.951745 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.951820 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.951911 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.951986 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.952055 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.952133 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.952205 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.952275 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.952358 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.952439 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.952523 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.952523 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.952662 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.952746 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.952824 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.952901 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.952991 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.953068 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.953146 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.953225 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.953303 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.953380 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.953457 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.953527 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.953598 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.953675 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.953754 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.953825 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.953895 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.953963 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.954041 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.954119 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.954191 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.954267 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.954344 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.954415 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.954484 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.954561 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.954640 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.954717 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.954789 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.954859 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.954937 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.955018 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.955584 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.955678 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.955752 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.955834 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.955934 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.956007 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.956084 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.956162 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.956233 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.956309 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.956387 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.956460 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.956529 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.956598 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.956668 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.956737 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.956818 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.956895 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.956967 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.957037 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.957114 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.957193 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.957272 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.957351 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.957351 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.957480 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.957557 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.957641 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.957720 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.957798 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.957876 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.957947 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.958016 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.958093 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.958170 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.958248 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.958331 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.958402 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.958471 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.958471 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.958471 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.958471 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.958728 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.958819 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.958819 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.958972 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.959045 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.959115 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.959193 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.959263 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.959263 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.959425 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.960137 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.960235 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.960311 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.960390 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.960476 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.960555 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.960627 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.960697 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.960767 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.960844 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.960929 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.961002 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.961073 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.961142 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.961212 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.961294 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.961380 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.961451 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.961528 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.961607 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.961607 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.961756 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.961756 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.961889 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.961889 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.962018 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.962095 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.962179 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.962250 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.962328 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.962405 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.962476 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.962546 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.962546 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.962693 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.962693 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.962826 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.962921 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.963030 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.963105 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.963176 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.963245 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.963316 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.963401 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.965320 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.965489 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.965646 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.965792 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.965956 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.966103 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.966258 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.966423 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.966569 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.966569 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.966844 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.967004 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.967149 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.967293 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.967456 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.967606 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.967840 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.968000 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.968164 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.968415 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.968576 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.968730 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.968885 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.969033 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.969179 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.969323 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.969477 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.969635 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.970236 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.970423 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.970658 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.970818 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.970976 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.971137 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.971285 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.971458 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.971610 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.971773 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.971926 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.972089 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.972236 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.972381 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.972525 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.972678 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.972823 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.972988 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.973143 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.973291 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.973291 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.973584 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.973738 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.973892 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.974037 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.974189 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.974342 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.974488 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.974641 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.974787 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.974948 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.975098 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.975255 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.975426 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.975591 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.975591 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.975875 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.976019 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.976170 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.976325 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.976484 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.976630 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.976790 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.976953 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.977101 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.977260 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.977413 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.977567 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.977721 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.977865 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.978010 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.978167 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.978322 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.978469 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.978640 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.978795 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.978941 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.979103 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.979257 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.979403 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.979595 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.979741 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.979903 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.980493 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.980672 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.980904 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.981053 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.981207 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.981374 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.981519 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.981666 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.981818 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.981963 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.982108 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.982264 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.982419 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.982566 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.982726 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.982879 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.983025 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.983182 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.983338 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.983517 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.983667 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.983820 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.983972 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.984127 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.984273 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.984273 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.984548 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.984701 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.984860 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.985021 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.985189 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.985334 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.985487 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.985640 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.985801 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.985947 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.985947 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.986224 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.986224 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.986503 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.986503 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.986791 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.986791 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.987074 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.987227 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.987388 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.987388 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.987703 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.987856 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.988011 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.988156 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.988314 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.988314 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.988589 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.988741 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.988886 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.989048 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.989203 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.989203 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.989485 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.989485 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.989766 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.989766 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.990073 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.990637 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.990787 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.990787 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.991212 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.991377 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.991577 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.991739 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.991901 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.991901 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.992201 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.992368 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.992528 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.992686 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.992839 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.992999 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.993153 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.993392 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.993546 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.993717 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.993878 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.993878 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.994381 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.994565 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.994720 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.994915 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.995073 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.995073 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.995373 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.995624 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.995786 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.995951 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.996103 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.996256 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.996418 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.996571 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.996732 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.996891 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.997043 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.997212 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.997381 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.997533 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.997533 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.997831 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.997993 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.998147 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.998308 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.999063 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.999233 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.999397 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.999586 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.999740 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:33.999901 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:34.000063 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:34.000998 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:34.001174 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:34.001481 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:34.001696 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:34.001853 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:34.002030 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:34.002192 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:34.002347 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:34.002505 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:34.002660 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:34.002820 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:34.002983 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:34.003156 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:34.003309 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:34.003543 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:34.003703 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:34.003868 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:34.004022 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:34.004249 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:34.004404 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:34.004555 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:34.004718 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:34.004885 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:34.005039 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:34.005211 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:34.005365 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:34.005524 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:34.005677 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:34.005847 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:34.005847 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:34.006147 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:34.006147 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:34.006453 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:34.006620 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:34.006774 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:34.006774 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:34.007090 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:34.007251 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:34.007427 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:34.007601 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:34.007763 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:34.007923 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:34.008082 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:34.008082 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:34.008372 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:34.008372 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:34.008671 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:34.008671 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:34.008961 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:34.009123 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:34.009284 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:34.009437 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:34.009597 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:34.009749 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:34.010014 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:34.010169 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:34.010330 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:34.010330 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:34.011166 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:34.011346 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:34.011691 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:34.011872 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:34.012037 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:34.012435 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:34.012590 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:34.012743 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:34.012894 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:34.013048 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:34.013210 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:34.013360 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:34.013360 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:34.013694 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:34.013769 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:34.013851 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:34.013944 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:34.014018 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:34.014095 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:34.014175 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:34.014175 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:34.014320 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:34.014434 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:34.014555 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:34.014648 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:34.014735 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:34.014807 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:34.014887 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:34.014960 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:34.014960 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:34.015105 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:34.015190 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:34.015270 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:34.015344 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:34.015451 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:34.015582 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:34.015687 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:34.015781 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:34.015880 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:34.015880 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:34.016078 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:34.016171 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:34.016171 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:34.016331 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:34.016422 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:34.016507 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:34.016590 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:34.016590 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:34.016749 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:34.016881 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:34.016981 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:34.017073 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:34.017165 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:34.017249 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:34.017339 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:34.017431 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:34.017516 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:34.017598 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:34.017682 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:34.017773 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:34.017858 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:34.017949 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:34.018046 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:34.018139 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:34.018224 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:34.018307 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:34.018397 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:34.018490 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:34.018583 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:34.018667 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:34.018667 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:34.018833 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:34.018919 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:34.019012 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:34.019096 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:34.019194 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:34.019285 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:34.019376 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:34.019517 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:34.019605 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:34.019695 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:34.019781 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:34.019872 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:34.019958 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:34.019958 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:34.020201 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:34.020294 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:34.020385 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:34.020385 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:34.020547 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:34.020547 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:34.020754 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:34.020840 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:34.021118 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:34.021378 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:34.021473 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:34.021571 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:34.021686 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:34.021773 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:34.021858 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:34.021942 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:34.022041 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:34.022127 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:34.022218 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:34.022218 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:34.022379 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:34.022463 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:34.022554 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:34.022640 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:34.022729 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:34.022729 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:34.022888 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:34.022972 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:34.023068 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:34.023161 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:34.023244 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:34.023341 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:34.023442 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:34.023528 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:34.023625 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:34.023712 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:34.023804 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:34.023889 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:34.023980 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:34.024081 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:34.024171 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:34.024263 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:34.024346 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:34.024429 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:34.024518 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:34.024617 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:34.024709 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:34.024794 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:34.024876 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:34.024955 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:34.025045 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:34.025045 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:34.025211 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:34.025293 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:34.025376 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:34.025507 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:34.025507 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:34.025686 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:34.025773 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:34.025863 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:34.025953 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:34.026038 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:34.026117 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:34.026190 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:34.026268 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:34.026340 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:34.026411 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:34.026500 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:34.026598 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:34.026682 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:34.026765 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:34.026847 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:34.026930 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:34.027013 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:34.027092 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:34.027175 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:34.027257 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:34.027347 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:34.027466 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:34.027565 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:34.027653 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:34.027743 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:34.027828 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:34.027910 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:34.027999 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:34.028095 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:34.028187 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:34.028271 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:34.028368 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:34.028460 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:34.028550 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:34.028646 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:34.028739 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:34.028832 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:34.028916 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:34.029005 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:34.029097 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:34.029188 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:34.029279 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:34.029371 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:34.029455 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:34.029545 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:34.029637 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:34.029722 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:34.029812 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:34.029903 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:34.029987 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:34.030070 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:34.030164 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:34.030249 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:34.030341 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:34.030432 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:34.030515 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:34.030606 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:34.030697 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:34.030780 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:34.030865 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:34.030965 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:34.031064 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:34.031157 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:34.031237 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:34.031487 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:34.031579 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:34.031676 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:34.031762 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:34.031855 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:34.031941 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:34.032029 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:34.032114 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:34.032192 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:34.032282 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:34.032376 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:34.032462 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:34.032551 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:34.032643 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:34.032727 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:34.032819 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:34.032905 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:34.032988 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:34.033076 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:34.033166 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:34.033166 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:34.033326 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:34.033412 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:34.033494 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:34.033672 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:34.033775 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:34.033962 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:34.034073 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:34.034259 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:34.034363 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:34.034569 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:34.034669 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:34.034859 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:34.034978 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:34.035154 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:34.035285 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:34.035500 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:34.035641 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:34.036510 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:34.036622 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:34.036698 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:34.036769 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:34.036847 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:34.036935 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:34.037017 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:34.037096 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:34.037174 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:34.037247 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:34.037323 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:34.037434 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:34.037526 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:34.037739 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:34.037827 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:34.038044 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:34.038126 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:34.038356 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:34.038439 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:34.038662 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:34.038745 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:34.038966 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:34.039055 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:34.039360 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:34.039481 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:34.039838 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:34.039965 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:34.040272 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:34.040588 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:34.040975 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:34.041099 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:34.041312 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:34.041401 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:34.041648 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:34.041840 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:34.041941 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:34.042179 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:34.042285 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:34.042488 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:34.042583 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:34.042798 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:34.042898 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:34.043110 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:34.043203 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:34.043472 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:34.043579 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:34.043758 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:34.043853 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:34.044073 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:34.044163 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:34.044472 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:34.044567 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:34.044754 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:34.044915 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:34.045077 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:34.045227 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:34.045318 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:34.045414 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:34.045669 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:34.045775 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:34.045954 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:34.046062 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:34.046265 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:34.046367 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:34.046586 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:34.046708 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:34.046916 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:34.047026 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:34.047228 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:34.047339 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:34.047575 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:34.047716 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:34.047892 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:34.048000 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:34.048199 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:34.048308 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:34.048506 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:34.048605 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:34.048819 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:34.048919 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:34.049128 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:34.049228 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:34.049429 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:34.049529 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:34.049750 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:34.049847 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:34.050061 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:34.050168 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:34.050384 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:34.050481 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:34.050711 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:34.050813 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:34.051029 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:34.051128 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:34.051340 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:34.051473 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:34.051694 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:34.051819 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:34.052017 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:34.052116 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:34.052332 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:34.052419 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:34.052655 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:34.052758 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:34.052974 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:34.053074 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:34.053292 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:34.053404 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:34.053609 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:34.053708 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:34.053911 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:34.054018 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:34.054150 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 23 07:11:34.054242 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:34.054530 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:34.054842 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:34.055161 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:34.055506 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:34.055818 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:34.056143 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:34.056464 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:34.056843 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:34.057173 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:34.057502 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:34.057813 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:34.058143 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:34.058471 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:34.058821 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:34.059137 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:34.059533 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:34.059867 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:34.060184 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:34.060504 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:34.060812 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:11:34.061058 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 23 07:11:34.120705 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO dbcounter [None req-a09009ee-65b4-4dc3-a564-9c4779e27856 None None] Registered counter for database nova_api Aug 23 07:11:34.123169 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO dbcounter [None req-f3d33b66-2ce9-436f-808d-740f088deea5 None None] Registered counter for database nova_api Aug 23 07:11:34.141435 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_db.sqlalchemy.engines [None req-a09009ee-65b4-4dc3-a564-9c4779e27856 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120798) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 23 07:11:34.144346 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_db.sqlalchemy.engines [None req-f3d33b66-2ce9-436f-808d-740f088deea5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120799) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 23 07:11:34.147979 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG dbcounter [-] [120798] Writer thread running {{(pid=120798) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 23 07:11:34.151297 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG dbcounter [-] [120799] Writer thread running {{(pid=120799) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 23 07:11:34.204691 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.context [None req-a09009ee-65b4-4dc3-a564-9c4779e27856 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),f504f095-246c-45ec-9346-3a7c88a97f22(cell1) {{(pid=120798) load_cells /opt/stack/nova/nova/context.py:464}} Aug 23 07:11:34.207137 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.context [None req-f3d33b66-2ce9-436f-808d-740f088deea5 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),f504f095-246c-45ec-9346-3a7c88a97f22(cell1) {{(pid=120799) load_cells /opt/stack/nova/nova/context.py:464}} Aug 23 07:11:34.209114 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-a09009ee-65b4-4dc3-a564-9c4779e27856 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:11:34.209588 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-a09009ee-65b4-4dc3-a564-9c4779e27856 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:11:34.211184 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-a09009ee-65b4-4dc3-a564-9c4779e27856 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:11:34.211334 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-f3d33b66-2ce9-436f-808d-740f088deea5 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:11:34.211724 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-f3d33b66-2ce9-436f-808d-740f088deea5 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:11:34.211971 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-a09009ee-65b4-4dc3-a564-9c4779e27856 None None] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:11:34.212413 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-a09009ee-65b4-4dc3-a564-9c4779e27856 None None] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:11:34.213345 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-f3d33b66-2ce9-436f-808d-740f088deea5 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:11:34.214243 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-f3d33b66-2ce9-436f-808d-740f088deea5 None None] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:11:34.214470 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-a09009ee-65b4-4dc3-a564-9c4779e27856 None None] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:11:34.214661 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-f3d33b66-2ce9-436f-808d-740f088deea5 None None] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:11:34.216468 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO dbcounter [None req-a09009ee-65b4-4dc3-a564-9c4779e27856 None None] Registered counter for database nova_cell0 Aug 23 07:11:34.216811 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-f3d33b66-2ce9-436f-808d-740f088deea5 None None] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:11:34.218844 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO dbcounter [None req-f3d33b66-2ce9-436f-808d-740f088deea5 None None] Registered counter for database nova_cell0 Aug 23 07:11:34.220525 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO dbcounter [None req-a09009ee-65b4-4dc3-a564-9c4779e27856 None None] Registered counter for database nova_cell1 Aug 23 07:11:34.222864 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO dbcounter [None req-f3d33b66-2ce9-436f-808d-740f088deea5 None None] Registered counter for database nova_cell1 Aug 23 07:11:34.228342 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_db.sqlalchemy.engines [None req-a09009ee-65b4-4dc3-a564-9c4779e27856 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120798) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 23 07:11:34.231449 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_db.sqlalchemy.engines [None req-a09009ee-65b4-4dc3-a564-9c4779e27856 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120798) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 23 07:11:34.231639 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_db.sqlalchemy.engines [None req-f3d33b66-2ce9-436f-808d-740f088deea5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120799) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 23 07:11:34.233415 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_db.sqlalchemy.engines [None req-f3d33b66-2ce9-436f-808d-740f088deea5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120799) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 23 07:11:34.238438 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG dbcounter [-] [120798] Writer thread running {{(pid=120798) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 23 07:11:34.238903 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG dbcounter [-] [120799] Writer thread running {{(pid=120799) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 23 07:11:34.240068 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG dbcounter [-] [120798] Writer thread running {{(pid=120798) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 23 07:11:34.241584 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG dbcounter [-] [120799] Writer thread running {{(pid=120799) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 23 07:11:34.384971 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO dbcounter [None req-a09009ee-65b4-4dc3-a564-9c4779e27856 None None] Registered counter for database nova_cell0 Aug 23 07:11:34.388493 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO dbcounter [None req-f3d33b66-2ce9-436f-808d-740f088deea5 None None] Registered counter for database nova_cell0 Aug 23 07:11:34.392054 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_db.sqlalchemy.engines [None req-a09009ee-65b4-4dc3-a564-9c4779e27856 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120798) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 23 07:11:34.395624 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_db.sqlalchemy.engines [None req-f3d33b66-2ce9-436f-808d-740f088deea5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120799) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 23 07:11:34.400347 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG dbcounter [-] [120798] Writer thread running {{(pid=120798) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 23 07:11:34.402349 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG dbcounter [-] [120799] Writer thread running {{(pid=120799) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 23 07:11:34.715896 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: WARNING keystonemiddleware.auth_token [None req-a09009ee-65b4-4dc3-a564-9c4779e27856 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 23 07:11:34.719856 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: WARNING keystonemiddleware.auth_token [None req-f3d33b66-2ce9-436f-808d-740f088deea5 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 23 07:11:34.723540 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: WARNING keystonemiddleware.auth_token [None req-a09009ee-65b4-4dc3-a564-9c4779e27856 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 23 07:11:34.727101 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: WARNING keystonemiddleware.auth_token [None req-f3d33b66-2ce9-436f-808d-740f088deea5 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 23 07:11:35.064241 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: WARNING keystonemiddleware.auth_token [None req-a09009ee-65b4-4dc3-a564-9c4779e27856 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 23 07:11:35.070191 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: WARNING keystonemiddleware.auth_token [None req-f3d33b66-2ce9-436f-808d-740f088deea5 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 23 07:11:35.070590 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: WARNING keystonemiddleware.auth_token [None req-a09009ee-65b4-4dc3-a564-9c4779e27856 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 23 07:11:35.075650 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55a81a1309c0 pid: 120798 (default app) Aug 23 07:11:35.076824 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: WARNING keystonemiddleware.auth_token [None req-f3d33b66-2ce9-436f-808d-740f088deea5 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 23 07:11:35.082461 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55a81a1309c0 pid: 120799 (default app) Aug 23 07:12:11.198345 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG dbcounter [-] [120799] Writing DB stats nova_api:SELECT=3 {{(pid=120799) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:12:11.200195 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG dbcounter [-] [120799] Writing DB stats nova_cell0:SELECT=3 {{(pid=120799) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:12:11.201130 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG dbcounter [-] [120798] Writing DB stats nova_api:SELECT=3 {{(pid=120798) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:12:11.202428 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG dbcounter [-] [120798] Writing DB stats nova_cell0:SELECT=3 {{(pid=120798) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:12:11.203530 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG dbcounter [-] [120799] Writing DB stats nova_cell1:SELECT=3 {{(pid=120799) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:12:11.207090 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG dbcounter [-] [120798] Writing DB stats nova_cell1:SELECT=3 {{(pid=120798) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:12:11.207521 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG dbcounter [-] [120799] Writing DB stats nova_cell0:SELECT=3 {{(pid=120799) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:12:11.209330 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG dbcounter [-] [120798] Writing DB stats nova_cell0:SELECT=3 {{(pid=120798) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:12:12.795226 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-6ae095ff-feb4-48b7-8537-7d3a9f47edc6 tempest-VolumesSnapshotsTestJSON-308946970 tempest-VolumesSnapshotsTestJSON-308946970-project] Action: 'create', calling method: .version_select at 0x7fe3c779b5e0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-2037599073"}} {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 07:12:13.158924 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-51494652-40cf-4e8c-9682-0a37338e3d8e tempest-VolumesGetTestJSON-36511058 tempest-VolumesGetTestJSON-36511058-project] Action: 'create', calling method: .version_select at 0x7fe3c7798700>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-979332097", "metadata": {"Type": "work"}}} {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 07:12:15.449982 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-6ae095ff-feb4-48b7-8537-7d3a9f47edc6 tempest-VolumesSnapshotsTestJSON-308946970 tempest-VolumesSnapshotsTestJSON-308946970-project] 10.222.0.17 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 4.267914 Aug 23 07:12:15.451643 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 1/1] 10.222.0.17 () {60 vars in 1155 bytes} [Tue Aug 23 07:12:11 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 4271 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Aug 23 07:12:15.515713 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [None req-51494652-40cf-4e8c-9682-0a37338e3d8e tempest-VolumesGetTestJSON-36511058 tempest-VolumesGetTestJSON-36511058-project] 10.222.0.17 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 4.333678 Aug 23 07:12:15.516757 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 1/2] 10.222.0.17 () {60 vars in 1156 bytes} [Tue Aug 23 07:12:11 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 4336 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Aug 23 07:12:15.522843 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-52c27a2a-3e49-48eb-aa4a-b3b1b36080f5 tempest-VolumesSnapshotsTestJSON-308946970 tempest-VolumesSnapshotsTestJSON-308946970-project] Calling method '.version_select at 0x7fe3c766b550>' {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:12:15.652490 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [None req-52c27a2a-3e49-48eb-aa4a-b3b1b36080f5 tempest-VolumesSnapshotsTestJSON-308946970 tempest-VolumesSnapshotsTestJSON-308946970-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/433e922a-0a6e-439f-a123-3d5cf7ba7ba6" status: 200 len: 345 microversion: 2.1 time: 0.134543 Aug 23 07:12:15.653344 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 2/3] 10.222.0.17 () {58 vars in 1245 bytes} [Tue Aug 23 07:12:15 2022] GET /compute/v2.1/os-volumes/433e922a-0a6e-439f-a123-3d5cf7ba7ba6 => generated 345 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 07:12:15.660920 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-543a4d2e-444d-4af1-88df-22cb1056aef4 tempest-VolumesGetTestJSON-36511058 tempest-VolumesGetTestJSON-36511058-project] Calling method '.version_select at 0x7fe3c766bca0>' {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:12:15.719384 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-c92a68fb-d63a-4e85-abd3-64509643384a tempest-VolumesNegativeTest-2080189454 tempest-VolumesNegativeTest-2080189454-project] Action: 'create', calling method: .version_select at 0x7fe3c766f430>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1881384961", "metadata": {"Type": "work"}}} {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 07:12:15.730862 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-c92a68fb-d63a-4e85-abd3-64509643384a tempest-VolumesNegativeTest-2080189454 tempest-VolumesNegativeTest-2080189454-project] Request method failure captured: Aug 23 07:12:15.730862 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 23 07:12:15.730862 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: Accept: application/json Aug 23 07:12:15.730862 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: Accept-Encoding: identity Aug 23 07:12:15.730862 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: Connection: close Aug 23 07:12:15.730862 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: Content-Length: 122 Aug 23 07:12:15.730862 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: Content-Type: application/json Aug 23 07:12:15.730862 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: Host: 10.222.0.17 Aug 23 07:12:15.730862 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: Openstack-System-Scope: None Aug 23 07:12:15.730862 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: User-Agent: python-urllib3/1.26.11 Aug 23 07:12:15.730862 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-Auth-Token: gAAAAABjBH3LAR4aSWqZg6J40H_ba2jLlpLpgM6QiC9JEtanVGuAVzSlXncRyWY2sy4mKw9hzecVF8Ya-uR6FvguDrk9TZAuIrcBmrbg4GlkN63BveCMKfGx9h2xYPGavpmSxUFBoXcqcBrBIagEkXEA-oiC2fVbzVbEfGaVlI5idfwcOVMwGzU Aug 23 07:12:15.730862 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-Domain-Id: None Aug 23 07:12:15.730862 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-Domain-Name: None Aug 23 07:12:15.730862 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-Identity-Status: Confirmed Aug 23 07:12:15.730862 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-Is-Admin-Project: True Aug 23 07:12:15.730862 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-Project-Domain-Id: default Aug 23 07:12:15.730862 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-Project-Domain-Name: Default Aug 23 07:12:15.730862 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-Project-Id: e449a86b7ec3494583203cb6abc4a930 Aug 23 07:12:15.730862 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-Project-Name: tempest-VolumesNegativeTest-2080189454 Aug 23 07:12:15.730862 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-Role: reader,member Aug 23 07:12:15.730862 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-Roles: reader,member Aug 23 07:12:15.771303 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/e449a86b7ec3494583203cb6abc4a930"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/e449a86b7ec3494583203cb6abc4a930"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_e449a86b7ec3494583203cb6abc4a930"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/e449a86b7ec3494583203cb6abc4a930"}]}] Aug 23 07:12:15.771303 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-Tenant: tempest-VolumesNegativeTest-2080189454 Aug 23 07:12:15.771303 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-Tenant-Id: e449a86b7ec3494583203cb6abc4a930 Aug 23 07:12:15.771303 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-Tenant-Name: tempest-VolumesNegativeTest-2080189454 Aug 23 07:12:15.771303 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-User: tempest-VolumesNegativeTest-2080189454-project Aug 23 07:12:15.771303 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-User-Domain-Id: default Aug 23 07:12:15.771303 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-User-Domain-Name: Default Aug 23 07:12:15.771303 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-User-Id: c31f51896f9a492298ee8185aba9a480 Aug 23 07:12:15.771303 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-User-Name: tempest-VolumesNegativeTest-2080189454-project Aug 23 07:12:15.771303 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: Aug 23 07:12:15.771303 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1881384961", "metadata": {"Type": "work"}}} Aug 23 07:12:15.771303 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: method: Aug 23 07:12:15.771303 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 23 07:12:15.775978 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1881384961', 'metadata': {'Type': 'work'}}}} Aug 23 07:12:15.775978 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 07:12:15.775978 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 07:12:15.775978 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 23 07:12:15.775978 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 23 07:12:15.775978 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 23 07:12:15.775978 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi raise error Aug 23 07:12:15.775978 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Aug 23 07:12:15.775978 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi Aug 23 07:12:15.775978 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 23 07:12:15.775978 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 23 07:12:15.775978 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi Aug 23 07:12:15.775978 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 23 07:12:15.775978 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi '#$%' Aug 23 07:12:15.775978 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi Aug 23 07:12:15.775978 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 07:12:15.775978 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi Aug 23 07:12:15.775978 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 07:12:15.775978 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 07:12:15.775978 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 07:12:15.775978 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 07:12:15.775978 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 07:12:15.781877 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 23 07:12:15.781877 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 23 07:12:15.781877 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 07:12:15.781877 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 07:12:15.781877 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 23 07:12:15.781877 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 23 07:12:15.781877 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 23 07:12:15.781877 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 23 07:12:15.781877 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 23 07:12:15.781877 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 23 07:12:15.781877 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 23 07:12:15.781877 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi Aug 23 07:12:15.781877 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 07:12:15.781877 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi Aug 23 07:12:15.781877 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 07:12:15.781877 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 07:12:15.781877 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 07:12:15.781877 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 23 07:12:15.781877 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 23 07:12:15.785307 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 23 07:12:15.785307 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi Aug 23 07:12:15.785307 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-c92a68fb-d63a-4e85-abd3-64509643384a tempest-VolumesNegativeTest-2080189454 tempest-VolumesNegativeTest-2080189454-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=120799) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 07:12:15.785307 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-c92a68fb-d63a-4e85-abd3-64509643384a tempest-VolumesNegativeTest-2080189454 tempest-VolumesNegativeTest-2080189454-project] 10.222.0.17 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.283022 Aug 23 07:12:15.785307 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 2/4] 10.222.0.17 () {60 vars in 1156 bytes} [Tue Aug 23 07:12:15 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 285 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 23 07:12:15.785307 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-3c3c5dbf-b389-4268-8ae5-f078e2b60e95 tempest-VolumesNegativeTest-2080189454 tempest-VolumesNegativeTest-2080189454-project] Action: 'create', calling method: .version_select at 0x7fe3c7680dc0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-400714332", "metadata": {"Type": "work"}}} {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 07:12:15.785307 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-3c3c5dbf-b389-4268-8ae5-f078e2b60e95 tempest-VolumesNegativeTest-2080189454 tempest-VolumesNegativeTest-2080189454-project] Request method failure captured: Aug 23 07:12:15.785307 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 23 07:12:15.785307 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: Accept: application/json Aug 23 07:12:15.785916 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: Accept-Encoding: identity Aug 23 07:12:15.785916 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: Connection: close Aug 23 07:12:15.785916 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: Content-Length: 119 Aug 23 07:12:15.785916 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: Content-Type: application/json Aug 23 07:12:15.785916 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: Host: 10.222.0.17 Aug 23 07:12:15.785916 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: Openstack-System-Scope: None Aug 23 07:12:15.785916 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: User-Agent: python-urllib3/1.26.11 Aug 23 07:12:15.785916 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-Auth-Token: gAAAAABjBH3LAR4aSWqZg6J40H_ba2jLlpLpgM6QiC9JEtanVGuAVzSlXncRyWY2sy4mKw9hzecVF8Ya-uR6FvguDrk9TZAuIrcBmrbg4GlkN63BveCMKfGx9h2xYPGavpmSxUFBoXcqcBrBIagEkXEA-oiC2fVbzVbEfGaVlI5idfwcOVMwGzU Aug 23 07:12:15.785916 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-Domain-Id: None Aug 23 07:12:15.785916 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-Domain-Name: None Aug 23 07:12:15.785916 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-Identity-Status: Confirmed Aug 23 07:12:15.785916 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-Is-Admin-Project: True Aug 23 07:12:15.785916 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-Project-Domain-Id: default Aug 23 07:12:15.785916 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-Project-Domain-Name: Default Aug 23 07:12:15.785916 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-Project-Id: e449a86b7ec3494583203cb6abc4a930 Aug 23 07:12:15.785916 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-Project-Name: tempest-VolumesNegativeTest-2080189454 Aug 23 07:12:15.785916 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-Role: reader,member Aug 23 07:12:15.785916 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-Roles: reader,member Aug 23 07:12:15.785916 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/e449a86b7ec3494583203cb6abc4a930"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/e449a86b7ec3494583203cb6abc4a930"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_e449a86b7ec3494583203cb6abc4a930"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/e449a86b7ec3494583203cb6abc4a930"}]}] Aug 23 07:12:15.788148 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-Tenant: tempest-VolumesNegativeTest-2080189454 Aug 23 07:12:15.788148 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-Tenant-Id: e449a86b7ec3494583203cb6abc4a930 Aug 23 07:12:15.788148 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-Tenant-Name: tempest-VolumesNegativeTest-2080189454 Aug 23 07:12:15.788148 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-User: tempest-VolumesNegativeTest-2080189454-project Aug 23 07:12:15.788148 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-User-Domain-Id: default Aug 23 07:12:15.788148 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-User-Domain-Name: Default Aug 23 07:12:15.788148 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-User-Id: c31f51896f9a492298ee8185aba9a480 Aug 23 07:12:15.788148 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-User-Name: tempest-VolumesNegativeTest-2080189454-project Aug 23 07:12:15.788148 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: Aug 23 07:12:15.788148 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-400714332", "metadata": {"Type": "work"}}} Aug 23 07:12:15.788148 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: method: Aug 23 07:12:15.788148 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 23 07:12:15.788148 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-400714332', 'metadata': {'Type': 'work'}}}} Aug 23 07:12:15.788148 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 07:12:15.788148 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 07:12:15.788148 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 23 07:12:15.788148 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 23 07:12:15.788148 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 23 07:12:15.788148 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi raise error Aug 23 07:12:15.788148 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Aug 23 07:12:15.788148 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi Aug 23 07:12:15.788148 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Aug 23 07:12:15.788148 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 23 07:12:15.788148 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi Aug 23 07:12:15.788148 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 23 07:12:15.788148 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi '0' Aug 23 07:12:15.788148 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi Aug 23 07:12:15.789776 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 07:12:15.789776 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi Aug 23 07:12:15.789776 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 07:12:15.789776 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 07:12:15.789776 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 07:12:15.789776 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 07:12:15.789776 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 07:12:15.789776 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 23 07:12:15.789776 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 23 07:12:15.789776 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 07:12:15.789776 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 07:12:15.789776 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 23 07:12:15.789776 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 23 07:12:15.789776 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 23 07:12:15.789776 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 23 07:12:15.789776 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 23 07:12:15.789776 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 23 07:12:15.789776 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 23 07:12:15.789776 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi Aug 23 07:12:15.789776 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 07:12:15.792331 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi Aug 23 07:12:15.792331 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 07:12:15.792331 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 07:12:15.792331 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 07:12:15.792331 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 23 07:12:15.792331 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 23 07:12:15.792331 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 23 07:12:15.792331 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi Aug 23 07:12:15.792331 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-3c3c5dbf-b389-4268-8ae5-f078e2b60e95 tempest-VolumesNegativeTest-2080189454 tempest-VolumesNegativeTest-2080189454-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=120799) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 07:12:15.792331 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-3c3c5dbf-b389-4268-8ae5-f078e2b60e95 tempest-VolumesNegativeTest-2080189454 tempest-VolumesNegativeTest-2080189454-project] 10.222.0.17 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.037035 Aug 23 07:12:15.792331 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 3/5] 10.222.0.17 () {60 vars in 1156 bytes} [Tue Aug 23 07:12:15 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 41 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 23 07:12:15.794557 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-935b52ef-d5d9-46b1-ab11-2341d3c9e793 tempest-VolumesNegativeTest-2080189454 tempest-VolumesNegativeTest-2080189454-project] Action: 'create', calling method: .version_select at 0x7fe3c766f550>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1562169591", "metadata": {"Type": "work"}}} {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 07:12:15.799447 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [None req-543a4d2e-444d-4af1-88df-22cb1056aef4 tempest-VolumesGetTestJSON-36511058 tempest-VolumesGetTestJSON-36511058-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/9fd78fd4-ab8b-45cb-81e9-9caf2e93a4c7" status: 200 len: 352 microversion: 2.1 time: 0.143863 Aug 23 07:12:15.799574 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-935b52ef-d5d9-46b1-ab11-2341d3c9e793 tempest-VolumesNegativeTest-2080189454 tempest-VolumesNegativeTest-2080189454-project] Request method failure captured: Aug 23 07:12:15.799574 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 23 07:12:15.799574 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: Accept: application/json Aug 23 07:12:15.799574 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: Accept-Encoding: identity Aug 23 07:12:15.799574 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: Connection: close Aug 23 07:12:15.799574 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: Content-Length: 119 Aug 23 07:12:15.799574 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: Content-Type: application/json Aug 23 07:12:15.799574 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: Host: 10.222.0.17 Aug 23 07:12:15.799574 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: Openstack-System-Scope: None Aug 23 07:12:15.799574 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: User-Agent: python-urllib3/1.26.11 Aug 23 07:12:15.799574 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-Auth-Token: gAAAAABjBH3LAR4aSWqZg6J40H_ba2jLlpLpgM6QiC9JEtanVGuAVzSlXncRyWY2sy4mKw9hzecVF8Ya-uR6FvguDrk9TZAuIrcBmrbg4GlkN63BveCMKfGx9h2xYPGavpmSxUFBoXcqcBrBIagEkXEA-oiC2fVbzVbEfGaVlI5idfwcOVMwGzU Aug 23 07:12:15.799574 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-Domain-Id: None Aug 23 07:12:15.799574 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-Domain-Name: None Aug 23 07:12:15.799574 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-Identity-Status: Confirmed Aug 23 07:12:15.799574 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-Is-Admin-Project: True Aug 23 07:12:15.799574 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-Project-Domain-Id: default Aug 23 07:12:15.799574 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-Project-Domain-Name: Default Aug 23 07:12:15.799574 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-Project-Id: e449a86b7ec3494583203cb6abc4a930 Aug 23 07:12:15.799574 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-Project-Name: tempest-VolumesNegativeTest-2080189454 Aug 23 07:12:15.799574 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-Role: reader,member Aug 23 07:12:15.799574 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-Roles: reader,member Aug 23 07:12:15.800724 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/e449a86b7ec3494583203cb6abc4a930"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/e449a86b7ec3494583203cb6abc4a930"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_e449a86b7ec3494583203cb6abc4a930"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/e449a86b7ec3494583203cb6abc4a930"}]}] Aug 23 07:12:15.800724 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-Tenant: tempest-VolumesNegativeTest-2080189454 Aug 23 07:12:15.800724 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-Tenant-Id: e449a86b7ec3494583203cb6abc4a930 Aug 23 07:12:15.800724 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-Tenant-Name: tempest-VolumesNegativeTest-2080189454 Aug 23 07:12:15.800724 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-User: tempest-VolumesNegativeTest-2080189454-project Aug 23 07:12:15.800724 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-User-Domain-Id: default Aug 23 07:12:15.800724 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-User-Domain-Name: Default Aug 23 07:12:15.800724 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-User-Id: c31f51896f9a492298ee8185aba9a480 Aug 23 07:12:15.800724 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-User-Name: tempest-VolumesNegativeTest-2080189454-project Aug 23 07:12:15.800724 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: Aug 23 07:12:15.800724 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1562169591", "metadata": {"Type": "work"}}} Aug 23 07:12:15.800724 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: method: Aug 23 07:12:15.800724 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 23 07:12:15.801638 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1562169591', 'metadata': {'Type': 'work'}}}} Aug 23 07:12:15.801638 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 07:12:15.801638 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 07:12:15.801638 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 23 07:12:15.801638 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 23 07:12:15.801638 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 23 07:12:15.801638 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi raise error Aug 23 07:12:15.801638 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Aug 23 07:12:15.801638 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi Aug 23 07:12:15.801638 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 23 07:12:15.801638 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 23 07:12:15.801638 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi Aug 23 07:12:15.801638 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 23 07:12:15.801638 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi '' Aug 23 07:12:15.801638 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi Aug 23 07:12:15.801638 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 07:12:15.801638 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi Aug 23 07:12:15.801638 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 07:12:15.801638 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 07:12:15.801638 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 07:12:15.801638 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 07:12:15.801638 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 07:12:15.802826 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 23 07:12:15.802826 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 23 07:12:15.802826 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 07:12:15.802826 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 07:12:15.802826 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 23 07:12:15.802826 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 23 07:12:15.802826 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 23 07:12:15.802826 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 23 07:12:15.802826 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 23 07:12:15.802826 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 23 07:12:15.802826 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 23 07:12:15.802826 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi Aug 23 07:12:15.802826 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 07:12:15.802826 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi Aug 23 07:12:15.802826 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 07:12:15.802826 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 07:12:15.802826 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 07:12:15.802826 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 23 07:12:15.802826 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 23 07:12:15.804000 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 23 07:12:15.804000 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi Aug 23 07:12:15.804124 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 3/6] 10.222.0.17 () {58 vars in 1245 bytes} [Tue Aug 23 07:12:15 2022] GET /compute/v2.1/os-volumes/9fd78fd4-ab8b-45cb-81e9-9caf2e93a4c7 => generated 352 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 07:12:15.804196 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-935b52ef-d5d9-46b1-ab11-2341d3c9e793 tempest-VolumesNegativeTest-2080189454 tempest-VolumesNegativeTest-2080189454-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=120799) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 07:12:15.805425 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-935b52ef-d5d9-46b1-ab11-2341d3c9e793 tempest-VolumesNegativeTest-2080189454 tempest-VolumesNegativeTest-2080189454-project] 10.222.0.17 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.017235 Aug 23 07:12:15.806251 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 4/7] 10.222.0.17 () {60 vars in 1156 bytes} [Tue Aug 23 07:12:15 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 20 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 23 07:12:15.819594 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-3f93daf0-0468-4531-b57e-a4aac977e659 tempest-VolumesNegativeTest-2080189454 tempest-VolumesNegativeTest-2080189454-project] Calling method '.version_select at 0x7fe3c76833a0>' {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:12:15.880118 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.wsgi [None req-3f93daf0-0468-4531-b57e-a4aac977e659 tempest-VolumesNegativeTest-2080189454 tempest-VolumesNegativeTest-2080189454-project] HTTP exception thrown: Volume tempest-invalid-1229928421 could not be found. Aug 23 07:12:15.885360 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-3f93daf0-0468-4531-b57e-a4aac977e659 tempest-VolumesNegativeTest-2080189454 tempest-VolumesNegativeTest-2080189454-project] Request method failure captured: Aug 23 07:12:15.885360 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1229928421 HTTP/1.1 Aug 23 07:12:15.885360 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: Accept: application/json Aug 23 07:12:15.885360 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: Accept-Encoding: identity Aug 23 07:12:15.885360 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: Connection: close Aug 23 07:12:15.885360 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: Content-Length: 0 Aug 23 07:12:15.885360 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: Content-Type: application/json Aug 23 07:12:15.885360 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: Host: 10.222.0.17 Aug 23 07:12:15.885360 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: Openstack-System-Scope: None Aug 23 07:12:15.885360 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: User-Agent: python-urllib3/1.26.11 Aug 23 07:12:15.885360 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-Auth-Token: gAAAAABjBH3LAR4aSWqZg6J40H_ba2jLlpLpgM6QiC9JEtanVGuAVzSlXncRyWY2sy4mKw9hzecVF8Ya-uR6FvguDrk9TZAuIrcBmrbg4GlkN63BveCMKfGx9h2xYPGavpmSxUFBoXcqcBrBIagEkXEA-oiC2fVbzVbEfGaVlI5idfwcOVMwGzU Aug 23 07:12:15.885360 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-Domain-Id: None Aug 23 07:12:15.885360 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-Domain-Name: None Aug 23 07:12:15.885360 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-Identity-Status: Confirmed Aug 23 07:12:15.885360 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-Is-Admin-Project: True Aug 23 07:12:15.885360 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-Project-Domain-Id: default Aug 23 07:12:15.885360 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-Project-Domain-Name: Default Aug 23 07:12:15.885360 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-Project-Id: e449a86b7ec3494583203cb6abc4a930 Aug 23 07:12:15.885360 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-Project-Name: tempest-VolumesNegativeTest-2080189454 Aug 23 07:12:15.885360 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-Role: reader,member Aug 23 07:12:15.885360 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-Roles: reader,member Aug 23 07:12:15.887648 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/e449a86b7ec3494583203cb6abc4a930"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/e449a86b7ec3494583203cb6abc4a930"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_e449a86b7ec3494583203cb6abc4a930"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/e449a86b7ec3494583203cb6abc4a930"}]}] Aug 23 07:12:15.887648 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-Tenant: tempest-VolumesNegativeTest-2080189454 Aug 23 07:12:15.887648 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-Tenant-Id: e449a86b7ec3494583203cb6abc4a930 Aug 23 07:12:15.887648 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-Tenant-Name: tempest-VolumesNegativeTest-2080189454 Aug 23 07:12:15.887648 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-User: tempest-VolumesNegativeTest-2080189454-project Aug 23 07:12:15.887648 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-User-Domain-Id: default Aug 23 07:12:15.887648 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-User-Domain-Name: Default Aug 23 07:12:15.887648 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-User-Id: c31f51896f9a492298ee8185aba9a480 Aug 23 07:12:15.887648 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-User-Name: tempest-VolumesNegativeTest-2080189454-project Aug 23 07:12:15.887648 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: method: Aug 23 07:12:15.887648 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: exception: Volume tempest-invalid-1229928421 could not be found. Aug 23 07:12:15.887648 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: action_args: {'id': 'tempest-invalid-1229928421'} Aug 23 07:12:15.887648 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 07:12:15.888223 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 07:12:15.888223 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 23 07:12:15.888223 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 23 07:12:15.888223 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 23 07:12:15.888223 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 23 07:12:15.888223 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 23 07:12:15.888223 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 23 07:12:15.888223 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 23 07:12:15.888223 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 23 07:12:15.888223 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 23 07:12:15.888223 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 23 07:12:15.888223 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 23 07:12:15.888223 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 23 07:12:15.888223 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 23 07:12:15.888223 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 23 07:12:15.888223 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1229928421 could not be found. (HTTP 404) (Request-ID: req-80a4c0aa-db49-4261-84e0-abb9ceb2293b) Aug 23 07:12:15.888223 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi Aug 23 07:12:15.888223 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 07:12:15.888223 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi Aug 23 07:12:15.889225 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 07:12:15.889225 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 23 07:12:15.889225 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 23 07:12:15.889225 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 23 07:12:15.889225 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 23 07:12:15.889225 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 23 07:12:15.889225 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 23 07:12:15.889225 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 23 07:12:15.889225 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 23 07:12:15.889225 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 23 07:12:15.889225 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 23 07:12:15.889225 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 23 07:12:15.889225 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 23 07:12:15.889225 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 23 07:12:15.889225 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 23 07:12:15.889225 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 23 07:12:15.889225 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 23 07:12:15.889225 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 23 07:12:15.889225 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 23 07:12:15.890144 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 23 07:12:15.890144 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 23 07:12:15.890144 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 23 07:12:15.890144 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 23 07:12:15.890144 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1229928421 could not be found. Aug 23 07:12:15.890144 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi Aug 23 07:12:15.890144 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 07:12:15.890144 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi Aug 23 07:12:15.890144 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 07:12:15.890144 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 07:12:15.890144 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 07:12:15.890144 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 07:12:15.890144 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 07:12:15.890144 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 23 07:12:15.890144 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 23 07:12:15.890144 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 07:12:15.890144 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 07:12:15.890144 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 23 07:12:15.890144 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 07:12:15.890144 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1229928421 could not be found. Aug 23 07:12:15.891321 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi Aug 23 07:12:15.891321 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 07:12:15.891321 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi Aug 23 07:12:15.891321 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 07:12:15.891321 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 07:12:15.891321 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 07:12:15.891321 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 07:12:15.891321 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 07:12:15.891321 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1229928421 could not be found. Aug 23 07:12:15.891321 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi Aug 23 07:12:15.891321 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-3f93daf0-0468-4531-b57e-a4aac977e659 tempest-VolumesNegativeTest-2080189454 tempest-VolumesNegativeTest-2080189454-project] Returning 404 to user: Volume tempest-invalid-1229928421 could not be found. {{(pid=120798) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 07:12:15.892877 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [None req-3f93daf0-0468-4531-b57e-a4aac977e659 tempest-VolumesNegativeTest-2080189454 tempest-VolumesNegativeTest-2080189454-project] 10.222.0.17 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1229928421" status: 404 len: 99 microversion: 2.1 time: 0.077647 Aug 23 07:12:15.893576 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 4/8] 10.222.0.17 () {58 vars in 1218 bytes} [Tue Aug 23 07:12:15 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1229928421 => generated 99 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Aug 23 07:12:15.907441 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-6c0f892a-49ed-4268-9c4b-dbd294550073 tempest-VolumesNegativeTest-2080189454 tempest-VolumesNegativeTest-2080189454-project] 10.222.0.17 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004956 Aug 23 07:12:15.913396 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 5/9] 10.222.0.17 () {58 vars in 1140 bytes} [Tue Aug 23 07:12:15 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 12 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 23 07:12:15.919255 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [None req-0f9566e9-6b67-4f17-9c48-438e5243c128 tempest-VolumesNegativeTest-2080189454 tempest-VolumesNegativeTest-2080189454-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004489 Aug 23 07:12:15.920312 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 5/10] 10.222.0.17 () {58 vars in 1137 bytes} [Tue Aug 23 07:12:15 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 23 07:12:15.930428 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-bb4836eb-b387-4fb9-8a0f-644db5d81506 tempest-VolumesNegativeTest-2080189454 tempest-VolumesNegativeTest-2080189454-project] Calling method '.version_select at 0x7fe3c779bee0>' {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:12:15.991140 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.wsgi [None req-bb4836eb-b387-4fb9-8a0f-644db5d81506 tempest-VolumesNegativeTest-2080189454 tempest-VolumesNegativeTest-2080189454-project] HTTP exception thrown: Volume 2cc6f35c-f740-42d3-99cb-d74e860cb177 could not be found. Aug 23 07:12:15.994977 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-bb4836eb-b387-4fb9-8a0f-644db5d81506 tempest-VolumesNegativeTest-2080189454 tempest-VolumesNegativeTest-2080189454-project] Request method failure captured: Aug 23 07:12:15.994977 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: request: DELETE /compute/v2.1/os-volumes/2cc6f35c-f740-42d3-99cb-d74e860cb177 HTTP/1.1 Aug 23 07:12:15.994977 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: Accept: application/json Aug 23 07:12:15.994977 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: Accept-Encoding: identity Aug 23 07:12:15.994977 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: Connection: close Aug 23 07:12:15.994977 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: Content-Length: 0 Aug 23 07:12:15.994977 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: Content-Type: application/json Aug 23 07:12:15.994977 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: Host: 10.222.0.17 Aug 23 07:12:15.994977 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: Openstack-System-Scope: None Aug 23 07:12:15.994977 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: User-Agent: python-urllib3/1.26.11 Aug 23 07:12:15.994977 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-Auth-Token: gAAAAABjBH3LAR4aSWqZg6J40H_ba2jLlpLpgM6QiC9JEtanVGuAVzSlXncRyWY2sy4mKw9hzecVF8Ya-uR6FvguDrk9TZAuIrcBmrbg4GlkN63BveCMKfGx9h2xYPGavpmSxUFBoXcqcBrBIagEkXEA-oiC2fVbzVbEfGaVlI5idfwcOVMwGzU Aug 23 07:12:15.994977 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-Domain-Id: None Aug 23 07:12:15.994977 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-Domain-Name: None Aug 23 07:12:15.994977 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-Identity-Status: Confirmed Aug 23 07:12:15.994977 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-Is-Admin-Project: True Aug 23 07:12:15.994977 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-Project-Domain-Id: default Aug 23 07:12:15.994977 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-Project-Domain-Name: Default Aug 23 07:12:15.994977 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-Project-Id: e449a86b7ec3494583203cb6abc4a930 Aug 23 07:12:15.994977 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-Project-Name: tempest-VolumesNegativeTest-2080189454 Aug 23 07:12:15.994977 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-Role: reader,member Aug 23 07:12:15.994977 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-Roles: reader,member Aug 23 07:12:15.996127 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/e449a86b7ec3494583203cb6abc4a930"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/e449a86b7ec3494583203cb6abc4a930"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_e449a86b7ec3494583203cb6abc4a930"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/e449a86b7ec3494583203cb6abc4a930"}]}] Aug 23 07:12:15.996127 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-Tenant: tempest-VolumesNegativeTest-2080189454 Aug 23 07:12:15.996127 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-Tenant-Id: e449a86b7ec3494583203cb6abc4a930 Aug 23 07:12:15.996127 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-Tenant-Name: tempest-VolumesNegativeTest-2080189454 Aug 23 07:12:15.996127 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-User: tempest-VolumesNegativeTest-2080189454-project Aug 23 07:12:15.996127 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-User-Domain-Id: default Aug 23 07:12:15.996127 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-User-Domain-Name: Default Aug 23 07:12:15.996127 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-User-Id: c31f51896f9a492298ee8185aba9a480 Aug 23 07:12:15.996127 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-User-Name: tempest-VolumesNegativeTest-2080189454-project Aug 23 07:12:15.996127 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: method: Aug 23 07:12:15.996127 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: exception: Volume 2cc6f35c-f740-42d3-99cb-d74e860cb177 could not be found. Aug 23 07:12:15.996127 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: action_args: {'id': '2cc6f35c-f740-42d3-99cb-d74e860cb177'} Aug 23 07:12:15.996127 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 07:12:15.996793 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 07:12:15.996793 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 23 07:12:15.996793 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 23 07:12:15.996793 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 23 07:12:15.996793 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 23 07:12:15.996793 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 23 07:12:15.996793 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 23 07:12:15.996793 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 23 07:12:15.996793 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 23 07:12:15.996793 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 23 07:12:15.996793 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 23 07:12:15.996793 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 23 07:12:15.996793 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 23 07:12:15.996793 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 23 07:12:15.996793 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 23 07:12:15.996793 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 2cc6f35c-f740-42d3-99cb-d74e860cb177 could not be found. (HTTP 404) (Request-ID: req-09e39a9d-ac58-48dd-a552-953aa6681ea5) Aug 23 07:12:15.996793 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi Aug 23 07:12:15.996793 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 07:12:15.996793 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi Aug 23 07:12:15.997768 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 07:12:15.997768 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 23 07:12:15.997768 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 23 07:12:15.997768 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 23 07:12:15.997768 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 23 07:12:15.997768 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 23 07:12:15.997768 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 23 07:12:15.997768 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 23 07:12:15.997768 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 23 07:12:15.997768 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 23 07:12:15.997768 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 23 07:12:15.997768 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 23 07:12:15.997768 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 23 07:12:15.997768 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 23 07:12:15.997768 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 23 07:12:15.997768 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 23 07:12:15.997768 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 23 07:12:15.997768 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 23 07:12:15.997768 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 23 07:12:15.998736 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 23 07:12:15.998736 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 23 07:12:15.998736 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 23 07:12:15.998736 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 23 07:12:15.998736 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 2cc6f35c-f740-42d3-99cb-d74e860cb177 could not be found. Aug 23 07:12:15.998736 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi Aug 23 07:12:15.998736 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 07:12:15.998736 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi Aug 23 07:12:15.998736 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 07:12:15.998736 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 07:12:15.998736 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 07:12:15.998736 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 07:12:15.998736 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 07:12:15.998736 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 23 07:12:15.998736 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 23 07:12:15.998736 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 07:12:15.998736 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 07:12:15.998736 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 23 07:12:15.998736 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 07:12:16.000239 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 2cc6f35c-f740-42d3-99cb-d74e860cb177 could not be found. Aug 23 07:12:16.000239 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi Aug 23 07:12:16.000239 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 07:12:16.000239 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi Aug 23 07:12:16.000239 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 07:12:16.000239 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 07:12:16.000239 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 07:12:16.000239 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 07:12:16.000239 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 07:12:16.000239 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 2cc6f35c-f740-42d3-99cb-d74e860cb177 could not be found. Aug 23 07:12:16.000239 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi Aug 23 07:12:16.000239 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-bb4836eb-b387-4fb9-8a0f-644db5d81506 tempest-VolumesNegativeTest-2080189454 tempest-VolumesNegativeTest-2080189454-project] Returning 404 to user: Volume 2cc6f35c-f740-42d3-99cb-d74e860cb177 could not be found. {{(pid=120799) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 07:12:16.000239 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-bb4836eb-b387-4fb9-8a0f-644db5d81506 tempest-VolumesNegativeTest-2080189454 tempest-VolumesNegativeTest-2080189454-project] 10.222.0.17 "DELETE /compute/v2.1/os-volumes/2cc6f35c-f740-42d3-99cb-d74e860cb177" status: 404 len: 109 microversion: 2.1 time: 0.073335 Aug 23 07:12:16.000239 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 6/11] 10.222.0.17 () {58 vars in 1248 bytes} [Tue Aug 23 07:12:15 2022] DELETE /compute/v2.1/os-volumes/2cc6f35c-f740-42d3-99cb-d74e860cb177 => generated 109 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 07:12:16.015100 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-ee8f42ea-f3ef-4208-aa0a-020f5b4a1649 tempest-VolumesNegativeTest-2080189454 tempest-VolumesNegativeTest-2080189454-project] Calling method '.version_select at 0x7fe3c7683ee0>' {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:12:16.073184 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.wsgi [None req-ee8f42ea-f3ef-4208-aa0a-020f5b4a1649 tempest-VolumesNegativeTest-2080189454 tempest-VolumesNegativeTest-2080189454-project] HTTP exception thrown: Volume 353328e6-0e0d-47af-9d78-4c4f8adbf729 could not be found. Aug 23 07:12:16.075176 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-ee8f42ea-f3ef-4208-aa0a-020f5b4a1649 tempest-VolumesNegativeTest-2080189454 tempest-VolumesNegativeTest-2080189454-project] Request method failure captured: Aug 23 07:12:16.075176 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: request: GET /compute/v2.1/os-volumes/353328e6-0e0d-47af-9d78-4c4f8adbf729 HTTP/1.1 Aug 23 07:12:16.075176 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: Accept: application/json Aug 23 07:12:16.075176 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: Accept-Encoding: identity Aug 23 07:12:16.075176 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: Connection: close Aug 23 07:12:16.075176 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: Content-Length: 0 Aug 23 07:12:16.075176 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: Content-Type: application/json Aug 23 07:12:16.075176 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: Host: 10.222.0.17 Aug 23 07:12:16.075176 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: Openstack-System-Scope: None Aug 23 07:12:16.075176 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: User-Agent: python-urllib3/1.26.11 Aug 23 07:12:16.075176 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-Auth-Token: gAAAAABjBH3LAR4aSWqZg6J40H_ba2jLlpLpgM6QiC9JEtanVGuAVzSlXncRyWY2sy4mKw9hzecVF8Ya-uR6FvguDrk9TZAuIrcBmrbg4GlkN63BveCMKfGx9h2xYPGavpmSxUFBoXcqcBrBIagEkXEA-oiC2fVbzVbEfGaVlI5idfwcOVMwGzU Aug 23 07:12:16.075176 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-Domain-Id: None Aug 23 07:12:16.075176 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-Domain-Name: None Aug 23 07:12:16.075176 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-Identity-Status: Confirmed Aug 23 07:12:16.075176 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-Is-Admin-Project: True Aug 23 07:12:16.075176 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-Project-Domain-Id: default Aug 23 07:12:16.075176 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-Project-Domain-Name: Default Aug 23 07:12:16.075176 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-Project-Id: e449a86b7ec3494583203cb6abc4a930 Aug 23 07:12:16.075176 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-Project-Name: tempest-VolumesNegativeTest-2080189454 Aug 23 07:12:16.075176 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-Role: reader,member Aug 23 07:12:16.075176 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-Roles: reader,member Aug 23 07:12:16.076475 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/e449a86b7ec3494583203cb6abc4a930"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/e449a86b7ec3494583203cb6abc4a930"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_e449a86b7ec3494583203cb6abc4a930"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/e449a86b7ec3494583203cb6abc4a930"}]}] Aug 23 07:12:16.076475 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-Tenant: tempest-VolumesNegativeTest-2080189454 Aug 23 07:12:16.076475 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-Tenant-Id: e449a86b7ec3494583203cb6abc4a930 Aug 23 07:12:16.076475 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-Tenant-Name: tempest-VolumesNegativeTest-2080189454 Aug 23 07:12:16.076475 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-User: tempest-VolumesNegativeTest-2080189454-project Aug 23 07:12:16.076475 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-User-Domain-Id: default Aug 23 07:12:16.076475 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-User-Domain-Name: Default Aug 23 07:12:16.076475 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-User-Id: c31f51896f9a492298ee8185aba9a480 Aug 23 07:12:16.076475 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-User-Name: tempest-VolumesNegativeTest-2080189454-project Aug 23 07:12:16.076475 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: method: Aug 23 07:12:16.076475 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: exception: Volume 353328e6-0e0d-47af-9d78-4c4f8adbf729 could not be found. Aug 23 07:12:16.076475 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: action_args: {'id': '353328e6-0e0d-47af-9d78-4c4f8adbf729'} Aug 23 07:12:16.076475 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 07:12:16.077218 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 07:12:16.077218 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 23 07:12:16.077218 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 23 07:12:16.077218 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 23 07:12:16.077218 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 23 07:12:16.077218 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 23 07:12:16.077218 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 23 07:12:16.077218 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 23 07:12:16.077218 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 23 07:12:16.077218 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 23 07:12:16.077218 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 23 07:12:16.077218 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 23 07:12:16.077218 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 23 07:12:16.077218 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 23 07:12:16.077218 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 23 07:12:16.077218 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 353328e6-0e0d-47af-9d78-4c4f8adbf729 could not be found. (HTTP 404) (Request-ID: req-6955cd12-1efb-4280-b92a-b6f77f7f56cd) Aug 23 07:12:16.077218 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi Aug 23 07:12:16.077218 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 07:12:16.077218 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi Aug 23 07:12:16.078251 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 07:12:16.078251 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 23 07:12:16.078251 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 23 07:12:16.078251 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 23 07:12:16.078251 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 23 07:12:16.078251 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 23 07:12:16.078251 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 23 07:12:16.078251 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 23 07:12:16.078251 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 23 07:12:16.078251 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 23 07:12:16.078251 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 23 07:12:16.078251 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 23 07:12:16.078251 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 23 07:12:16.078251 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 23 07:12:16.078251 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 23 07:12:16.078251 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 23 07:12:16.078251 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 23 07:12:16.078251 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 23 07:12:16.078251 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 23 07:12:16.079082 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 23 07:12:16.079082 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 23 07:12:16.079082 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 23 07:12:16.079082 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 23 07:12:16.079082 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 353328e6-0e0d-47af-9d78-4c4f8adbf729 could not be found. Aug 23 07:12:16.079082 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi Aug 23 07:12:16.079082 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 07:12:16.079082 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi Aug 23 07:12:16.079082 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 07:12:16.079082 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 07:12:16.079082 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 07:12:16.079082 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 07:12:16.079082 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 07:12:16.079082 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 23 07:12:16.079082 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 23 07:12:16.079082 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 07:12:16.079082 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 07:12:16.079082 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 23 07:12:16.079082 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 07:12:16.082119 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 353328e6-0e0d-47af-9d78-4c4f8adbf729 could not be found. Aug 23 07:12:16.082119 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi Aug 23 07:12:16.082119 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 07:12:16.082119 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi Aug 23 07:12:16.082119 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 07:12:16.082119 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 07:12:16.082119 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 07:12:16.082119 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 07:12:16.082119 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 07:12:16.082119 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 353328e6-0e0d-47af-9d78-4c4f8adbf729 could not be found. Aug 23 07:12:16.082119 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi Aug 23 07:12:16.082119 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-ee8f42ea-f3ef-4208-aa0a-020f5b4a1649 tempest-VolumesNegativeTest-2080189454 tempest-VolumesNegativeTest-2080189454-project] Returning 404 to user: Volume 353328e6-0e0d-47af-9d78-4c4f8adbf729 could not be found. {{(pid=120798) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 07:12:16.082119 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [None req-ee8f42ea-f3ef-4208-aa0a-020f5b4a1649 tempest-VolumesNegativeTest-2080189454 tempest-VolumesNegativeTest-2080189454-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/353328e6-0e0d-47af-9d78-4c4f8adbf729" status: 404 len: 109 microversion: 2.1 time: 0.072378 Aug 23 07:12:16.082119 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 6/12] 10.222.0.17 () {58 vars in 1245 bytes} [Tue Aug 23 07:12:16 2022] GET /compute/v2.1/os-volumes/353328e6-0e0d-47af-9d78-4c4f8adbf729 => generated 109 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 07:12:16.668235 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-51c3612f-0b42-4ea8-8dda-9e0ff2ca1840 tempest-VolumesSnapshotsTestJSON-308946970 tempest-VolumesSnapshotsTestJSON-308946970-project] Calling method '.version_select at 0x7fe3c7615280>' {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:12:16.784970 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-51c3612f-0b42-4ea8-8dda-9e0ff2ca1840 tempest-VolumesSnapshotsTestJSON-308946970 tempest-VolumesSnapshotsTestJSON-308946970-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/433e922a-0a6e-439f-a123-3d5cf7ba7ba6" status: 200 len: 346 microversion: 2.1 time: 0.122596 Aug 23 07:12:16.785528 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 7/13] 10.222.0.17 () {58 vars in 1245 bytes} [Tue Aug 23 07:12:16 2022] GET /compute/v2.1/os-volumes/433e922a-0a6e-439f-a123-3d5cf7ba7ba6 => generated 346 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 07:12:16.803368 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-4c04cc3a-f694-4101-97bf-a7c263ef755d tempest-VolumesSnapshotsTestJSON-308946970 tempest-VolumesSnapshotsTestJSON-308946970-project] Action: 'create', calling method: .version_select at 0x7fe3c7683940>, body: {"snapshot": {"volume_id": "433e922a-0a6e-439f-a123-3d5cf7ba7ba6", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1561453030"}} {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 07:12:16.812745 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-e5c68a32-c812-4deb-b47c-4a22929db98a tempest-VolumesGetTestJSON-36511058 tempest-VolumesGetTestJSON-36511058-project] Calling method '.version_select at 0x7fe3c7641ca0>' {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:12:17.127771 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-e5c68a32-c812-4deb-b47c-4a22929db98a tempest-VolumesGetTestJSON-36511058 tempest-VolumesGetTestJSON-36511058-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/9fd78fd4-ab8b-45cb-81e9-9caf2e93a4c7" status: 200 len: 353 microversion: 2.1 time: 0.319131 Aug 23 07:12:17.128828 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 8/14] 10.222.0.17 () {58 vars in 1245 bytes} [Tue Aug 23 07:12:16 2022] GET /compute/v2.1/os-volumes/9fd78fd4-ab8b-45cb-81e9-9caf2e93a4c7 => generated 353 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 07:12:17.142947 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-f10bd71f-d5d6-4113-88c4-8d1a15c6665c tempest-VolumesGetTestJSON-36511058 tempest-VolumesGetTestJSON-36511058-project] Calling method '.version_select at 0x7fe3c76155e0>' {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:12:17.281629 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-f10bd71f-d5d6-4113-88c4-8d1a15c6665c tempest-VolumesGetTestJSON-36511058 tempest-VolumesGetTestJSON-36511058-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/9fd78fd4-ab8b-45cb-81e9-9caf2e93a4c7" status: 200 len: 353 microversion: 2.1 time: 0.144088 Aug 23 07:12:17.282686 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 9/15] 10.222.0.17 () {58 vars in 1245 bytes} [Tue Aug 23 07:12:17 2022] GET /compute/v2.1/os-volumes/9fd78fd4-ab8b-45cb-81e9-9caf2e93a4c7 => generated 353 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 07:12:17.304301 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-0a2a848e-3a64-4011-8daf-2e460d743682 tempest-VolumesGetTestJSON-36511058 tempest-VolumesGetTestJSON-36511058-project] Calling method '.version_select at 0x7fe3c7615790>' {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:12:17.350954 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [None req-4c04cc3a-f694-4101-97bf-a7c263ef755d tempest-VolumesSnapshotsTestJSON-308946970 tempest-VolumesSnapshotsTestJSON-308946970-project] 10.222.0.17 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.554986 Aug 23 07:12:17.351847 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 7/16] 10.222.0.17 () {60 vars in 1162 bytes} [Tue Aug 23 07:12:16 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 07:12:17.362522 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-da5e26e8-1c57-49fc-a00a-d7766f3daf96 tempest-VolumesSnapshotsTestJSON-308946970 tempest-VolumesSnapshotsTestJSON-308946970-project] Calling method '.version_select at 0x7fe3c75eedc0>' {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:12:18.217265 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-0a2a848e-3a64-4011-8daf-2e460d743682 tempest-VolumesGetTestJSON-36511058 tempest-VolumesGetTestJSON-36511058-project] 10.222.0.17 "DELETE /compute/v2.1/os-volumes/9fd78fd4-ab8b-45cb-81e9-9caf2e93a4c7" status: 202 len: 0 microversion: 2.1 time: 0.924676 Aug 23 07:12:18.218082 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 10/17] 10.222.0.17 () {58 vars in 1248 bytes} [Tue Aug 23 07:12:17 2022] DELETE /compute/v2.1/os-volumes/9fd78fd4-ab8b-45cb-81e9-9caf2e93a4c7 => generated 0 bytes in 926 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 07:12:18.256267 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [None req-da5e26e8-1c57-49fc-a00a-d7766f3daf96 tempest-VolumesSnapshotsTestJSON-308946970 tempest-VolumesSnapshotsTestJSON-308946970-project] 10.222.0.17 "GET /compute/v2.1/os-snapshots/b5732036-5789-4c51-a6dd-d176833a66e6" status: 200 len: 287 microversion: 2.1 time: 0.897608 Aug 23 07:12:18.256813 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 8/18] 10.222.0.17 () {58 vars in 1251 bytes} [Tue Aug 23 07:12:17 2022] GET /compute/v2.1/os-snapshots/b5732036-5789-4c51-a6dd-d176833a66e6 => generated 287 bytes in 899 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 07:12:18.261959 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-c120295d-84d7-46a6-b326-06c6b91bb922 tempest-VolumesGetTestJSON-36511058 tempest-VolumesGetTestJSON-36511058-project] Calling method '.version_select at 0x7fe3c75eeaf0>' {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:12:18.421456 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [None req-c120295d-84d7-46a6-b326-06c6b91bb922 tempest-VolumesGetTestJSON-36511058 tempest-VolumesGetTestJSON-36511058-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/9fd78fd4-ab8b-45cb-81e9-9caf2e93a4c7" status: 200 len: 352 microversion: 2.1 time: 0.163215 Aug 23 07:12:18.421791 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 9/19] 10.222.0.17 () {58 vars in 1245 bytes} [Tue Aug 23 07:12:18 2022] GET /compute/v2.1/os-volumes/9fd78fd4-ab8b-45cb-81e9-9caf2e93a4c7 => generated 352 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 07:12:18.426596 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-da5945a2-82ca-43a0-a577-ef787d995c8f tempest-VolumesSnapshotsTestJSON-308946970 tempest-VolumesSnapshotsTestJSON-308946970-project] Calling method '.version_select at 0x7fe3c75ee430>' {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:12:18.516907 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [None req-da5945a2-82ca-43a0-a577-ef787d995c8f tempest-VolumesSnapshotsTestJSON-308946970 tempest-VolumesSnapshotsTestJSON-308946970-project] 10.222.0.17 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.093665 Aug 23 07:12:18.517822 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 10/20] 10.222.0.17 () {58 vars in 1140 bytes} [Tue Aug 23 07:12:18 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 07:12:18.529142 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-fb05b181-0162-47fb-961f-9063e0ab9423 tempest-VolumesSnapshotsTestJSON-308946970 tempest-VolumesSnapshotsTestJSON-308946970-project] Calling method '.version_select at 0x7fe3c75f7160>' {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:12:18.606639 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-ebce15ce-2cb2-4cec-97ba-8863a01c5c8c tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1362852361", "imageRef": "b899fd65-02ae-4b43-bac7-86f38fc3f224", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 07:12:18.614769 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [None req-fb05b181-0162-47fb-961f-9063e0ab9423 tempest-VolumesSnapshotsTestJSON-308946970 tempest-VolumesSnapshotsTestJSON-308946970-project] 10.222.0.17 "GET /compute/v2.1/os-snapshots/b5732036-5789-4c51-a6dd-d176833a66e6" status: 200 len: 287 microversion: 2.1 time: 0.089852 Aug 23 07:12:18.615564 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 11/21] 10.222.0.17 () {58 vars in 1251 bytes} [Tue Aug 23 07:12:18 2022] GET /compute/v2.1/os-snapshots/b5732036-5789-4c51-a6dd-d176833a66e6 => generated 287 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 07:12:18.900662 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.network.neutron [None req-ebce15ce-2cb2-4cec-97ba-8863a01c5c8c tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] validate_networks() for [('9e95747b-9120-47f7-876e-b84ff790f199', None, None, None, None, None)] {{(pid=120799) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 23 07:12:19.434298 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-2c043da6-f353-4952-93b1-550aa8992370 tempest-VolumesGetTestJSON-36511058 tempest-VolumesGetTestJSON-36511058-project] Calling method '.version_select at 0x7fe3c7683160>' {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:12:19.618680 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [None req-2c043da6-f353-4952-93b1-550aa8992370 tempest-VolumesGetTestJSON-36511058 tempest-VolumesGetTestJSON-36511058-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/9fd78fd4-ab8b-45cb-81e9-9caf2e93a4c7" status: 200 len: 352 microversion: 2.1 time: 0.188244 Aug 23 07:12:19.619477 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 12/22] 10.222.0.17 () {58 vars in 1245 bytes} [Tue Aug 23 07:12:19 2022] GET /compute/v2.1/os-volumes/9fd78fd4-ab8b-45cb-81e9-9caf2e93a4c7 => generated 352 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 07:12:19.627069 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-fb4fd25d-2952-43c0-b6d9-5fe00e36240c tempest-VolumesSnapshotsTestJSON-308946970 tempest-VolumesSnapshotsTestJSON-308946970-project] Calling method '.version_select at 0x7fe3c7798790>' {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:12:19.696442 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [None req-fb4fd25d-2952-43c0-b6d9-5fe00e36240c tempest-VolumesSnapshotsTestJSON-308946970 tempest-VolumesSnapshotsTestJSON-308946970-project] 10.222.0.17 "GET /compute/v2.1/os-snapshots/b5732036-5789-4c51-a6dd-d176833a66e6" status: 200 len: 287 microversion: 2.1 time: 0.072847 Aug 23 07:12:19.697784 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 13/23] 10.222.0.17 () {58 vars in 1251 bytes} [Tue Aug 23 07:12:19 2022] GET /compute/v2.1/os-snapshots/b5732036-5789-4c51-a6dd-d176833a66e6 => generated 287 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 07:12:20.319205 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.virt.hardware [None req-ebce15ce-2cb2-4cec-97ba-8863a01c5c8c tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Flavor limits 0:0:0 {{(pid=120799) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 07:12:20.319790 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.virt.hardware [None req-ebce15ce-2cb2-4cec-97ba-8863a01c5c8c tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Image limits 0:0:0 {{(pid=120799) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 07:12:20.320199 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.virt.hardware [None req-ebce15ce-2cb2-4cec-97ba-8863a01c5c8c tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Flavor pref 0:0:0 {{(pid=120799) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 07:12:20.320623 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.virt.hardware [None req-ebce15ce-2cb2-4cec-97ba-8863a01c5c8c tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Image pref 0:0:0 {{(pid=120799) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 07:12:20.321188 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.virt.hardware [None req-ebce15ce-2cb2-4cec-97ba-8863a01c5c8c tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120799) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 07:12:20.359292 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-ebce15ce-2cb2-4cec-97ba-8863a01c5c8c tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:12:20.361844 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-ebce15ce-2cb2-4cec-97ba-8863a01c5c8c tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:12:20.363659 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-ebce15ce-2cb2-4cec-97ba-8863a01c5c8c tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:12:20.365023 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-ebce15ce-2cb2-4cec-97ba-8863a01c5c8c tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:12:20.368012 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-ebce15ce-2cb2-4cec-97ba-8863a01c5c8c tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:12:20.372069 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-ebce15ce-2cb2-4cec-97ba-8863a01c5c8c tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:12:20.443953 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.quota [None req-ebce15ce-2cb2-4cec-97ba-8863a01c5c8c tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Getting quotas for project 135367be6e3f4b3d965ee0d99fdca524. Resources: {'ram', 'instances', 'cores'} {{(pid=120799) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 07:12:20.453480 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.quota [None req-ebce15ce-2cb2-4cec-97ba-8863a01c5c8c tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Getting quotas for user 64d54cb95b264c18b45d90822507fae1 and project 135367be6e3f4b3d965ee0d99fdca524. Resources: {'ram', 'instances', 'cores'} {{(pid=120799) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 07:12:20.481880 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.compute.api [None req-ebce15ce-2cb2-4cec-97ba-8863a01c5c8c tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Going to run 1 instances... {{(pid=120799) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 23 07:12:20.501209 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.compute.api [None req-ebce15ce-2cb2-4cec-97ba-8863a01c5c8c tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] [instance: 6915ed26-7e2f-41b9-aada-adcb2c2015d3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b899fd65-02ae-4b43-bac7-86f38fc3f224',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120799) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 07:12:20.645575 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-bf492b76-4bb7-4db4-a4cb-23de6dc2e682 tempest-VolumesGetTestJSON-36511058 tempest-VolumesGetTestJSON-36511058-project] Calling method '.version_select at 0x7fe3c75ee4c0>' {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:12:20.686151 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-ebce15ce-2cb2-4cec-97ba-8863a01c5c8c tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.466690 Aug 23 07:12:20.694451 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 11/24] 10.222.0.17 () {60 vars in 1147 bytes} [Tue Aug 23 07:12:18 2022] POST /compute/v2.1/servers => generated 383 bytes in 2476 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 23 07:12:20.728990 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-307a960a-e7b6-4993-9730-e7176660df0b tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Calling method '>' {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:12:20.729922 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.compute.api [None req-307a960a-e7b6-4993-9730-e7176660df0b tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] [instance: 6915ed26-7e2f-41b9-aada-adcb2c2015d3] Fetching instance by UUID {{(pid=120799) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:12:20.960541 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [None req-bf492b76-4bb7-4db4-a4cb-23de6dc2e682 tempest-VolumesGetTestJSON-36511058 tempest-VolumesGetTestJSON-36511058-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/9fd78fd4-ab8b-45cb-81e9-9caf2e93a4c7" status: 200 len: 352 microversion: 2.1 time: 0.329880 Aug 23 07:12:20.962025 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 14/25] 10.222.0.17 () {58 vars in 1245 bytes} [Tue Aug 23 07:12:20 2022] GET /compute/v2.1/os-volumes/9fd78fd4-ab8b-45cb-81e9-9caf2e93a4c7 => generated 352 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 07:12:20.969525 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-c159fd84-d742-4054-a8a7-30ad6f237763 tempest-VolumesSnapshotsTestJSON-308946970 tempest-VolumesSnapshotsTestJSON-308946970-project] Calling method '.version_select at 0x7fe3c75eeb80>' {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:12:21.062994 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [None req-c159fd84-d742-4054-a8a7-30ad6f237763 tempest-VolumesSnapshotsTestJSON-308946970 tempest-VolumesSnapshotsTestJSON-308946970-project] 10.222.0.17 "GET /compute/v2.1/os-snapshots/b5732036-5789-4c51-a6dd-d176833a66e6" status: 200 len: 288 microversion: 2.1 time: 0.098104 Aug 23 07:12:21.063612 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 15/26] 10.222.0.17 () {58 vars in 1251 bytes} [Tue Aug 23 07:12:20 2022] GET /compute/v2.1/os-snapshots/b5732036-5789-4c51-a6dd-d176833a66e6 => generated 288 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 07:12:21.075212 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-cb26c297-d4b6-40a8-8f6b-e578319c27fc tempest-VolumesSnapshotsTestJSON-308946970 tempest-VolumesSnapshotsTestJSON-308946970-project] Calling method '.version_select at 0x7fe3c75ee9d0>' {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:12:21.273625 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [None req-cb26c297-d4b6-40a8-8f6b-e578319c27fc tempest-VolumesSnapshotsTestJSON-308946970 tempest-VolumesSnapshotsTestJSON-308946970-project] 10.222.0.17 "DELETE /compute/v2.1/os-snapshots/b5732036-5789-4c51-a6dd-d176833a66e6" status: 202 len: 0 microversion: 2.1 time: 0.202449 Aug 23 07:12:21.275950 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 16/27] 10.222.0.17 () {58 vars in 1254 bytes} [Tue Aug 23 07:12:21 2022] DELETE /compute/v2.1/os-snapshots/b5732036-5789-4c51-a6dd-d176833a66e6 => generated 0 bytes in 206 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 23 07:12:21.287152 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-c7b6ba11-72d6-4eb1-8459-1c038611cc04 tempest-VolumesSnapshotsTestJSON-308946970 tempest-VolumesSnapshotsTestJSON-308946970-project] Calling method '.version_select at 0x7fe3c75ee3a0>' {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:12:21.343778 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [None req-c7b6ba11-72d6-4eb1-8459-1c038611cc04 tempest-VolumesSnapshotsTestJSON-308946970 tempest-VolumesSnapshotsTestJSON-308946970-project] 10.222.0.17 "GET /compute/v2.1/os-snapshots/b5732036-5789-4c51-a6dd-d176833a66e6" status: 200 len: 287 microversion: 2.1 time: 0.062366 Aug 23 07:12:21.344654 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 17/28] 10.222.0.17 () {58 vars in 1251 bytes} [Tue Aug 23 07:12:21 2022] GET /compute/v2.1/os-snapshots/b5732036-5789-4c51-a6dd-d176833a66e6 => generated 287 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 07:12:21.387837 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.policy [None req-307a960a-e7b6-4993-9730-e7176660df0b tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64d54cb95b264c18b45d90822507fae1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135367be6e3f4b3d965ee0d99fdca524', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120799) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:12:21.443750 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-307a960a-e7b6-4993-9730-e7176660df0b tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] 10.222.0.17 "GET /compute/v2.1/servers/6915ed26-7e2f-41b9-aada-adcb2c2015d3" status: 200 len: 1222 microversion: 2.1 time: 0.744655 Aug 23 07:12:21.462333 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 12/29] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:12:20 2022] GET /compute/v2.1/servers/6915ed26-7e2f-41b9-aada-adcb2c2015d3 => generated 1222 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:12:21.613324 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-14781a5e-d5f5-4e13-bc36-4c154f2f208e tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1455091074", "imageRef": "b899fd65-02ae-4b43-bac7-86f38fc3f224", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 07:12:21.846334 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.network.neutron [None req-14781a5e-d5f5-4e13-bc36-4c154f2f208e tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] validate_networks() for [('9e95747b-9120-47f7-876e-b84ff790f199', None, None, None, None, None)] {{(pid=120798) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 23 07:12:21.977015 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-ee97b5aa-3c3b-40f9-afc1-5c16f5054e7f tempest-VolumesGetTestJSON-36511058 tempest-VolumesGetTestJSON-36511058-project] Calling method '.version_select at 0x7fe3c64a0af0>' {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:12:22.074329 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.wsgi [None req-ee97b5aa-3c3b-40f9-afc1-5c16f5054e7f tempest-VolumesGetTestJSON-36511058 tempest-VolumesGetTestJSON-36511058-project] HTTP exception thrown: Volume 9fd78fd4-ab8b-45cb-81e9-9caf2e93a4c7 could not be found. Aug 23 07:12:22.077943 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-ee97b5aa-3c3b-40f9-afc1-5c16f5054e7f tempest-VolumesGetTestJSON-36511058 tempest-VolumesGetTestJSON-36511058-project] Request method failure captured: Aug 23 07:12:22.077943 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: request: GET /compute/v2.1/os-volumes/9fd78fd4-ab8b-45cb-81e9-9caf2e93a4c7 HTTP/1.1 Aug 23 07:12:22.077943 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: Accept: application/json Aug 23 07:12:22.077943 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: Accept-Encoding: identity Aug 23 07:12:22.077943 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: Connection: close Aug 23 07:12:22.077943 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: Content-Length: 0 Aug 23 07:12:22.077943 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: Content-Type: application/json Aug 23 07:12:22.077943 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: Host: 10.222.0.17 Aug 23 07:12:22.077943 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: Openstack-System-Scope: None Aug 23 07:12:22.077943 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: User-Agent: python-urllib3/1.26.11 Aug 23 07:12:22.077943 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-Auth-Token: gAAAAABjBH3Lw4br4N9Tl8AqTpdvhgGIy1eGFYxuU6C_PLCtroZgWcBwDIaVwxTFtpQE6yiP0fPTXVn_tUyYKwGYjAfvyu_CNcMI7ZJbDrho8ChJW6l_xKAtHjveU05-5M2rTyoVCXYaYuRdmTSg-6s2FQpFSdEXuXTscjT2TrnC0osWLLbXFvg Aug 23 07:12:22.077943 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-Domain-Id: None Aug 23 07:12:22.077943 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-Domain-Name: None Aug 23 07:12:22.077943 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-Identity-Status: Confirmed Aug 23 07:12:22.077943 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-Is-Admin-Project: True Aug 23 07:12:22.077943 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-Project-Domain-Id: default Aug 23 07:12:22.077943 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-Project-Domain-Name: Default Aug 23 07:12:22.077943 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-Project-Id: f1dc52471ac841d5be9887ddfd1503c1 Aug 23 07:12:22.077943 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-Project-Name: tempest-VolumesGetTestJSON-36511058 Aug 23 07:12:22.077943 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-Role: reader,member Aug 23 07:12:22.077943 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-Roles: reader,member Aug 23 07:12:22.079175 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/f1dc52471ac841d5be9887ddfd1503c1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/f1dc52471ac841d5be9887ddfd1503c1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_f1dc52471ac841d5be9887ddfd1503c1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/f1dc52471ac841d5be9887ddfd1503c1"}]}] Aug 23 07:12:22.079175 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-Tenant: tempest-VolumesGetTestJSON-36511058 Aug 23 07:12:22.079175 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-Tenant-Id: f1dc52471ac841d5be9887ddfd1503c1 Aug 23 07:12:22.079175 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-Tenant-Name: tempest-VolumesGetTestJSON-36511058 Aug 23 07:12:22.079175 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-User: tempest-VolumesGetTestJSON-36511058-project Aug 23 07:12:22.079175 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-User-Domain-Id: default Aug 23 07:12:22.079175 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-User-Domain-Name: Default Aug 23 07:12:22.079175 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-User-Id: 326bc6f8519c4497b1a7d7caeb6b4a77 Aug 23 07:12:22.079175 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-User-Name: tempest-VolumesGetTestJSON-36511058-project Aug 23 07:12:22.079175 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: method: Aug 23 07:12:22.079175 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: exception: Volume 9fd78fd4-ab8b-45cb-81e9-9caf2e93a4c7 could not be found. Aug 23 07:12:22.079175 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: action_args: {'id': '9fd78fd4-ab8b-45cb-81e9-9caf2e93a4c7'} Aug 23 07:12:22.079175 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 07:12:22.079873 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 07:12:22.079873 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 23 07:12:22.079873 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 23 07:12:22.079873 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 23 07:12:22.079873 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 23 07:12:22.079873 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 23 07:12:22.079873 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 23 07:12:22.079873 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 23 07:12:22.079873 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 23 07:12:22.079873 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 23 07:12:22.079873 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 23 07:12:22.079873 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 23 07:12:22.079873 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 23 07:12:22.079873 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 23 07:12:22.079873 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 23 07:12:22.079873 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 9fd78fd4-ab8b-45cb-81e9-9caf2e93a4c7 could not be found. (HTTP 404) (Request-ID: req-a81ba858-e1b2-4b13-b253-2bb4d77ecd47) Aug 23 07:12:22.079873 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi Aug 23 07:12:22.079873 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 07:12:22.079873 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi Aug 23 07:12:22.081150 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 07:12:22.081150 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 23 07:12:22.081150 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 23 07:12:22.081150 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 23 07:12:22.081150 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 23 07:12:22.081150 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 23 07:12:22.081150 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 23 07:12:22.081150 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 23 07:12:22.081150 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 23 07:12:22.081150 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 23 07:12:22.081150 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 23 07:12:22.081150 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 23 07:12:22.081150 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 23 07:12:22.081150 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 23 07:12:22.081150 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 23 07:12:22.081150 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 23 07:12:22.081150 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 23 07:12:22.081150 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 23 07:12:22.081150 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 23 07:12:22.082132 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 23 07:12:22.082132 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 23 07:12:22.082132 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 23 07:12:22.082132 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 23 07:12:22.082132 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 9fd78fd4-ab8b-45cb-81e9-9caf2e93a4c7 could not be found. Aug 23 07:12:22.082132 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi Aug 23 07:12:22.082132 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 07:12:22.082132 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi Aug 23 07:12:22.082132 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 07:12:22.082132 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 07:12:22.082132 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 07:12:22.082132 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 07:12:22.082132 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 07:12:22.082132 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 23 07:12:22.082132 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 23 07:12:22.082132 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 07:12:22.082132 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 07:12:22.082132 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 23 07:12:22.082132 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 07:12:22.084140 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 9fd78fd4-ab8b-45cb-81e9-9caf2e93a4c7 could not be found. Aug 23 07:12:22.084140 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi Aug 23 07:12:22.084140 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 07:12:22.084140 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi Aug 23 07:12:22.084140 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 07:12:22.084140 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 07:12:22.084140 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 07:12:22.084140 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 07:12:22.084140 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 07:12:22.084140 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 9fd78fd4-ab8b-45cb-81e9-9caf2e93a4c7 could not be found. Aug 23 07:12:22.084140 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi Aug 23 07:12:22.088451 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-ee97b5aa-3c3b-40f9-afc1-5c16f5054e7f tempest-VolumesGetTestJSON-36511058 tempest-VolumesGetTestJSON-36511058-project] Returning 404 to user: Volume 9fd78fd4-ab8b-45cb-81e9-9caf2e93a4c7 could not be found. {{(pid=120799) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 07:12:22.090543 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-ee97b5aa-3c3b-40f9-afc1-5c16f5054e7f tempest-VolumesGetTestJSON-36511058 tempest-VolumesGetTestJSON-36511058-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/9fd78fd4-ab8b-45cb-81e9-9caf2e93a4c7" status: 404 len: 109 microversion: 2.1 time: 0.120331 Aug 23 07:12:22.092184 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 13/30] 10.222.0.17 () {58 vars in 1245 bytes} [Tue Aug 23 07:12:21 2022] GET /compute/v2.1/os-volumes/9fd78fd4-ab8b-45cb-81e9-9caf2e93a4c7 => generated 109 bytes in 122 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 23 07:12:22.357372 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-4b19f658-8e34-4e22-99f6-2eb273d3b857 tempest-VolumesSnapshotsTestJSON-308946970 tempest-VolumesSnapshotsTestJSON-308946970-project] Calling method '.version_select at 0x7fe3c64c3af0>' {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:12:22.487613 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.wsgi [None req-4b19f658-8e34-4e22-99f6-2eb273d3b857 tempest-VolumesSnapshotsTestJSON-308946970 tempest-VolumesSnapshotsTestJSON-308946970-project] HTTP exception thrown: Snapshot b5732036-5789-4c51-a6dd-d176833a66e6 could not be found. Aug 23 07:12:22.491251 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-4b19f658-8e34-4e22-99f6-2eb273d3b857 tempest-VolumesSnapshotsTestJSON-308946970 tempest-VolumesSnapshotsTestJSON-308946970-project] Request method failure captured: Aug 23 07:12:22.491251 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: request: GET /compute/v2.1/os-snapshots/b5732036-5789-4c51-a6dd-d176833a66e6 HTTP/1.1 Aug 23 07:12:22.491251 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: Accept: application/json Aug 23 07:12:22.491251 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: Accept-Encoding: identity Aug 23 07:12:22.491251 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: Connection: close Aug 23 07:12:22.491251 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: Content-Length: 0 Aug 23 07:12:22.491251 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: Content-Type: application/json Aug 23 07:12:22.491251 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: Host: 10.222.0.17 Aug 23 07:12:22.491251 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: Openstack-System-Scope: None Aug 23 07:12:22.491251 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: User-Agent: python-urllib3/1.26.11 Aug 23 07:12:22.491251 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-Auth-Token: gAAAAABjBH3LQIB-TY0vnwghwjrbOn860XY23qxh9HFMmvxRnA-RcHEiEluaFvWAlpi4NUxgxHqc_YGQpBAgfDDUm1I7HRyL95eygklF4TUc7FAy_fgPQDz_d2T9J3-5oBK9F6smffrrwENGwJDKvFWwIAnBbTK0Ihw06SRm5jZ6gH3F5dWbIB0 Aug 23 07:12:22.491251 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-Domain-Id: None Aug 23 07:12:22.491251 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-Domain-Name: None Aug 23 07:12:22.491251 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-Identity-Status: Confirmed Aug 23 07:12:22.491251 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-Is-Admin-Project: True Aug 23 07:12:22.491251 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-Project-Domain-Id: default Aug 23 07:12:22.491251 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-Project-Domain-Name: Default Aug 23 07:12:22.491251 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-Project-Id: 2877fe45fc8a4710a294486a9c1991b8 Aug 23 07:12:22.491251 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-308946970 Aug 23 07:12:22.491251 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-Role: reader,member Aug 23 07:12:22.491251 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-Roles: reader,member Aug 23 07:12:22.492547 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/2877fe45fc8a4710a294486a9c1991b8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/2877fe45fc8a4710a294486a9c1991b8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_2877fe45fc8a4710a294486a9c1991b8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/2877fe45fc8a4710a294486a9c1991b8"}]}] Aug 23 07:12:22.492547 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-Tenant: tempest-VolumesSnapshotsTestJSON-308946970 Aug 23 07:12:22.492547 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-Tenant-Id: 2877fe45fc8a4710a294486a9c1991b8 Aug 23 07:12:22.492547 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-308946970 Aug 23 07:12:22.492547 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-User: tempest-VolumesSnapshotsTestJSON-308946970-project Aug 23 07:12:22.492547 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-User-Domain-Id: default Aug 23 07:12:22.492547 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-User-Domain-Name: Default Aug 23 07:12:22.492547 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-User-Id: 4cf8918a05f8452a9bb8e17a47de7a8a Aug 23 07:12:22.492547 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-User-Name: tempest-VolumesSnapshotsTestJSON-308946970-project Aug 23 07:12:22.492547 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: method: Aug 23 07:12:22.492547 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: exception: Snapshot b5732036-5789-4c51-a6dd-d176833a66e6 could not be found. Aug 23 07:12:22.492547 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: action_args: {'id': 'b5732036-5789-4c51-a6dd-d176833a66e6'} Aug 23 07:12:22.492547 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 07:12:22.493290 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 07:12:22.493290 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 23 07:12:22.493290 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 23 07:12:22.493290 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 23 07:12:22.493290 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 23 07:12:22.493290 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 23 07:12:22.493290 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 23 07:12:22.493290 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 23 07:12:22.493290 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 23 07:12:22.493290 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 23 07:12:22.493290 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 23 07:12:22.493290 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 23 07:12:22.493290 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 23 07:12:22.493290 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 23 07:12:22.493290 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 23 07:12:22.493290 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot b5732036-5789-4c51-a6dd-d176833a66e6 could not be found. (HTTP 404) (Request-ID: req-1869580a-3197-4b3d-9aa4-0266d39ad611) Aug 23 07:12:22.493290 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi Aug 23 07:12:22.493290 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 07:12:22.494649 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi Aug 23 07:12:22.494649 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 07:12:22.494649 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Aug 23 07:12:22.494649 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Aug 23 07:12:22.494649 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 23 07:12:22.494649 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 23 07:12:22.494649 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Aug 23 07:12:22.494649 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Aug 23 07:12:22.494649 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 23 07:12:22.494649 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 23 07:12:22.494649 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 23 07:12:22.494649 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 23 07:12:22.494649 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 23 07:12:22.494649 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 23 07:12:22.494649 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 23 07:12:22.494649 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 23 07:12:22.494649 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 23 07:12:22.494649 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 23 07:12:22.494649 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 23 07:12:22.497433 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 23 07:12:22.497433 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 23 07:12:22.497433 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 23 07:12:22.497433 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 23 07:12:22.497433 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 23 07:12:22.497433 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot b5732036-5789-4c51-a6dd-d176833a66e6 could not be found. Aug 23 07:12:22.497433 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi Aug 23 07:12:22.497433 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 07:12:22.497433 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi Aug 23 07:12:22.497433 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 07:12:22.497433 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 07:12:22.497433 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 07:12:22.497433 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 07:12:22.497433 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 07:12:22.497433 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 23 07:12:22.497433 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 23 07:12:22.497433 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 07:12:22.497433 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 07:12:22.497433 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Aug 23 07:12:22.497433 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 07:12:22.500774 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot b5732036-5789-4c51-a6dd-d176833a66e6 could not be found. Aug 23 07:12:22.500774 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi Aug 23 07:12:22.500774 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 07:12:22.500774 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi Aug 23 07:12:22.500774 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 07:12:22.500774 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 07:12:22.500774 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 07:12:22.500774 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 07:12:22.500774 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 07:12:22.500774 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot b5732036-5789-4c51-a6dd-d176833a66e6 could not be found. Aug 23 07:12:22.500774 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi Aug 23 07:12:22.504806 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-4b19f658-8e34-4e22-99f6-2eb273d3b857 tempest-VolumesSnapshotsTestJSON-308946970 tempest-VolumesSnapshotsTestJSON-308946970-project] Returning 404 to user: Snapshot b5732036-5789-4c51-a6dd-d176833a66e6 could not be found. {{(pid=120799) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 07:12:22.506899 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-4b19f658-8e34-4e22-99f6-2eb273d3b857 tempest-VolumesSnapshotsTestJSON-308946970 tempest-VolumesSnapshotsTestJSON-308946970-project] 10.222.0.17 "GET /compute/v2.1/os-snapshots/b5732036-5789-4c51-a6dd-d176833a66e6" status: 404 len: 111 microversion: 2.1 time: 0.153884 Aug 23 07:12:22.512033 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 14/31] 10.222.0.17 () {58 vars in 1251 bytes} [Tue Aug 23 07:12:22 2022] GET /compute/v2.1/os-snapshots/b5732036-5789-4c51-a6dd-d176833a66e6 => generated 111 bytes in 160 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 07:12:22.527670 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-c59890ed-3274-47e1-bb0b-85e588e6b791 tempest-VolumesSnapshotsTestJSON-308946970 tempest-VolumesSnapshotsTestJSON-308946970-project] Calling method '.version_select at 0x7fe3c64c3dc0>' {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:12:22.766638 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-c59890ed-3274-47e1-bb0b-85e588e6b791 tempest-VolumesSnapshotsTestJSON-308946970 tempest-VolumesSnapshotsTestJSON-308946970-project] 10.222.0.17 "DELETE /compute/v2.1/os-volumes/433e922a-0a6e-439f-a123-3d5cf7ba7ba6" status: 202 len: 0 microversion: 2.1 time: 0.250760 Aug 23 07:12:22.767357 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 15/32] 10.222.0.17 () {58 vars in 1248 bytes} [Tue Aug 23 07:12:22 2022] DELETE /compute/v2.1/os-volumes/433e922a-0a6e-439f-a123-3d5cf7ba7ba6 => generated 0 bytes in 254 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 07:12:23.311380 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-385352e9-85e7-4a01-9886-8fc181672b74 tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1921881096", "imageRef": "b899fd65-02ae-4b43-bac7-86f38fc3f224", "flavorRef": "452", "networks": [{"uuid": "c6820ca2-7fe9-4b4d-9ce7-43da28dcba47"}]}} {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 07:12:23.436234 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.network.neutron [None req-385352e9-85e7-4a01-9886-8fc181672b74 tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] validate_networks() for [('c6820ca2-7fe9-4b4d-9ce7-43da28dcba47', None, None, None, None, None)] {{(pid=120799) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 23 07:12:23.930532 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.virt.hardware [None req-14781a5e-d5f5-4e13-bc36-4c154f2f208e tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Flavor limits 0:0:0 {{(pid=120798) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 07:12:23.931118 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.virt.hardware [None req-14781a5e-d5f5-4e13-bc36-4c154f2f208e tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Image limits 0:0:0 {{(pid=120798) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 07:12:23.931727 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.virt.hardware [None req-14781a5e-d5f5-4e13-bc36-4c154f2f208e tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Flavor pref 0:0:0 {{(pid=120798) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 07:12:23.932915 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.virt.hardware [None req-14781a5e-d5f5-4e13-bc36-4c154f2f208e tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Image pref 0:0:0 {{(pid=120798) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 07:12:23.933330 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.virt.hardware [None req-14781a5e-d5f5-4e13-bc36-4c154f2f208e tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120798) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 07:12:23.961868 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-14781a5e-d5f5-4e13-bc36-4c154f2f208e tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:12:23.962450 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-14781a5e-d5f5-4e13-bc36-4c154f2f208e tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:12:23.963486 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-14781a5e-d5f5-4e13-bc36-4c154f2f208e tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:12:23.964214 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-14781a5e-d5f5-4e13-bc36-4c154f2f208e tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:12:23.964978 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-14781a5e-d5f5-4e13-bc36-4c154f2f208e tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:12:23.970930 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-14781a5e-d5f5-4e13-bc36-4c154f2f208e tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:12:24.065948 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.quota [None req-14781a5e-d5f5-4e13-bc36-4c154f2f208e tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Getting quotas for project 135367be6e3f4b3d965ee0d99fdca524. Resources: {'ram', 'instances', 'cores'} {{(pid=120798) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 07:12:24.087031 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.quota [None req-14781a5e-d5f5-4e13-bc36-4c154f2f208e tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Getting quotas for user 64d54cb95b264c18b45d90822507fae1 and project 135367be6e3f4b3d965ee0d99fdca524. Resources: {'ram', 'instances', 'cores'} {{(pid=120798) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 07:12:24.107928 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.compute.api [None req-14781a5e-d5f5-4e13-bc36-4c154f2f208e tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Going to run 1 instances... {{(pid=120798) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 23 07:12:24.111498 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.compute.api [None req-14781a5e-d5f5-4e13-bc36-4c154f2f208e tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] [instance: 703acb74-65e6-4a60-9dd0-bf986498889e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b899fd65-02ae-4b43-bac7-86f38fc3f224',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120798) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 07:12:24.266483 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [None req-14781a5e-d5f5-4e13-bc36-4c154f2f208e tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.658321 Aug 23 07:12:24.267118 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 18/33] 10.222.0.17 () {60 vars in 1147 bytes} [Tue Aug 23 07:12:21 2022] POST /compute/v2.1/servers => generated 383 bytes in 2660 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 23 07:12:24.272364 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-f4f960ae-1203-4393-954a-81f82f0216c2 tempest-VolumesSnapshotsTestJSON-308946970 tempest-VolumesSnapshotsTestJSON-308946970-project] Calling method '.version_select at 0x7fe3c6cfb1f0>' {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:12:24.383604 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [None req-f4f960ae-1203-4393-954a-81f82f0216c2 tempest-VolumesSnapshotsTestJSON-308946970 tempest-VolumesSnapshotsTestJSON-308946970-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/433e922a-0a6e-439f-a123-3d5cf7ba7ba6" status: 200 len: 345 microversion: 2.1 time: 0.114983 Aug 23 07:12:24.384177 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 19/34] 10.222.0.17 () {58 vars in 1245 bytes} [Tue Aug 23 07:12:24 2022] GET /compute/v2.1/os-volumes/433e922a-0a6e-439f-a123-3d5cf7ba7ba6 => generated 345 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 07:12:24.389095 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-3327fec2-b57e-46a3-a5b8-333b629b12ba tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Calling method '>' {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:12:24.389862 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.compute.api [None req-3327fec2-b57e-46a3-a5b8-333b629b12ba tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] [instance: 703acb74-65e6-4a60-9dd0-bf986498889e] Fetching instance by UUID {{(pid=120798) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:12:24.864991 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.policy [None req-3327fec2-b57e-46a3-a5b8-333b629b12ba tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64d54cb95b264c18b45d90822507fae1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135367be6e3f4b3d965ee0d99fdca524', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120798) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:12:24.899181 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [None req-3327fec2-b57e-46a3-a5b8-333b629b12ba tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] 10.222.0.17 "GET /compute/v2.1/servers/703acb74-65e6-4a60-9dd0-bf986498889e" status: 200 len: 1222 microversion: 2.1 time: 0.513675 Aug 23 07:12:24.931787 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 20/35] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:12:24 2022] GET /compute/v2.1/servers/703acb74-65e6-4a60-9dd0-bf986498889e => generated 1222 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:12:25.147946 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.virt.hardware [None req-385352e9-85e7-4a01-9886-8fc181672b74 tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] Flavor limits 0:0:0 {{(pid=120799) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 07:12:25.148448 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.virt.hardware [None req-385352e9-85e7-4a01-9886-8fc181672b74 tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] Image limits 0:0:0 {{(pid=120799) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 07:12:25.148829 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.virt.hardware [None req-385352e9-85e7-4a01-9886-8fc181672b74 tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] Flavor pref 0:0:0 {{(pid=120799) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 07:12:25.149414 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.virt.hardware [None req-385352e9-85e7-4a01-9886-8fc181672b74 tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] Image pref 0:0:0 {{(pid=120799) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 07:12:25.150014 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.virt.hardware [None req-385352e9-85e7-4a01-9886-8fc181672b74 tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120799) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 07:12:25.169244 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-385352e9-85e7-4a01-9886-8fc181672b74 tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:12:25.173121 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-385352e9-85e7-4a01-9886-8fc181672b74 tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:12:25.176709 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-385352e9-85e7-4a01-9886-8fc181672b74 tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:12:25.177755 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-385352e9-85e7-4a01-9886-8fc181672b74 tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:12:25.179467 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-385352e9-85e7-4a01-9886-8fc181672b74 tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:12:25.182155 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-385352e9-85e7-4a01-9886-8fc181672b74 tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:12:25.232618 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.quota [None req-385352e9-85e7-4a01-9886-8fc181672b74 tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] Getting quotas for project 24307daab4d24f979c30e081163c3bfe. Resources: {'ram', 'instances', 'cores'} {{(pid=120799) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 07:12:25.239328 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.quota [None req-385352e9-85e7-4a01-9886-8fc181672b74 tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] Getting quotas for user 6cbcc9668f454c0e8c27495a1827d703 and project 24307daab4d24f979c30e081163c3bfe. Resources: {'ram', 'instances', 'cores'} {{(pid=120799) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 07:12:25.259026 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.compute.api [None req-385352e9-85e7-4a01-9886-8fc181672b74 tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] Going to run 1 instances... {{(pid=120799) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 23 07:12:25.261683 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.compute.api [None req-385352e9-85e7-4a01-9886-8fc181672b74 tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] [instance: 9d984b5d-f788-4a4c-8609-471747c44fb8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b899fd65-02ae-4b43-bac7-86f38fc3f224',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120799) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 07:12:25.338077 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-385352e9-85e7-4a01-9886-8fc181672b74 tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.565786 Aug 23 07:12:25.339289 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 16/36] 10.222.0.17 () {60 vars in 1147 bytes} [Tue Aug 23 07:12:22 2022] POST /compute/v2.1/servers => generated 380 bytes in 2571 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 23 07:12:25.350633 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-5bebe8fa-a0b5-4811-85d7-aca7eef0adf9 tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] Calling method '>' {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:12:25.351240 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.compute.api [None req-5bebe8fa-a0b5-4811-85d7-aca7eef0adf9 tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] [instance: 9d984b5d-f788-4a4c-8609-471747c44fb8] Fetching instance by UUID {{(pid=120798) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:12:25.400578 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-4be7fb05-c064-43b9-b00e-0084b65d3d2e tempest-VolumesSnapshotsTestJSON-308946970 tempest-VolumesSnapshotsTestJSON-308946970-project] Calling method '.version_select at 0x7fe3c64561f0>' {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:12:25.435457 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.policy [None req-5bebe8fa-a0b5-4811-85d7-aca7eef0adf9 tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cbcc9668f454c0e8c27495a1827d703', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24307daab4d24f979c30e081163c3bfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120798) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:12:25.449216 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [None req-5bebe8fa-a0b5-4811-85d7-aca7eef0adf9 tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] 10.222.0.17 "GET /compute/v2.1/servers/9d984b5d-f788-4a4c-8609-471747c44fb8" status: 200 len: 1215 microversion: 2.1 time: 0.102096 Aug 23 07:12:25.464496 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 21/37] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:12:25 2022] GET /compute/v2.1/servers/9d984b5d-f788-4a4c-8609-471747c44fb8 => generated 1215 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:12:25.548000 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-4be7fb05-c064-43b9-b00e-0084b65d3d2e tempest-VolumesSnapshotsTestJSON-308946970 tempest-VolumesSnapshotsTestJSON-308946970-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/433e922a-0a6e-439f-a123-3d5cf7ba7ba6" status: 200 len: 345 microversion: 2.1 time: 0.153393 Aug 23 07:12:25.548910 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 17/38] 10.222.0.17 () {58 vars in 1245 bytes} [Tue Aug 23 07:12:25 2022] GET /compute/v2.1/os-volumes/433e922a-0a6e-439f-a123-3d5cf7ba7ba6 => generated 345 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 07:12:25.929285 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-f8ca2d79-f674-4006-b173-e3e1740e28f6 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Calling method '>' {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:12:25.930206 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.compute.api [None req-f8ca2d79-f674-4006-b173-e3e1740e28f6 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] [instance: 703acb74-65e6-4a60-9dd0-bf986498889e] Fetching instance by UUID {{(pid=120798) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:12:25.951706 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-f8ca2d79-f674-4006-b173-e3e1740e28f6 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:12:25.959103 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-f8ca2d79-f674-4006-b173-e3e1740e28f6 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:12:25.960856 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-f8ca2d79-f674-4006-b173-e3e1740e28f6 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:12:25.963226 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-f8ca2d79-f674-4006-b173-e3e1740e28f6 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:12:25.966100 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-f8ca2d79-f674-4006-b173-e3e1740e28f6 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:12:25.969832 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-f8ca2d79-f674-4006-b173-e3e1740e28f6 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:12:26.498173 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.policy [None req-f8ca2d79-f674-4006-b173-e3e1740e28f6 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64d54cb95b264c18b45d90822507fae1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135367be6e3f4b3d965ee0d99fdca524', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120798) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:12:26.535702 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [None req-f8ca2d79-f674-4006-b173-e3e1740e28f6 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] 10.222.0.17 "GET /compute/v2.1/servers/703acb74-65e6-4a60-9dd0-bf986498889e" status: 200 len: 1274 microversion: 2.1 time: 0.611812 Aug 23 07:12:26.553376 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 22/39] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:12:25 2022] GET /compute/v2.1/servers/703acb74-65e6-4a60-9dd0-bf986498889e => generated 1274 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:12:26.592852 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-3286f22b-16d0-4a2a-9e56-b45b86883b89 tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] Calling method '>' {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:12:26.595847 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.compute.api [None req-3286f22b-16d0-4a2a-9e56-b45b86883b89 tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] [instance: 9d984b5d-f788-4a4c-8609-471747c44fb8] Fetching instance by UUID {{(pid=120798) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:12:26.619689 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-3286f22b-16d0-4a2a-9e56-b45b86883b89 tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:12:26.620575 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-3286f22b-16d0-4a2a-9e56-b45b86883b89 tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:12:26.621256 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-3286f22b-16d0-4a2a-9e56-b45b86883b89 tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:12:26.622643 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-3286f22b-16d0-4a2a-9e56-b45b86883b89 tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:12:26.623305 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-3286f22b-16d0-4a2a-9e56-b45b86883b89 tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:12:26.624008 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-3286f22b-16d0-4a2a-9e56-b45b86883b89 tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:12:26.735591 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.policy [None req-3286f22b-16d0-4a2a-9e56-b45b86883b89 tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cbcc9668f454c0e8c27495a1827d703', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24307daab4d24f979c30e081163c3bfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120798) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:12:26.744553 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [None req-3286f22b-16d0-4a2a-9e56-b45b86883b89 tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] 10.222.0.17 "GET /compute/v2.1/servers/9d984b5d-f788-4a4c-8609-471747c44fb8" status: 200 len: 1219 microversion: 2.1 time: 0.189621 Aug 23 07:12:26.751863 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 23/40] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:12:26 2022] GET /compute/v2.1/servers/9d984b5d-f788-4a4c-8609-471747c44fb8 => generated 1219 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:12:26.771322 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-4c8720f3-eff2-4419-b8bf-57812095499c tempest-VolumesSnapshotsTestJSON-308946970 tempest-VolumesSnapshotsTestJSON-308946970-project] Calling method '.version_select at 0x7fe3c63d7310>' {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:12:26.842470 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.wsgi [None req-4c8720f3-eff2-4419-b8bf-57812095499c tempest-VolumesSnapshotsTestJSON-308946970 tempest-VolumesSnapshotsTestJSON-308946970-project] HTTP exception thrown: Volume 433e922a-0a6e-439f-a123-3d5cf7ba7ba6 could not be found. Aug 23 07:12:26.843954 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-4c8720f3-eff2-4419-b8bf-57812095499c tempest-VolumesSnapshotsTestJSON-308946970 tempest-VolumesSnapshotsTestJSON-308946970-project] Request method failure captured: Aug 23 07:12:26.843954 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: request: GET /compute/v2.1/os-volumes/433e922a-0a6e-439f-a123-3d5cf7ba7ba6 HTTP/1.1 Aug 23 07:12:26.843954 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: Accept: application/json Aug 23 07:12:26.843954 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: Accept-Encoding: identity Aug 23 07:12:26.843954 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: Connection: close Aug 23 07:12:26.843954 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: Content-Length: 0 Aug 23 07:12:26.843954 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: Content-Type: application/json Aug 23 07:12:26.843954 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: Host: 10.222.0.17 Aug 23 07:12:26.843954 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: Openstack-System-Scope: None Aug 23 07:12:26.843954 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: User-Agent: python-urllib3/1.26.11 Aug 23 07:12:26.843954 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-Auth-Token: gAAAAABjBH3LQIB-TY0vnwghwjrbOn860XY23qxh9HFMmvxRnA-RcHEiEluaFvWAlpi4NUxgxHqc_YGQpBAgfDDUm1I7HRyL95eygklF4TUc7FAy_fgPQDz_d2T9J3-5oBK9F6smffrrwENGwJDKvFWwIAnBbTK0Ihw06SRm5jZ6gH3F5dWbIB0 Aug 23 07:12:26.843954 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-Domain-Id: None Aug 23 07:12:26.843954 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-Domain-Name: None Aug 23 07:12:26.843954 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-Identity-Status: Confirmed Aug 23 07:12:26.843954 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-Is-Admin-Project: True Aug 23 07:12:26.843954 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-Project-Domain-Id: default Aug 23 07:12:26.843954 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-Project-Domain-Name: Default Aug 23 07:12:26.843954 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-Project-Id: 2877fe45fc8a4710a294486a9c1991b8 Aug 23 07:12:26.843954 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-308946970 Aug 23 07:12:26.843954 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-Role: reader,member Aug 23 07:12:26.843954 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-Roles: reader,member Aug 23 07:12:26.845285 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/2877fe45fc8a4710a294486a9c1991b8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/2877fe45fc8a4710a294486a9c1991b8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_2877fe45fc8a4710a294486a9c1991b8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/2877fe45fc8a4710a294486a9c1991b8"}]}] Aug 23 07:12:26.845285 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-Tenant: tempest-VolumesSnapshotsTestJSON-308946970 Aug 23 07:12:26.845285 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-Tenant-Id: 2877fe45fc8a4710a294486a9c1991b8 Aug 23 07:12:26.845285 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-308946970 Aug 23 07:12:26.845285 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-User: tempest-VolumesSnapshotsTestJSON-308946970-project Aug 23 07:12:26.845285 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-User-Domain-Id: default Aug 23 07:12:26.845285 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-User-Domain-Name: Default Aug 23 07:12:26.845285 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-User-Id: 4cf8918a05f8452a9bb8e17a47de7a8a Aug 23 07:12:26.845285 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-User-Name: tempest-VolumesSnapshotsTestJSON-308946970-project Aug 23 07:12:26.845285 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: method: Aug 23 07:12:26.845285 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: exception: Volume 433e922a-0a6e-439f-a123-3d5cf7ba7ba6 could not be found. Aug 23 07:12:26.845285 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: action_args: {'id': '433e922a-0a6e-439f-a123-3d5cf7ba7ba6'} Aug 23 07:12:26.845285 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 07:12:26.846082 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 07:12:26.846082 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 23 07:12:26.846082 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 23 07:12:26.846082 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 23 07:12:26.846082 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 23 07:12:26.846082 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 23 07:12:26.846082 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 23 07:12:26.846082 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 23 07:12:26.846082 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 23 07:12:26.846082 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 23 07:12:26.846082 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 23 07:12:26.846082 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 23 07:12:26.846082 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 23 07:12:26.846082 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 23 07:12:26.846082 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 23 07:12:26.846082 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 433e922a-0a6e-439f-a123-3d5cf7ba7ba6 could not be found. (HTTP 404) (Request-ID: req-0c0d72ca-4cdb-4ebc-a555-b77e2dd3687e) Aug 23 07:12:26.846082 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi Aug 23 07:12:26.846082 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 07:12:26.846082 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi Aug 23 07:12:26.847030 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 07:12:26.847030 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 23 07:12:26.847030 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 23 07:12:26.847030 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 23 07:12:26.847030 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 23 07:12:26.847030 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 23 07:12:26.847030 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 23 07:12:26.847030 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 23 07:12:26.847030 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 23 07:12:26.847030 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 23 07:12:26.847030 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 23 07:12:26.847030 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 23 07:12:26.847030 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 23 07:12:26.847030 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 23 07:12:26.847030 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 23 07:12:26.847030 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 23 07:12:26.847030 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 23 07:12:26.847030 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 23 07:12:26.847030 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 23 07:12:26.848001 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 23 07:12:26.848001 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 23 07:12:26.848001 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 23 07:12:26.848001 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 23 07:12:26.848001 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 433e922a-0a6e-439f-a123-3d5cf7ba7ba6 could not be found. Aug 23 07:12:26.848001 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi Aug 23 07:12:26.848001 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 07:12:26.848001 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi Aug 23 07:12:26.848001 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 07:12:26.848001 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 07:12:26.848001 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 07:12:26.848001 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 07:12:26.848001 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 07:12:26.848001 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 23 07:12:26.848001 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 23 07:12:26.848001 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 07:12:26.848001 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 07:12:26.848001 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 23 07:12:26.848001 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 07:12:26.848925 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 433e922a-0a6e-439f-a123-3d5cf7ba7ba6 could not be found. Aug 23 07:12:26.848925 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi Aug 23 07:12:26.848925 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 07:12:26.848925 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi Aug 23 07:12:26.848925 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 07:12:26.848925 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 07:12:26.848925 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 07:12:26.848925 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 07:12:26.848925 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 07:12:26.848925 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 433e922a-0a6e-439f-a123-3d5cf7ba7ba6 could not be found. Aug 23 07:12:26.848925 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi Aug 23 07:12:26.848925 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-4c8720f3-eff2-4419-b8bf-57812095499c tempest-VolumesSnapshotsTestJSON-308946970 tempest-VolumesSnapshotsTestJSON-308946970-project] Returning 404 to user: Volume 433e922a-0a6e-439f-a123-3d5cf7ba7ba6 could not be found. {{(pid=120798) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 07:12:26.848925 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [None req-4c8720f3-eff2-4419-b8bf-57812095499c tempest-VolumesSnapshotsTestJSON-308946970 tempest-VolumesSnapshotsTestJSON-308946970-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/433e922a-0a6e-439f-a123-3d5cf7ba7ba6" status: 404 len: 109 microversion: 2.1 time: 0.084832 Aug 23 07:12:26.855269 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 24/41] 10.222.0.17 () {58 vars in 1245 bytes} [Tue Aug 23 07:12:26 2022] GET /compute/v2.1/os-volumes/433e922a-0a6e-439f-a123-3d5cf7ba7ba6 => generated 109 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 07:12:26.866877 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-358a82db-6dd2-4b7c-833c-d45553a1e20d tempest-VolumesSnapshotsTestJSON-308946970 tempest-VolumesSnapshotsTestJSON-308946970-project] Calling method '.version_select at 0x7fe3c6405280>' {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:12:27.038678 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.wsgi [None req-358a82db-6dd2-4b7c-833c-d45553a1e20d tempest-VolumesSnapshotsTestJSON-308946970 tempest-VolumesSnapshotsTestJSON-308946970-project] HTTP exception thrown: Volume 433e922a-0a6e-439f-a123-3d5cf7ba7ba6 could not be found. Aug 23 07:12:27.040990 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-358a82db-6dd2-4b7c-833c-d45553a1e20d tempest-VolumesSnapshotsTestJSON-308946970 tempest-VolumesSnapshotsTestJSON-308946970-project] Request method failure captured: Aug 23 07:12:27.040990 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: request: DELETE /compute/v2.1/os-volumes/433e922a-0a6e-439f-a123-3d5cf7ba7ba6 HTTP/1.1 Aug 23 07:12:27.040990 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: Accept: application/json Aug 23 07:12:27.040990 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: Accept-Encoding: identity Aug 23 07:12:27.040990 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: Connection: close Aug 23 07:12:27.040990 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: Content-Length: 0 Aug 23 07:12:27.040990 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: Content-Type: application/json Aug 23 07:12:27.040990 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: Host: 10.222.0.17 Aug 23 07:12:27.040990 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: Openstack-System-Scope: None Aug 23 07:12:27.040990 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: User-Agent: python-urllib3/1.26.11 Aug 23 07:12:27.040990 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-Auth-Token: gAAAAABjBH3LQIB-TY0vnwghwjrbOn860XY23qxh9HFMmvxRnA-RcHEiEluaFvWAlpi4NUxgxHqc_YGQpBAgfDDUm1I7HRyL95eygklF4TUc7FAy_fgPQDz_d2T9J3-5oBK9F6smffrrwENGwJDKvFWwIAnBbTK0Ihw06SRm5jZ6gH3F5dWbIB0 Aug 23 07:12:27.040990 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-Domain-Id: None Aug 23 07:12:27.040990 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-Domain-Name: None Aug 23 07:12:27.040990 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-Identity-Status: Confirmed Aug 23 07:12:27.040990 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-Is-Admin-Project: True Aug 23 07:12:27.040990 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-Project-Domain-Id: default Aug 23 07:12:27.040990 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-Project-Domain-Name: Default Aug 23 07:12:27.040990 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-Project-Id: 2877fe45fc8a4710a294486a9c1991b8 Aug 23 07:12:27.040990 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-308946970 Aug 23 07:12:27.040990 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-Role: reader,member Aug 23 07:12:27.040990 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-Roles: reader,member Aug 23 07:12:27.042281 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/2877fe45fc8a4710a294486a9c1991b8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/2877fe45fc8a4710a294486a9c1991b8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_2877fe45fc8a4710a294486a9c1991b8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/2877fe45fc8a4710a294486a9c1991b8"}]}] Aug 23 07:12:27.042281 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-Tenant: tempest-VolumesSnapshotsTestJSON-308946970 Aug 23 07:12:27.042281 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-Tenant-Id: 2877fe45fc8a4710a294486a9c1991b8 Aug 23 07:12:27.042281 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-308946970 Aug 23 07:12:27.042281 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-User: tempest-VolumesSnapshotsTestJSON-308946970-project Aug 23 07:12:27.042281 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-User-Domain-Id: default Aug 23 07:12:27.042281 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-User-Domain-Name: Default Aug 23 07:12:27.042281 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-User-Id: 4cf8918a05f8452a9bb8e17a47de7a8a Aug 23 07:12:27.042281 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-User-Name: tempest-VolumesSnapshotsTestJSON-308946970-project Aug 23 07:12:27.042281 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: method: Aug 23 07:12:27.042281 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: exception: Volume 433e922a-0a6e-439f-a123-3d5cf7ba7ba6 could not be found. Aug 23 07:12:27.042281 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: action_args: {'id': '433e922a-0a6e-439f-a123-3d5cf7ba7ba6'} Aug 23 07:12:27.042281 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 07:12:27.043078 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 07:12:27.043078 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 23 07:12:27.043078 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 23 07:12:27.043078 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 23 07:12:27.043078 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 23 07:12:27.043078 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 23 07:12:27.043078 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 23 07:12:27.043078 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 23 07:12:27.043078 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 23 07:12:27.043078 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 23 07:12:27.043078 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 23 07:12:27.043078 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 23 07:12:27.043078 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 23 07:12:27.043078 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 23 07:12:27.043078 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 23 07:12:27.043078 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 433e922a-0a6e-439f-a123-3d5cf7ba7ba6 could not be found. (HTTP 404) (Request-ID: req-43a066b1-7836-4a41-a4c6-0db310b11db3) Aug 23 07:12:27.043078 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi Aug 23 07:12:27.043078 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 07:12:27.043078 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi Aug 23 07:12:27.044244 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 07:12:27.044244 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 23 07:12:27.044244 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 23 07:12:27.044244 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 23 07:12:27.044244 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 23 07:12:27.044244 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 23 07:12:27.044244 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 23 07:12:27.044244 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 23 07:12:27.044244 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 23 07:12:27.044244 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 23 07:12:27.044244 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 23 07:12:27.044244 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 23 07:12:27.044244 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 23 07:12:27.044244 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 23 07:12:27.044244 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 23 07:12:27.044244 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 23 07:12:27.044244 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 23 07:12:27.044244 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 23 07:12:27.044244 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 23 07:12:27.045402 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 23 07:12:27.045402 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 23 07:12:27.045402 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 23 07:12:27.045402 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 23 07:12:27.045402 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 433e922a-0a6e-439f-a123-3d5cf7ba7ba6 could not be found. Aug 23 07:12:27.045402 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi Aug 23 07:12:27.045402 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 07:12:27.045402 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi Aug 23 07:12:27.045402 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 07:12:27.045402 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 07:12:27.045402 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 07:12:27.045402 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 07:12:27.045402 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 07:12:27.045402 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 23 07:12:27.045402 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 23 07:12:27.045402 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 07:12:27.045402 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 07:12:27.045402 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 23 07:12:27.045402 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 07:12:27.046627 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 433e922a-0a6e-439f-a123-3d5cf7ba7ba6 could not be found. Aug 23 07:12:27.046627 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi Aug 23 07:12:27.046627 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 07:12:27.046627 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi Aug 23 07:12:27.046627 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 07:12:27.046627 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 07:12:27.046627 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 07:12:27.046627 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 07:12:27.046627 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 07:12:27.046627 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 433e922a-0a6e-439f-a123-3d5cf7ba7ba6 could not be found. Aug 23 07:12:27.046627 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi Aug 23 07:12:27.046627 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-358a82db-6dd2-4b7c-833c-d45553a1e20d tempest-VolumesSnapshotsTestJSON-308946970 tempest-VolumesSnapshotsTestJSON-308946970-project] Returning 404 to user: Volume 433e922a-0a6e-439f-a123-3d5cf7ba7ba6 could not be found. {{(pid=120798) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 07:12:27.046627 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [None req-358a82db-6dd2-4b7c-833c-d45553a1e20d tempest-VolumesSnapshotsTestJSON-308946970 tempest-VolumesSnapshotsTestJSON-308946970-project] 10.222.0.17 "DELETE /compute/v2.1/os-volumes/433e922a-0a6e-439f-a123-3d5cf7ba7ba6" status: 404 len: 109 microversion: 2.1 time: 0.188961 Aug 23 07:12:27.048533 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 25/42] 10.222.0.17 () {58 vars in 1248 bytes} [Tue Aug 23 07:12:26 2022] DELETE /compute/v2.1/os-volumes/433e922a-0a6e-439f-a123-3d5cf7ba7ba6 => generated 109 bytes in 192 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 07:12:27.055572 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-e1befb69-8075-4d84-9382-0172df3d79c7 tempest-VolumesSnapshotsTestJSON-308946970 tempest-VolumesSnapshotsTestJSON-308946970-project] Calling method '.version_select at 0x7fe3c6431940>' {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:12:27.124506 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-022be7fe-642a-47e4-8433-933f43d3142d tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Action: 'create', calling method: .version_select at 0x7fe3c64c3670>, body: {"keypair": {"name": "tempest-keypair-479729521", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIgcv502000NAxbsnRE8FucaevD2biVH2JE7X7bYVJs+dEClOlgI0jZAdlbtqdRnTSlU+90JAfJM7WFnZExktw3JrO7nAXl0o9fl9H+UtECwx+w7EsuWia11npSRkqwlkw=="}} {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 07:12:27.173021 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.quota [None req-022be7fe-642a-47e4-8433-933f43d3142d tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Getting quotas for project eb44f62fa62e46528712f24479cbb19f. Resources: {'key_pairs'} {{(pid=120799) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 07:12:27.184113 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.quota [None req-022be7fe-642a-47e4-8433-933f43d3142d tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Getting quotas for user 471dc5c1db64411ab1d80ad6c038e519 and project eb44f62fa62e46528712f24479cbb19f. Resources: {'key_pairs'} {{(pid=120799) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 07:12:27.191023 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.wsgi [None req-e1befb69-8075-4d84-9382-0172df3d79c7 tempest-VolumesSnapshotsTestJSON-308946970 tempest-VolumesSnapshotsTestJSON-308946970-project] HTTP exception thrown: Volume 433e922a-0a6e-439f-a123-3d5cf7ba7ba6 could not be found. Aug 23 07:12:27.193281 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-e1befb69-8075-4d84-9382-0172df3d79c7 tempest-VolumesSnapshotsTestJSON-308946970 tempest-VolumesSnapshotsTestJSON-308946970-project] Request method failure captured: Aug 23 07:12:27.193281 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: request: GET /compute/v2.1/os-volumes/433e922a-0a6e-439f-a123-3d5cf7ba7ba6 HTTP/1.1 Aug 23 07:12:27.193281 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: Accept: application/json Aug 23 07:12:27.193281 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: Accept-Encoding: identity Aug 23 07:12:27.193281 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: Connection: close Aug 23 07:12:27.193281 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: Content-Length: 0 Aug 23 07:12:27.193281 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: Content-Type: application/json Aug 23 07:12:27.193281 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: Host: 10.222.0.17 Aug 23 07:12:27.193281 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: Openstack-System-Scope: None Aug 23 07:12:27.193281 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: User-Agent: python-urllib3/1.26.11 Aug 23 07:12:27.193281 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-Auth-Token: gAAAAABjBH3LQIB-TY0vnwghwjrbOn860XY23qxh9HFMmvxRnA-RcHEiEluaFvWAlpi4NUxgxHqc_YGQpBAgfDDUm1I7HRyL95eygklF4TUc7FAy_fgPQDz_d2T9J3-5oBK9F6smffrrwENGwJDKvFWwIAnBbTK0Ihw06SRm5jZ6gH3F5dWbIB0 Aug 23 07:12:27.193281 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-Domain-Id: None Aug 23 07:12:27.193281 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-Domain-Name: None Aug 23 07:12:27.193281 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-Identity-Status: Confirmed Aug 23 07:12:27.193281 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-Is-Admin-Project: True Aug 23 07:12:27.193281 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-Project-Domain-Id: default Aug 23 07:12:27.193281 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-Project-Domain-Name: Default Aug 23 07:12:27.193281 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-Project-Id: 2877fe45fc8a4710a294486a9c1991b8 Aug 23 07:12:27.193281 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-308946970 Aug 23 07:12:27.193281 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-Role: reader,member Aug 23 07:12:27.193281 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-Roles: reader,member Aug 23 07:12:27.194431 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/2877fe45fc8a4710a294486a9c1991b8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/2877fe45fc8a4710a294486a9c1991b8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_2877fe45fc8a4710a294486a9c1991b8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/2877fe45fc8a4710a294486a9c1991b8"}]}] Aug 23 07:12:27.194431 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-Tenant: tempest-VolumesSnapshotsTestJSON-308946970 Aug 23 07:12:27.194431 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-Tenant-Id: 2877fe45fc8a4710a294486a9c1991b8 Aug 23 07:12:27.194431 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-308946970 Aug 23 07:12:27.194431 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-User: tempest-VolumesSnapshotsTestJSON-308946970-project Aug 23 07:12:27.194431 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-User-Domain-Id: default Aug 23 07:12:27.194431 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-User-Domain-Name: Default Aug 23 07:12:27.194431 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-User-Id: 4cf8918a05f8452a9bb8e17a47de7a8a Aug 23 07:12:27.194431 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-User-Name: tempest-VolumesSnapshotsTestJSON-308946970-project Aug 23 07:12:27.194431 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: method: Aug 23 07:12:27.194431 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: exception: Volume 433e922a-0a6e-439f-a123-3d5cf7ba7ba6 could not be found. Aug 23 07:12:27.194431 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: action_args: {'id': '433e922a-0a6e-439f-a123-3d5cf7ba7ba6'} Aug 23 07:12:27.194431 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 07:12:27.195105 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 07:12:27.195105 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 23 07:12:27.195105 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 23 07:12:27.195105 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 23 07:12:27.195105 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 23 07:12:27.195105 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 23 07:12:27.195105 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 23 07:12:27.195105 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 23 07:12:27.195105 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 23 07:12:27.195105 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 23 07:12:27.195105 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 23 07:12:27.195105 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 23 07:12:27.195105 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 23 07:12:27.195105 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 23 07:12:27.195105 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 23 07:12:27.195105 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 433e922a-0a6e-439f-a123-3d5cf7ba7ba6 could not be found. (HTTP 404) (Request-ID: req-332173c3-a172-4b20-953e-043a76a81a2f) Aug 23 07:12:27.195105 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi Aug 23 07:12:27.195105 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 07:12:27.195105 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi Aug 23 07:12:27.196244 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 07:12:27.196244 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 23 07:12:27.196244 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 23 07:12:27.196244 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 23 07:12:27.196244 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 23 07:12:27.196244 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 23 07:12:27.196244 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 23 07:12:27.196244 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 23 07:12:27.196244 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 23 07:12:27.196244 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 23 07:12:27.196244 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 23 07:12:27.196244 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 23 07:12:27.196244 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 23 07:12:27.196244 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 23 07:12:27.196244 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 23 07:12:27.196244 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 23 07:12:27.196244 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 23 07:12:27.196244 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 23 07:12:27.196244 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 23 07:12:27.197398 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 23 07:12:27.197398 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 23 07:12:27.197398 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 23 07:12:27.197398 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 23 07:12:27.197398 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 433e922a-0a6e-439f-a123-3d5cf7ba7ba6 could not be found. Aug 23 07:12:27.197398 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi Aug 23 07:12:27.197398 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 07:12:27.197398 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi Aug 23 07:12:27.197398 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 07:12:27.197398 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 07:12:27.197398 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 07:12:27.197398 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 07:12:27.197398 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 07:12:27.197398 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 23 07:12:27.197398 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 23 07:12:27.197398 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 07:12:27.197398 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 07:12:27.197398 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 23 07:12:27.197398 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 07:12:27.198390 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 433e922a-0a6e-439f-a123-3d5cf7ba7ba6 could not be found. Aug 23 07:12:27.198390 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi Aug 23 07:12:27.198390 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 07:12:27.198390 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi Aug 23 07:12:27.198390 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 07:12:27.198390 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 07:12:27.198390 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 07:12:27.198390 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 07:12:27.198390 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 07:12:27.198390 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 433e922a-0a6e-439f-a123-3d5cf7ba7ba6 could not be found. Aug 23 07:12:27.198390 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi Aug 23 07:12:27.199990 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-e1befb69-8075-4d84-9382-0172df3d79c7 tempest-VolumesSnapshotsTestJSON-308946970 tempest-VolumesSnapshotsTestJSON-308946970-project] Returning 404 to user: Volume 433e922a-0a6e-439f-a123-3d5cf7ba7ba6 could not be found. {{(pid=120798) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 07:12:27.201038 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [None req-e1befb69-8075-4d84-9382-0172df3d79c7 tempest-VolumesSnapshotsTestJSON-308946970 tempest-VolumesSnapshotsTestJSON-308946970-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/433e922a-0a6e-439f-a123-3d5cf7ba7ba6" status: 404 len: 109 microversion: 2.1 time: 0.149451 Aug 23 07:12:27.201799 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 26/43] 10.222.0.17 () {58 vars in 1245 bytes} [Tue Aug 23 07:12:27 2022] GET /compute/v2.1/os-volumes/433e922a-0a6e-439f-a123-3d5cf7ba7ba6 => generated 109 bytes in 151 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 07:12:27.301665 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-022be7fe-642a-47e4-8433-933f43d3142d tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.908861 Aug 23 07:12:27.302475 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 18/44] 10.222.0.17 () {60 vars in 1159 bytes} [Tue Aug 23 07:12:26 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 911 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 07:12:27.566207 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-13c772ed-98c1-467a-be12-0406964972b7 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Calling method '>' {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:12:27.568510 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.compute.api [None req-13c772ed-98c1-467a-be12-0406964972b7 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] [instance: 703acb74-65e6-4a60-9dd0-bf986498889e] Fetching instance by UUID {{(pid=120798) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:12:27.590132 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-13c772ed-98c1-467a-be12-0406964972b7 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:12:27.593404 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-13c772ed-98c1-467a-be12-0406964972b7 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:12:27.599584 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-13c772ed-98c1-467a-be12-0406964972b7 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:12:27.600584 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-13c772ed-98c1-467a-be12-0406964972b7 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:12:27.609260 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-13c772ed-98c1-467a-be12-0406964972b7 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:12:27.616212 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-13c772ed-98c1-467a-be12-0406964972b7 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:12:27.776619 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-8ae78e66-749c-4566-90d6-f2abe0532fd8 tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] Calling method '>' {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:12:27.777514 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.compute.api [None req-8ae78e66-749c-4566-90d6-f2abe0532fd8 tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] [instance: 9d984b5d-f788-4a4c-8609-471747c44fb8] Fetching instance by UUID {{(pid=120799) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:12:27.794560 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-8ae78e66-749c-4566-90d6-f2abe0532fd8 tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:12:27.797058 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-8ae78e66-749c-4566-90d6-f2abe0532fd8 tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:12:27.797526 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-8ae78e66-749c-4566-90d6-f2abe0532fd8 tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:12:27.801697 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-8ae78e66-749c-4566-90d6-f2abe0532fd8 tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:12:27.802243 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-8ae78e66-749c-4566-90d6-f2abe0532fd8 tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:12:27.802678 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-8ae78e66-749c-4566-90d6-f2abe0532fd8 tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:12:27.825416 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.policy [None req-13c772ed-98c1-467a-be12-0406964972b7 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64d54cb95b264c18b45d90822507fae1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135367be6e3f4b3d965ee0d99fdca524', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120798) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:12:27.840618 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [None req-13c772ed-98c1-467a-be12-0406964972b7 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] 10.222.0.17 "GET /compute/v2.1/servers/703acb74-65e6-4a60-9dd0-bf986498889e" status: 200 len: 1280 microversion: 2.1 time: 0.280819 Aug 23 07:12:27.842624 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 27/45] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:12:27 2022] GET /compute/v2.1/servers/703acb74-65e6-4a60-9dd0-bf986498889e => generated 1280 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:12:28.631469 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.policy [None req-8ae78e66-749c-4566-90d6-f2abe0532fd8 tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cbcc9668f454c0e8c27495a1827d703', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24307daab4d24f979c30e081163c3bfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120799) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:12:28.696459 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-8ae78e66-749c-4566-90d6-f2abe0532fd8 tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] 10.222.0.17 "GET /compute/v2.1/servers/9d984b5d-f788-4a4c-8609-471747c44fb8" status: 200 len: 1267 microversion: 2.1 time: 0.909092 Aug 23 07:12:28.697583 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 19/46] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:12:27 2022] GET /compute/v2.1/servers/9d984b5d-f788-4a4c-8609-471747c44fb8 => generated 1267 bytes in 928 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 07:12:28.869827 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-32bf2818-4f2f-4916-bf60-e8641205a2bd tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Calling method '>' {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:12:28.871284 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.compute.api [None req-32bf2818-4f2f-4916-bf60-e8641205a2bd tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] [instance: 703acb74-65e6-4a60-9dd0-bf986498889e] Fetching instance by UUID {{(pid=120798) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:12:28.910132 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-32bf2818-4f2f-4916-bf60-e8641205a2bd tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:12:28.910727 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-32bf2818-4f2f-4916-bf60-e8641205a2bd tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:12:28.911171 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-32bf2818-4f2f-4916-bf60-e8641205a2bd tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:12:28.912127 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-32bf2818-4f2f-4916-bf60-e8641205a2bd tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:12:28.912578 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-32bf2818-4f2f-4916-bf60-e8641205a2bd tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:12:28.914545 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-32bf2818-4f2f-4916-bf60-e8641205a2bd tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:12:29.149624 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.policy [None req-32bf2818-4f2f-4916-bf60-e8641205a2bd tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64d54cb95b264c18b45d90822507fae1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135367be6e3f4b3d965ee0d99fdca524', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120798) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:12:29.180956 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [None req-32bf2818-4f2f-4916-bf60-e8641205a2bd tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] 10.222.0.17 "GET /compute/v2.1/servers/703acb74-65e6-4a60-9dd0-bf986498889e" status: 200 len: 1280 microversion: 2.1 time: 0.316970 Aug 23 07:12:29.202898 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 28/47] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:12:28 2022] GET /compute/v2.1/servers/703acb74-65e6-4a60-9dd0-bf986498889e => generated 1280 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:12:29.725165 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-0e471f41-97cd-4edb-bd55-989cb4f35785 tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] Calling method '>' {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:12:29.726376 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.compute.api [None req-0e471f41-97cd-4edb-bd55-989cb4f35785 tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] [instance: 9d984b5d-f788-4a4c-8609-471747c44fb8] Fetching instance by UUID {{(pid=120799) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:12:29.738482 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-0e471f41-97cd-4edb-bd55-989cb4f35785 tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:12:29.741305 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-0e471f41-97cd-4edb-bd55-989cb4f35785 tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:12:29.742917 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-0e471f41-97cd-4edb-bd55-989cb4f35785 tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:12:29.746097 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-0e471f41-97cd-4edb-bd55-989cb4f35785 tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:12:29.746747 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-0e471f41-97cd-4edb-bd55-989cb4f35785 tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:12:29.749341 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-0e471f41-97cd-4edb-bd55-989cb4f35785 tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:12:29.962177 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.policy [None req-0e471f41-97cd-4edb-bd55-989cb4f35785 tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cbcc9668f454c0e8c27495a1827d703', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24307daab4d24f979c30e081163c3bfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120799) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:12:29.993247 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-0e471f41-97cd-4edb-bd55-989cb4f35785 tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] 10.222.0.17 "GET /compute/v2.1/servers/9d984b5d-f788-4a4c-8609-471747c44fb8" status: 200 len: 1273 microversion: 2.1 time: 0.271814 Aug 23 07:12:29.996162 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 20/48] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:12:29 2022] GET /compute/v2.1/servers/9d984b5d-f788-4a4c-8609-471747c44fb8 => generated 1273 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:12:30.212740 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-4b673037-7fa2-4ab0-b543-daf78c0282da tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Calling method '>' {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:12:30.214152 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.compute.api [None req-4b673037-7fa2-4ab0-b543-daf78c0282da tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] [instance: 703acb74-65e6-4a60-9dd0-bf986498889e] Fetching instance by UUID {{(pid=120798) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:12:30.232806 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-4b673037-7fa2-4ab0-b543-daf78c0282da tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:12:30.241640 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-4b673037-7fa2-4ab0-b543-daf78c0282da tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:12:30.243658 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-4b673037-7fa2-4ab0-b543-daf78c0282da tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:12:30.248450 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-4b673037-7fa2-4ab0-b543-daf78c0282da tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:12:30.249681 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-4b673037-7fa2-4ab0-b543-daf78c0282da tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:12:30.265257 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-4b673037-7fa2-4ab0-b543-daf78c0282da tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:12:30.569590 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-13f415b2-1789-4971-9fd2-5aa28d932857 tempest-VolumesTestJSON-1193576512 tempest-VolumesTestJSON-1193576512-project] Calling method '.version_select at 0x7fe3c5ba1820>' {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:12:30.678190 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-13f415b2-1789-4971-9fd2-5aa28d932857 tempest-VolumesTestJSON-1193576512 tempest-VolumesTestJSON-1193576512-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/ad3784c8-aa00-4bca-8d05-eaed15116ffd" status: 200 len: 351 microversion: 2.1 time: 0.113542 Aug 23 07:12:30.687820 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 21/49] 10.222.0.17 () {58 vars in 1245 bytes} [Tue Aug 23 07:12:30 2022] GET /compute/v2.1/os-volumes/ad3784c8-aa00-4bca-8d05-eaed15116ffd => generated 351 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 07:12:31.028328 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-06aa5f32-e968-4bd1-9db4-1da24e30a2b9 tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] Calling method '>' {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:12:31.030367 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.compute.api [None req-06aa5f32-e968-4bd1-9db4-1da24e30a2b9 tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] [instance: 9d984b5d-f788-4a4c-8609-471747c44fb8] Fetching instance by UUID {{(pid=120799) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:12:31.047628 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-06aa5f32-e968-4bd1-9db4-1da24e30a2b9 tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:12:31.050508 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-06aa5f32-e968-4bd1-9db4-1da24e30a2b9 tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:12:31.052045 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-06aa5f32-e968-4bd1-9db4-1da24e30a2b9 tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:12:31.056158 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-06aa5f32-e968-4bd1-9db4-1da24e30a2b9 tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:12:31.058206 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-06aa5f32-e968-4bd1-9db4-1da24e30a2b9 tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:12:31.060926 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-06aa5f32-e968-4bd1-9db4-1da24e30a2b9 tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:12:31.099197 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.policy [None req-4b673037-7fa2-4ab0-b543-daf78c0282da tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64d54cb95b264c18b45d90822507fae1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135367be6e3f4b3d965ee0d99fdca524', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120798) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:12:31.117247 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [None req-4b673037-7fa2-4ab0-b543-daf78c0282da tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] 10.222.0.17 "GET /compute/v2.1/servers/703acb74-65e6-4a60-9dd0-bf986498889e" status: 200 len: 1280 microversion: 2.1 time: 0.912938 Aug 23 07:12:31.139491 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 29/50] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:12:30 2022] GET /compute/v2.1/servers/703acb74-65e6-4a60-9dd0-bf986498889e => generated 1280 bytes in 931 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:12:31.966192 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.policy [None req-06aa5f32-e968-4bd1-9db4-1da24e30a2b9 tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cbcc9668f454c0e8c27495a1827d703', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24307daab4d24f979c30e081163c3bfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120799) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:12:31.989082 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-06aa5f32-e968-4bd1-9db4-1da24e30a2b9 tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] 10.222.0.17 "GET /compute/v2.1/servers/9d984b5d-f788-4a4c-8609-471747c44fb8" status: 200 len: 1273 microversion: 2.1 time: 0.970587 Aug 23 07:12:32.005506 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 22/51] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:12:31 2022] GET /compute/v2.1/servers/9d984b5d-f788-4a4c-8609-471747c44fb8 => generated 1273 bytes in 991 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:12:32.142169 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-95b635f9-bf45-4010-a657-63fbcb900e23 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Calling method '>' {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:12:32.142774 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.compute.api [None req-95b635f9-bf45-4010-a657-63fbcb900e23 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] [instance: 703acb74-65e6-4a60-9dd0-bf986498889e] Fetching instance by UUID {{(pid=120798) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:12:32.152672 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-95b635f9-bf45-4010-a657-63fbcb900e23 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:12:32.153270 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-95b635f9-bf45-4010-a657-63fbcb900e23 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:12:32.153593 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-95b635f9-bf45-4010-a657-63fbcb900e23 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:12:32.154850 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-95b635f9-bf45-4010-a657-63fbcb900e23 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:12:32.171195 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-95b635f9-bf45-4010-a657-63fbcb900e23 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:12:32.171778 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-95b635f9-bf45-4010-a657-63fbcb900e23 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:12:32.504681 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.policy [None req-95b635f9-bf45-4010-a657-63fbcb900e23 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64d54cb95b264c18b45d90822507fae1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135367be6e3f4b3d965ee0d99fdca524', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120798) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:12:32.517017 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [None req-95b635f9-bf45-4010-a657-63fbcb900e23 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] 10.222.0.17 "GET /compute/v2.1/servers/703acb74-65e6-4a60-9dd0-bf986498889e" status: 200 len: 1280 microversion: 2.1 time: 0.376351 Aug 23 07:12:32.529694 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 30/52] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:12:32 2022] GET /compute/v2.1/servers/703acb74-65e6-4a60-9dd0-bf986498889e => generated 1280 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:12:32.572877 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-183ba1b0-d7ab-4600-b0d5-c6934e1c0dc6 tempest-VolumesTestJSON-1193576512 tempest-VolumesTestJSON-1193576512-project] Calling method '.version_select at 0x7fe3c5bf7670>' {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:12:32.666639 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-183ba1b0-d7ab-4600-b0d5-c6934e1c0dc6 tempest-VolumesTestJSON-1193576512 tempest-VolumesTestJSON-1193576512-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/5d19b319-096b-4e3b-bff3-17f37a151619" status: 200 len: 351 microversion: 2.1 time: 0.097522 Aug 23 07:12:32.667345 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 23/53] 10.222.0.17 () {58 vars in 1245 bytes} [Tue Aug 23 07:12:32 2022] GET /compute/v2.1/os-volumes/5d19b319-096b-4e3b-bff3-17f37a151619 => generated 351 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 07:12:33.008912 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-ce994bd7-b066-485b-a962-4562c2f088c4 tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] Calling method '>' {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:12:33.009978 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.compute.api [None req-ce994bd7-b066-485b-a962-4562c2f088c4 tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] [instance: 9d984b5d-f788-4a4c-8609-471747c44fb8] Fetching instance by UUID {{(pid=120798) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:12:33.022675 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-ce994bd7-b066-485b-a962-4562c2f088c4 tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:12:33.026180 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-ce994bd7-b066-485b-a962-4562c2f088c4 tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:12:33.026764 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-ce994bd7-b066-485b-a962-4562c2f088c4 tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:12:33.028333 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-ce994bd7-b066-485b-a962-4562c2f088c4 tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:12:33.031897 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-ce994bd7-b066-485b-a962-4562c2f088c4 tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:12:33.033670 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-ce994bd7-b066-485b-a962-4562c2f088c4 tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:12:33.393859 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.policy [None req-ce994bd7-b066-485b-a962-4562c2f088c4 tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cbcc9668f454c0e8c27495a1827d703', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24307daab4d24f979c30e081163c3bfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120798) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:12:33.404188 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [None req-ce994bd7-b066-485b-a962-4562c2f088c4 tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] 10.222.0.17 "GET /compute/v2.1/servers/9d984b5d-f788-4a4c-8609-471747c44fb8" status: 200 len: 1273 microversion: 2.1 time: 0.399656 Aug 23 07:12:33.410917 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 31/54] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:12:33 2022] GET /compute/v2.1/servers/9d984b5d-f788-4a4c-8609-471747c44fb8 => generated 1273 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:12:33.550357 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-c9c0d2ce-7f14-44ca-b372-d7d18fcb477b tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Calling method '>' {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:12:33.551613 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.compute.api [None req-c9c0d2ce-7f14-44ca-b372-d7d18fcb477b tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] [instance: 703acb74-65e6-4a60-9dd0-bf986498889e] Fetching instance by UUID {{(pid=120799) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:12:33.565248 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-c9c0d2ce-7f14-44ca-b372-d7d18fcb477b tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:12:33.565747 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-c9c0d2ce-7f14-44ca-b372-d7d18fcb477b tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:12:33.566180 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-c9c0d2ce-7f14-44ca-b372-d7d18fcb477b tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:12:33.567312 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-c9c0d2ce-7f14-44ca-b372-d7d18fcb477b tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:12:33.572791 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-c9c0d2ce-7f14-44ca-b372-d7d18fcb477b tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:12:33.576656 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-c9c0d2ce-7f14-44ca-b372-d7d18fcb477b tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:12:33.845609 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.policy [None req-c9c0d2ce-7f14-44ca-b372-d7d18fcb477b tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64d54cb95b264c18b45d90822507fae1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135367be6e3f4b3d965ee0d99fdca524', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120799) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:12:33.859174 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-c9c0d2ce-7f14-44ca-b372-d7d18fcb477b tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] 10.222.0.17 "GET /compute/v2.1/servers/703acb74-65e6-4a60-9dd0-bf986498889e" status: 200 len: 1280 microversion: 2.1 time: 0.309683 Aug 23 07:12:33.873084 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 24/55] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:12:33 2022] GET /compute/v2.1/servers/703acb74-65e6-4a60-9dd0-bf986498889e => generated 1280 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:12:34.428673 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-606fa9fa-1de4-4f83-beeb-6d4b345bb202 tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] Calling method '>' {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:12:34.430218 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.compute.api [None req-606fa9fa-1de4-4f83-beeb-6d4b345bb202 tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] [instance: 9d984b5d-f788-4a4c-8609-471747c44fb8] Fetching instance by UUID {{(pid=120798) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:12:34.433798 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG dbcounter [-] [120798] Writing DB stats nova_cell0:SELECT=2 {{(pid=120798) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:12:34.455585 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-606fa9fa-1de4-4f83-beeb-6d4b345bb202 tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:12:34.462869 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-606fa9fa-1de4-4f83-beeb-6d4b345bb202 tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:12:34.463709 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-606fa9fa-1de4-4f83-beeb-6d4b345bb202 tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:12:34.468600 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-606fa9fa-1de4-4f83-beeb-6d4b345bb202 tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:12:34.474191 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-606fa9fa-1de4-4f83-beeb-6d4b345bb202 tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:12:34.474831 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-606fa9fa-1de4-4f83-beeb-6d4b345bb202 tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:12:34.712853 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-383a7ef5-3bd7-4093-8d5f-9f5a591d41c3 tempest-VolumesTestJSON-1193576512 tempest-VolumesTestJSON-1193576512-project] Calling method '.version_select at 0x7fe3c5ba1c10>' {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:12:34.828486 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-383a7ef5-3bd7-4093-8d5f-9f5a591d41c3 tempest-VolumesTestJSON-1193576512 tempest-VolumesTestJSON-1193576512-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/78108c5e-5db9-40d4-b1a1-8a5c4cd573ff" status: 200 len: 351 microversion: 2.1 time: 0.131686 Aug 23 07:12:34.832339 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 25/56] 10.222.0.17 () {58 vars in 1245 bytes} [Tue Aug 23 07:12:34 2022] GET /compute/v2.1/os-volumes/78108c5e-5db9-40d4-b1a1-8a5c4cd573ff => generated 351 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 07:12:34.844367 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.policy [None req-606fa9fa-1de4-4f83-beeb-6d4b345bb202 tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cbcc9668f454c0e8c27495a1827d703', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24307daab4d24f979c30e081163c3bfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120798) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:12:34.847769 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-62714639-f60a-47af-ba10-c0aa2af66338 tempest-VolumesTestJSON-1193576512 tempest-VolumesTestJSON-1193576512-project] Calling method '.version_select at 0x7fe3c5becaf0>' {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:12:34.855853 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [None req-606fa9fa-1de4-4f83-beeb-6d4b345bb202 tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] 10.222.0.17 "GET /compute/v2.1/servers/9d984b5d-f788-4a4c-8609-471747c44fb8" status: 200 len: 1273 microversion: 2.1 time: 0.431537 Aug 23 07:12:34.858359 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 32/57] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:12:34 2022] GET /compute/v2.1/servers/9d984b5d-f788-4a4c-8609-471747c44fb8 => generated 1273 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:12:34.888287 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-ca0a36c6-36cb-44dd-b13c-acec90ee4abb tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Calling method '>' {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:12:34.892274 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.compute.api [None req-ca0a36c6-36cb-44dd-b13c-acec90ee4abb tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] [instance: 703acb74-65e6-4a60-9dd0-bf986498889e] Fetching instance by UUID {{(pid=120798) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:12:34.916461 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-ca0a36c6-36cb-44dd-b13c-acec90ee4abb tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:12:34.916967 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-ca0a36c6-36cb-44dd-b13c-acec90ee4abb tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:12:34.917404 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-ca0a36c6-36cb-44dd-b13c-acec90ee4abb tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:12:34.918113 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-ca0a36c6-36cb-44dd-b13c-acec90ee4abb tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:12:34.918568 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-ca0a36c6-36cb-44dd-b13c-acec90ee4abb tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:12:34.918988 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-ca0a36c6-36cb-44dd-b13c-acec90ee4abb tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:12:35.090297 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-62714639-f60a-47af-ba10-c0aa2af66338 tempest-VolumesTestJSON-1193576512 tempest-VolumesTestJSON-1193576512-project] 10.222.0.17 "GET /compute/v2.1/os-volumes" status: 200 len: 1036 microversion: 2.1 time: 0.249665 Aug 23 07:12:35.091182 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 26/58] 10.222.0.17 () {58 vars in 1134 bytes} [Tue Aug 23 07:12:34 2022] GET /compute/v2.1/os-volumes => generated 1036 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:12:35.105102 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-058fa67b-8c90-4f2c-90e6-f1cdbb11ca0c tempest-VolumesTestJSON-1193576512 tempest-VolumesTestJSON-1193576512-project] Calling method '.version_select at 0x7fe3c5bc6160>' {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:12:35.212727 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG dbcounter [-] [120799] Writing DB stats nova_cell0:SELECT=4 {{(pid=120799) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:12:35.404931 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-058fa67b-8c90-4f2c-90e6-f1cdbb11ca0c tempest-VolumesTestJSON-1193576512 tempest-VolumesTestJSON-1193576512-project] 10.222.0.17 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.304161 Aug 23 07:12:35.406512 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 27/59] 10.222.0.17 () {58 vars in 1149 bytes} [Tue Aug 23 07:12:35 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 695 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 07:12:35.421175 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-9d1d8ac8-7c36-495e-b293-f983fcb4cfa7 tempest-VolumesTestJSON-1193576512 tempest-VolumesTestJSON-1193576512-project] Calling method '.version_select at 0x7fe3c64775e0>' {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:12:35.444342 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG dbcounter [-] [120798] Writing DB stats nova_cell0:SELECT=10 {{(pid=120798) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:12:35.728266 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-9d1d8ac8-7c36-495e-b293-f983fcb4cfa7 tempest-VolumesTestJSON-1193576512 tempest-VolumesTestJSON-1193576512-project] 10.222.0.17 "GET /compute/v2.1/os-volumes" status: 200 len: 1036 microversion: 2.1 time: 0.311142 Aug 23 07:12:35.729038 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 28/60] 10.222.0.17 () {58 vars in 1134 bytes} [Tue Aug 23 07:12:35 2022] GET /compute/v2.1/os-volumes => generated 1036 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:12:35.742310 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-60d91b64-538d-4e92-b45f-23c94c3c1fab tempest-VolumesTestJSON-1193576512 tempest-VolumesTestJSON-1193576512-project] Calling method '.version_select at 0x7fe3c5ba1ee0>' {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:12:36.123348 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-60d91b64-538d-4e92-b45f-23c94c3c1fab tempest-VolumesTestJSON-1193576512 tempest-VolumesTestJSON-1193576512-project] 10.222.0.17 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.385592 Aug 23 07:12:36.124488 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 29/61] 10.222.0.17 () {58 vars in 1167 bytes} [Tue Aug 23 07:12:35 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 07:12:36.131229 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-020d6995-a2f0-49cb-aa41-0cd2fc7f997a tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] Calling method '>' {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:12:36.131990 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.compute.api [None req-020d6995-a2f0-49cb-aa41-0cd2fc7f997a tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] [instance: 9d984b5d-f788-4a4c-8609-471747c44fb8] Fetching instance by UUID {{(pid=120799) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:12:36.159139 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-020d6995-a2f0-49cb-aa41-0cd2fc7f997a tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:12:36.161950 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-020d6995-a2f0-49cb-aa41-0cd2fc7f997a tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:12:36.162678 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-020d6995-a2f0-49cb-aa41-0cd2fc7f997a tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:12:36.163807 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-020d6995-a2f0-49cb-aa41-0cd2fc7f997a tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:12:36.164527 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-020d6995-a2f0-49cb-aa41-0cd2fc7f997a tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:12:36.166826 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-020d6995-a2f0-49cb-aa41-0cd2fc7f997a tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:12:36.249315 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.policy [None req-ca0a36c6-36cb-44dd-b13c-acec90ee4abb tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64d54cb95b264c18b45d90822507fae1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135367be6e3f4b3d965ee0d99fdca524', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120798) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:12:36.257149 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [None req-ca0a36c6-36cb-44dd-b13c-acec90ee4abb tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] 10.222.0.17 "GET /compute/v2.1/servers/703acb74-65e6-4a60-9dd0-bf986498889e" status: 200 len: 1322 microversion: 2.1 time: 1.376564 Aug 23 07:12:36.257721 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 33/62] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:12:34 2022] GET /compute/v2.1/servers/703acb74-65e6-4a60-9dd0-bf986498889e => generated 1322 bytes in 1379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:12:36.268294 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-2c0b021d-63eb-43e9-8b14-9396cea47dc8 tempest-VolumesTestJSON-1193576512 tempest-VolumesTestJSON-1193576512-project] Calling method '.version_select at 0x7fe3c64050d0>' {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:12:36.636377 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [None req-2c0b021d-63eb-43e9-8b14-9396cea47dc8 tempest-VolumesTestJSON-1193576512 tempest-VolumesTestJSON-1193576512-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.375324 Aug 23 07:12:36.637711 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 34/63] 10.222.0.17 () {58 vars in 1170 bytes} [Tue Aug 23 07:12:36 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 695 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 07:12:36.653581 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-cfb9f2e8-1c3c-4d43-b2f7-48453e6f55e0 tempest-VolumesTestJSON-1193576512 tempest-VolumesTestJSON-1193576512-project] Calling method '.version_select at 0x7fe3c6431940>' {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:12:37.079316 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [None req-cfb9f2e8-1c3c-4d43-b2f7-48453e6f55e0 tempest-VolumesTestJSON-1193576512 tempest-VolumesTestJSON-1193576512-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1036 microversion: 2.1 time: 0.432160 Aug 23 07:12:37.080180 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 35/64] 10.222.0.17 () {58 vars in 1155 bytes} [Tue Aug 23 07:12:36 2022] GET /compute/v2.1/os-volumes/detail => generated 1036 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:12:37.094335 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-709b7ee3-cb2d-4fd7-880c-9e3a0a755f61 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-427071871", "imageRef": "b899fd65-02ae-4b43-bac7-86f38fc3f224", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "5ee97029-6237-4f87-a16d-878d9597a1a6"}], "security_groups": [{"name": "tempest-securitygroup--334544297"}], "key_name": "tempest-keypair-479729521", "user_data": "}} {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 07:12:37.204378 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG dbcounter [-] [120799] Writing DB stats nova_cell0:SELECT=18 {{(pid=120799) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:12:38.138020 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.policy [None req-020d6995-a2f0-49cb-aa41-0cd2fc7f997a tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cbcc9668f454c0e8c27495a1827d703', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24307daab4d24f979c30e081163c3bfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120799) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:12:38.146552 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-020d6995-a2f0-49cb-aa41-0cd2fc7f997a tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] 10.222.0.17 "GET /compute/v2.1/servers/9d984b5d-f788-4a4c-8609-471747c44fb8" status: 200 len: 1315 microversion: 2.1 time: 2.020912 Aug 23 07:12:38.160679 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 30/65] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:12:36 2022] GET /compute/v2.1/servers/9d984b5d-f788-4a4c-8609-471747c44fb8 => generated 1315 bytes in 2025 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:12:38.166593 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-3d00f35d-f039-460b-9396-667d071de7c9 tempest-VolumesTestJSON-1193576512 tempest-VolumesTestJSON-1193576512-project] Calling method '.version_select at 0x7fe3c5ba1af0>' {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:12:38.377639 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.network.neutron [None req-709b7ee3-cb2d-4fd7-880c-9e3a0a755f61 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] validate_networks() for [('5ee97029-6237-4f87-a16d-878d9597a1a6', None, None, None, None, None)] {{(pid=120798) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 23 07:12:38.640093 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-3d00f35d-f039-460b-9396-667d071de7c9 tempest-VolumesTestJSON-1193576512 tempest-VolumesTestJSON-1193576512-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.487840 Aug 23 07:12:38.649280 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 31/66] 10.222.0.17 () {58 vars in 1188 bytes} [Tue Aug 23 07:12:38 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 07:12:38.658240 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-ad96d724-f49c-44f8-bcd1-8503d9d4204a tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Calling method '>' {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:12:38.659397 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.compute.api [None req-ad96d724-f49c-44f8-bcd1-8503d9d4204a tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] [instance: 703acb74-65e6-4a60-9dd0-bf986498889e] Fetching instance by UUID {{(pid=120799) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:12:38.683604 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-ad96d724-f49c-44f8-bcd1-8503d9d4204a tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:12:38.684350 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-ad96d724-f49c-44f8-bcd1-8503d9d4204a tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:12:38.685668 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-ad96d724-f49c-44f8-bcd1-8503d9d4204a tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:12:38.686549 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-ad96d724-f49c-44f8-bcd1-8503d9d4204a tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:12:38.692514 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-ad96d724-f49c-44f8-bcd1-8503d9d4204a tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:12:38.693664 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-ad96d724-f49c-44f8-bcd1-8503d9d4204a tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:12:39.502199 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.policy [None req-ad96d724-f49c-44f8-bcd1-8503d9d4204a tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64d54cb95b264c18b45d90822507fae1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135367be6e3f4b3d965ee0d99fdca524', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120799) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:12:39.511090 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-ad96d724-f49c-44f8-bcd1-8503d9d4204a tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] 10.222.0.17 "GET /compute/v2.1/servers/703acb74-65e6-4a60-9dd0-bf986498889e" status: 200 len: 1322 microversion: 2.1 time: 0.860322 Aug 23 07:12:39.520126 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 32/67] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:12:38 2022] GET /compute/v2.1/servers/703acb74-65e6-4a60-9dd0-bf986498889e => generated 1322 bytes in 870 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:12:40.068600 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [req-f15b2d80-85fb-4fc6-9626-9fff4051216c req-ae40b327-3770-497a-83d0-376e38ec601d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6915ed26-7e2f-41b9-aada-adcb2c2015d3", "tag": "b8077cfc-5527-4264-938d-c6318acc4e35"}]} {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 07:12:40.102601 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [req-f15b2d80-85fb-4fc6-9626-9fff4051216c req-ae40b327-3770-497a-83d0-376e38ec601d service nova] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:12:40.103659 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [req-f15b2d80-85fb-4fc6-9626-9fff4051216c req-ae40b327-3770-497a-83d0-376e38ec601d service nova] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:12:40.104261 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [req-f15b2d80-85fb-4fc6-9626-9fff4051216c req-ae40b327-3770-497a-83d0-376e38ec601d service nova] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:12:40.256031 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.compute.server_external_events [req-f15b2d80-85fb-4fc6-9626-9fff4051216c req-ae40b327-3770-497a-83d0-376e38ec601d service nova] Creating event network-changed:b8077cfc-5527-4264-938d-c6318acc4e35 for instance 6915ed26-7e2f-41b9-aada-adcb2c2015d3 on hv-cinder-85409 Aug 23 07:12:40.256581 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [req-f15b2d80-85fb-4fc6-9626-9fff4051216c req-ae40b327-3770-497a-83d0-376e38ec601d service nova] Acquiring lock "compute-rpcapi-router" {{(pid=120799) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 23 07:12:40.256962 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [req-f15b2d80-85fb-4fc6-9626-9fff4051216c req-ae40b327-3770-497a-83d0-376e38ec601d service nova] Acquired lock "compute-rpcapi-router" {{(pid=120799) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 23 07:12:40.258055 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-2cec03da-c92d-4b90-9d46-2aac1a1baf29 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:12:40.258544 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-2cec03da-c92d-4b90-9d46-2aac1a1baf29 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:12:40.258980 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-2cec03da-c92d-4b90-9d46-2aac1a1baf29 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:12:40.284882 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-2cec03da-c92d-4b90-9d46-2aac1a1baf29 None None] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:12:40.285659 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-2cec03da-c92d-4b90-9d46-2aac1a1baf29 None None] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.026s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:12:40.287466 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-2cec03da-c92d-4b90-9d46-2aac1a1baf29 None None] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:12:40.340304 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.compute.rpcapi [None req-2cec03da-c92d-4b90-9d46-2aac1a1baf29 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Aug 23 07:12:40.350726 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-2cec03da-c92d-4b90-9d46-2aac1a1baf29 None None] Releasing lock "compute-rpcapi-router" {{(pid=120799) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 23 07:12:40.397063 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-2cec03da-c92d-4b90-9d46-2aac1a1baf29 None None] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.875391 Aug 23 07:12:40.397799 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 33/68] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Aug 23 07:12:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 877 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 07:12:40.404577 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-9ff6723c-436b-411b-aa7c-b005ec91fd6c tempest-VolumesTestJSON-1193576512 tempest-VolumesTestJSON-1193576512-project] Calling method '.version_select at 0x7fe3c6477670>' {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:12:40.632897 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.virt.hardware [None req-709b7ee3-cb2d-4fd7-880c-9e3a0a755f61 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Flavor limits 0:0:0 {{(pid=120798) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 07:12:40.633431 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.virt.hardware [None req-709b7ee3-cb2d-4fd7-880c-9e3a0a755f61 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Image limits 0:0:0 {{(pid=120798) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 07:12:40.633808 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.virt.hardware [None req-709b7ee3-cb2d-4fd7-880c-9e3a0a755f61 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Flavor pref 0:0:0 {{(pid=120798) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 07:12:40.634317 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.virt.hardware [None req-709b7ee3-cb2d-4fd7-880c-9e3a0a755f61 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Image pref 0:0:0 {{(pid=120798) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 07:12:40.634877 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.virt.hardware [None req-709b7ee3-cb2d-4fd7-880c-9e3a0a755f61 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120798) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 07:12:40.652035 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-709b7ee3-cb2d-4fd7-880c-9e3a0a755f61 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:12:40.652532 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-709b7ee3-cb2d-4fd7-880c-9e3a0a755f61 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:12:40.652989 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-709b7ee3-cb2d-4fd7-880c-9e3a0a755f61 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:12:40.653678 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-709b7ee3-cb2d-4fd7-880c-9e3a0a755f61 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:12:40.654138 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-709b7ee3-cb2d-4fd7-880c-9e3a0a755f61 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:12:40.654544 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-709b7ee3-cb2d-4fd7-880c-9e3a0a755f61 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:12:40.665513 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-9ff6723c-436b-411b-aa7c-b005ec91fd6c tempest-VolumesTestJSON-1193576512 tempest-VolumesTestJSON-1193576512-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1036 microversion: 2.1 time: 0.265996 Aug 23 07:12:40.666860 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 34/69] 10.222.0.17 () {58 vars in 1155 bytes} [Tue Aug 23 07:12:40 2022] GET /compute/v2.1/os-volumes/detail => generated 1036 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:12:40.680497 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.quota [None req-709b7ee3-cb2d-4fd7-880c-9e3a0a755f61 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Getting quotas for project eb44f62fa62e46528712f24479cbb19f. Resources: {'ram', 'instances', 'cores'} {{(pid=120798) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 07:12:40.696725 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.quota [None req-709b7ee3-cb2d-4fd7-880c-9e3a0a755f61 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Getting quotas for user 471dc5c1db64411ab1d80ad6c038e519 and project eb44f62fa62e46528712f24479cbb19f. Resources: {'ram', 'instances', 'cores'} {{(pid=120798) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 07:12:40.700420 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-c38b9b13-1ce6-4048-a832-57dd5b4ea25d tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] Calling method '>' {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:12:40.701473 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.compute.api [None req-c38b9b13-1ce6-4048-a832-57dd5b4ea25d tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] [instance: 9d984b5d-f788-4a4c-8609-471747c44fb8] Fetching instance by UUID {{(pid=120799) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:12:40.714993 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-c38b9b13-1ce6-4048-a832-57dd5b4ea25d tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:12:40.716072 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-c38b9b13-1ce6-4048-a832-57dd5b4ea25d tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:12:40.716702 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-c38b9b13-1ce6-4048-a832-57dd5b4ea25d tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:12:40.717921 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-c38b9b13-1ce6-4048-a832-57dd5b4ea25d tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:12:40.718622 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-c38b9b13-1ce6-4048-a832-57dd5b4ea25d tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:12:40.719540 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-c38b9b13-1ce6-4048-a832-57dd5b4ea25d tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:12:40.742362 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.compute.api [None req-709b7ee3-cb2d-4fd7-880c-9e3a0a755f61 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Going to run 1 instances... {{(pid=120798) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 23 07:12:40.744970 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.compute.api [None req-709b7ee3-cb2d-4fd7-880c-9e3a0a755f61 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] [instance: 057628ba-a74f-426e-ba25-a3b79c3b6339] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b899fd65-02ae-4b43-bac7-86f38fc3f224',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120798) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 07:12:40.841473 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [None req-709b7ee3-cb2d-4fd7-880c-9e3a0a755f61 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 3.751836 Aug 23 07:12:40.842125 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 36/70] 10.222.0.17 () {60 vars in 1147 bytes} [Tue Aug 23 07:12:37 2022] POST /compute/v2.1/servers => generated 401 bytes in 3753 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 23 07:12:41.069377 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.policy [None req-c38b9b13-1ce6-4048-a832-57dd5b4ea25d tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cbcc9668f454c0e8c27495a1827d703', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24307daab4d24f979c30e081163c3bfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120799) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:12:41.080054 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-c38b9b13-1ce6-4048-a832-57dd5b4ea25d tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] 10.222.0.17 "GET /compute/v2.1/servers/9d984b5d-f788-4a4c-8609-471747c44fb8" status: 200 len: 1315 microversion: 2.1 time: 0.391252 Aug 23 07:12:41.093463 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 35/71] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:12:40 2022] GET /compute/v2.1/servers/9d984b5d-f788-4a4c-8609-471747c44fb8 => generated 1315 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:12:41.093463 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-7d76add3-203e-4427-a785-f239f01df546 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Calling method '>' {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:12:41.093463 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.compute.api [None req-7d76add3-203e-4427-a785-f239f01df546 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] [instance: 703acb74-65e6-4a60-9dd0-bf986498889e] Fetching instance by UUID {{(pid=120799) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:12:41.097378 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-7d76add3-203e-4427-a785-f239f01df546 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:12:41.097954 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-7d76add3-203e-4427-a785-f239f01df546 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:12:41.099156 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-7d76add3-203e-4427-a785-f239f01df546 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:12:41.100045 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-7d76add3-203e-4427-a785-f239f01df546 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:12:41.100958 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-7d76add3-203e-4427-a785-f239f01df546 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:12:41.101389 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-7d76add3-203e-4427-a785-f239f01df546 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:12:41.191949 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [req-28a28cb4-3211-4a32-9e4c-130d65c3f5b5 req-5f10ee04-8d00-4bca-9d36-07b2c08bd828 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "703acb74-65e6-4a60-9dd0-bf986498889e", "tag": "713d5b4f-c65f-4843-862f-a75e5cbe6db4"}]} {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 07:12:41.207992 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [req-28a28cb4-3211-4a32-9e4c-130d65c3f5b5 req-5f10ee04-8d00-4bca-9d36-07b2c08bd828 service nova] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:12:41.208457 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [req-28a28cb4-3211-4a32-9e4c-130d65c3f5b5 req-5f10ee04-8d00-4bca-9d36-07b2c08bd828 service nova] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:12:41.209054 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [req-28a28cb4-3211-4a32-9e4c-130d65c3f5b5 req-5f10ee04-8d00-4bca-9d36-07b2c08bd828 service nova] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:12:41.234598 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.compute.server_external_events [req-28a28cb4-3211-4a32-9e4c-130d65c3f5b5 req-5f10ee04-8d00-4bca-9d36-07b2c08bd828 service nova] Creating event network-changed:713d5b4f-c65f-4843-862f-a75e5cbe6db4 for instance 703acb74-65e6-4a60-9dd0-bf986498889e on hv-cinder-85409 Aug 23 07:12:41.235117 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [req-28a28cb4-3211-4a32-9e4c-130d65c3f5b5 req-5f10ee04-8d00-4bca-9d36-07b2c08bd828 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=120798) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 23 07:12:41.235584 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [req-28a28cb4-3211-4a32-9e4c-130d65c3f5b5 req-5f10ee04-8d00-4bca-9d36-07b2c08bd828 service nova] Acquired lock "compute-rpcapi-router" {{(pid=120798) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 23 07:12:41.236718 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-d9230793-0e7a-48ac-a8a4-eeb68c15976b None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:12:41.237264 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-d9230793-0e7a-48ac-a8a4-eeb68c15976b None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:12:41.237684 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-d9230793-0e7a-48ac-a8a4-eeb68c15976b None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:12:41.238363 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-d9230793-0e7a-48ac-a8a4-eeb68c15976b None None] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:12:41.238967 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-d9230793-0e7a-48ac-a8a4-eeb68c15976b None None] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:12:41.239554 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-d9230793-0e7a-48ac-a8a4-eeb68c15976b None None] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:12:41.250472 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.compute.rpcapi [None req-d9230793-0e7a-48ac-a8a4-eeb68c15976b None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Aug 23 07:12:41.252504 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-d9230793-0e7a-48ac-a8a4-eeb68c15976b None None] Releasing lock "compute-rpcapi-router" {{(pid=120798) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 23 07:12:41.256221 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.policy [None req-7d76add3-203e-4427-a785-f239f01df546 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64d54cb95b264c18b45d90822507fae1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135367be6e3f4b3d965ee0d99fdca524', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120799) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:12:41.262942 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG dbcounter [-] [120799] Writing DB stats nova_cell1:SELECT=55 {{(pid=120799) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:12:41.265265 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-7d76add3-203e-4427-a785-f239f01df546 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] 10.222.0.17 "GET /compute/v2.1/servers/703acb74-65e6-4a60-9dd0-bf986498889e" status: 200 len: 1322 microversion: 2.1 time: 0.181998 Aug 23 07:12:41.266407 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 36/72] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:12:41 2022] GET /compute/v2.1/servers/703acb74-65e6-4a60-9dd0-bf986498889e => generated 1322 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:12:41.271955 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-89ae7aa0-abed-4bc5-b2b3-02fbe54a3b47 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Calling method '>' {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:12:41.272755 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.compute.api [None req-89ae7aa0-abed-4bc5-b2b3-02fbe54a3b47 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] [instance: 057628ba-a74f-426e-ba25-a3b79c3b6339] Fetching instance by UUID {{(pid=120799) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:12:41.274718 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG dbcounter [-] [120799] Writing DB stats nova_api:SELECT=60,nova_api:INSERT=7 {{(pid=120799) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:12:41.286427 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [None req-d9230793-0e7a-48ac-a8a4-eeb68c15976b None None] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.438947 Aug 23 07:12:41.287897 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 37/73] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Aug 23 07:12:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 07:12:41.343292 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.policy [None req-89ae7aa0-abed-4bc5-b2b3-02fbe54a3b47 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '471dc5c1db64411ab1d80ad6c038e519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb44f62fa62e46528712f24479cbb19f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120799) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:12:41.354608 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-89ae7aa0-abed-4bc5-b2b3-02fbe54a3b47 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] 10.222.0.17 "GET /compute/v2.1/servers/057628ba-a74f-426e-ba25-a3b79c3b6339" status: 200 len: 1240 microversion: 2.1 time: 0.083870 Aug 23 07:12:41.354736 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 37/74] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:12:41 2022] GET /compute/v2.1/servers/057628ba-a74f-426e-ba25-a3b79c3b6339 => generated 1240 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:12:42.107567 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-ddd757a9-0c9a-49a3-994f-318b2d8601bc tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] Calling method '>' {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:12:42.108666 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.compute.api [None req-ddd757a9-0c9a-49a3-994f-318b2d8601bc tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] [instance: 9d984b5d-f788-4a4c-8609-471747c44fb8] Fetching instance by UUID {{(pid=120798) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:12:42.123946 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-ddd757a9-0c9a-49a3-994f-318b2d8601bc tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:12:42.125036 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-ddd757a9-0c9a-49a3-994f-318b2d8601bc tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:12:42.126026 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-ddd757a9-0c9a-49a3-994f-318b2d8601bc tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:12:42.126810 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-ddd757a9-0c9a-49a3-994f-318b2d8601bc tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:12:42.127850 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-ddd757a9-0c9a-49a3-994f-318b2d8601bc tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:12:42.128425 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-ddd757a9-0c9a-49a3-994f-318b2d8601bc tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:12:42.290405 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.policy [None req-ddd757a9-0c9a-49a3-994f-318b2d8601bc tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cbcc9668f454c0e8c27495a1827d703', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24307daab4d24f979c30e081163c3bfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120798) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:12:42.294348 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-33db0418-410f-44e5-adc8-74fd72d5640e tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Calling method '>' {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:12:42.294884 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.compute.api [None req-33db0418-410f-44e5-adc8-74fd72d5640e tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] [instance: 703acb74-65e6-4a60-9dd0-bf986498889e] Fetching instance by UUID {{(pid=120799) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:12:42.304981 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [None req-ddd757a9-0c9a-49a3-994f-318b2d8601bc tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] 10.222.0.17 "GET /compute/v2.1/servers/9d984b5d-f788-4a4c-8609-471747c44fb8" status: 200 len: 1315 microversion: 2.1 time: 0.202481 Aug 23 07:12:42.305565 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 38/75] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:12:42 2022] GET /compute/v2.1/servers/9d984b5d-f788-4a4c-8609-471747c44fb8 => generated 1315 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:12:42.309455 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-33db0418-410f-44e5-adc8-74fd72d5640e tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:12:42.310111 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-33db0418-410f-44e5-adc8-74fd72d5640e tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:12:42.310853 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-33db0418-410f-44e5-adc8-74fd72d5640e tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:12:42.311735 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-33db0418-410f-44e5-adc8-74fd72d5640e tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:12:42.312865 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-33db0418-410f-44e5-adc8-74fd72d5640e tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:12:42.313614 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-33db0418-410f-44e5-adc8-74fd72d5640e tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:12:42.377155 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-c995694c-a0dc-406d-b7e3-c86a3bf7bf7f tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Calling method '>' {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:12:42.378193 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.compute.api [None req-c995694c-a0dc-406d-b7e3-c86a3bf7bf7f tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] [instance: 057628ba-a74f-426e-ba25-a3b79c3b6339] Fetching instance by UUID {{(pid=120798) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:12:42.388667 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-c995694c-a0dc-406d-b7e3-c86a3bf7bf7f tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:12:42.389154 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-c995694c-a0dc-406d-b7e3-c86a3bf7bf7f tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:12:42.389577 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-c995694c-a0dc-406d-b7e3-c86a3bf7bf7f tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:12:42.390453 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-c995694c-a0dc-406d-b7e3-c86a3bf7bf7f tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:12:42.390901 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-c995694c-a0dc-406d-b7e3-c86a3bf7bf7f tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:12:42.391319 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-c995694c-a0dc-406d-b7e3-c86a3bf7bf7f tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:12:42.599859 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.policy [None req-c995694c-a0dc-406d-b7e3-c86a3bf7bf7f tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '471dc5c1db64411ab1d80ad6c038e519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb44f62fa62e46528712f24479cbb19f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120798) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:12:42.610583 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [None req-c995694c-a0dc-406d-b7e3-c86a3bf7bf7f tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] 10.222.0.17 "GET /compute/v2.1/servers/057628ba-a74f-426e-ba25-a3b79c3b6339" status: 200 len: 1244 microversion: 2.1 time: 0.238555 Aug 23 07:12:42.623160 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 39/76] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:12:42 2022] GET /compute/v2.1/servers/057628ba-a74f-426e-ba25-a3b79c3b6339 => generated 1244 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:12:42.665064 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.policy [None req-33db0418-410f-44e5-adc8-74fd72d5640e tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64d54cb95b264c18b45d90822507fae1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135367be6e3f4b3d965ee0d99fdca524', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120799) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:12:42.673903 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-33db0418-410f-44e5-adc8-74fd72d5640e tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] 10.222.0.17 "GET /compute/v2.1/servers/703acb74-65e6-4a60-9dd0-bf986498889e" status: 200 len: 1322 microversion: 2.1 time: 0.390881 Aug 23 07:12:42.684213 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 38/77] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:12:42 2022] GET /compute/v2.1/servers/703acb74-65e6-4a60-9dd0-bf986498889e => generated 1322 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:12:43.305064 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [req-6874d544-60e4-41eb-8611-d1c6576e8e34 req-9efa6f25-ca1f-41c0-bbce-e08dfcf59e6d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9d984b5d-f788-4a4c-8609-471747c44fb8", "tag": "4994a4df-b092-4dfd-afa6-ad9a86dd2c2b"}]} {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 07:12:43.320655 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [req-6874d544-60e4-41eb-8611-d1c6576e8e34 req-9efa6f25-ca1f-41c0-bbce-e08dfcf59e6d service nova] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:12:43.323041 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [req-6874d544-60e4-41eb-8611-d1c6576e8e34 req-9efa6f25-ca1f-41c0-bbce-e08dfcf59e6d service nova] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:12:43.324000 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [req-6874d544-60e4-41eb-8611-d1c6576e8e34 req-9efa6f25-ca1f-41c0-bbce-e08dfcf59e6d service nova] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:12:43.328790 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-04e27a79-f76a-4e4a-93f3-05d9fffd3adb tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] Calling method '>' {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:12:43.328790 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.compute.api [None req-04e27a79-f76a-4e4a-93f3-05d9fffd3adb tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] [instance: 9d984b5d-f788-4a4c-8609-471747c44fb8] Fetching instance by UUID {{(pid=120799) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:12:43.334769 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-04e27a79-f76a-4e4a-93f3-05d9fffd3adb tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:12:43.335254 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-04e27a79-f76a-4e4a-93f3-05d9fffd3adb tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:12:43.340257 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.compute.server_external_events [req-6874d544-60e4-41eb-8611-d1c6576e8e34 req-9efa6f25-ca1f-41c0-bbce-e08dfcf59e6d service nova] Creating event network-changed:4994a4df-b092-4dfd-afa6-ad9a86dd2c2b for instance 9d984b5d-f788-4a4c-8609-471747c44fb8 on hv-cinder-85409 Aug 23 07:12:43.341938 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-04e27a79-f76a-4e4a-93f3-05d9fffd3adb tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:12:43.342915 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-04e27a79-f76a-4e4a-93f3-05d9fffd3adb tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:12:43.343454 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-04e27a79-f76a-4e4a-93f3-05d9fffd3adb tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:12:43.344234 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-04e27a79-f76a-4e4a-93f3-05d9fffd3adb tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:12:43.347058 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [req-6874d544-60e4-41eb-8611-d1c6576e8e34 req-9efa6f25-ca1f-41c0-bbce-e08dfcf59e6d service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046420 Aug 23 07:12:43.348629 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 40/78] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Aug 23 07:12:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 07:12:43.570319 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.policy [None req-04e27a79-f76a-4e4a-93f3-05d9fffd3adb tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cbcc9668f454c0e8c27495a1827d703', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24307daab4d24f979c30e081163c3bfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120799) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:12:43.583350 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-04e27a79-f76a-4e4a-93f3-05d9fffd3adb tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] 10.222.0.17 "GET /compute/v2.1/servers/9d984b5d-f788-4a4c-8609-471747c44fb8" status: 200 len: 1315 microversion: 2.1 time: 0.260603 Aug 23 07:12:43.598639 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 39/79] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:12:43 2022] GET /compute/v2.1/servers/9d984b5d-f788-4a4c-8609-471747c44fb8 => generated 1315 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:12:43.643471 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-64295a5c-d209-406d-af76-bbf42862f252 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Calling method '>' {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:12:43.656203 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.compute.api [None req-64295a5c-d209-406d-af76-bbf42862f252 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] [instance: 057628ba-a74f-426e-ba25-a3b79c3b6339] Fetching instance by UUID {{(pid=120798) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:12:43.682308 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-64295a5c-d209-406d-af76-bbf42862f252 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:12:43.683209 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-64295a5c-d209-406d-af76-bbf42862f252 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:12:43.683892 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-64295a5c-d209-406d-af76-bbf42862f252 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:12:43.685879 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-64295a5c-d209-406d-af76-bbf42862f252 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:12:43.690892 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-64295a5c-d209-406d-af76-bbf42862f252 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:12:43.691664 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-64295a5c-d209-406d-af76-bbf42862f252 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:12:43.695681 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-22d96fe2-529d-4ecb-ba90-0872b2b17467 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Calling method '>' {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:12:43.696760 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.compute.api [None req-22d96fe2-529d-4ecb-ba90-0872b2b17467 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] [instance: 703acb74-65e6-4a60-9dd0-bf986498889e] Fetching instance by UUID {{(pid=120799) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:12:43.734966 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-22d96fe2-529d-4ecb-ba90-0872b2b17467 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:12:43.735874 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-22d96fe2-529d-4ecb-ba90-0872b2b17467 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:12:43.736289 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-22d96fe2-529d-4ecb-ba90-0872b2b17467 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:12:43.740056 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-22d96fe2-529d-4ecb-ba90-0872b2b17467 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:12:43.741644 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-22d96fe2-529d-4ecb-ba90-0872b2b17467 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:12:43.742231 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-22d96fe2-529d-4ecb-ba90-0872b2b17467 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:12:43.868752 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.policy [None req-64295a5c-d209-406d-af76-bbf42862f252 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '471dc5c1db64411ab1d80ad6c038e519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb44f62fa62e46528712f24479cbb19f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120798) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:12:43.885190 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [None req-64295a5c-d209-406d-af76-bbf42862f252 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] 10.222.0.17 "GET /compute/v2.1/servers/057628ba-a74f-426e-ba25-a3b79c3b6339" status: 200 len: 1244 microversion: 2.1 time: 0.255758 Aug 23 07:12:43.888785 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 41/80] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:12:43 2022] GET /compute/v2.1/servers/057628ba-a74f-426e-ba25-a3b79c3b6339 => generated 1244 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:12:44.018464 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.policy [None req-22d96fe2-529d-4ecb-ba90-0872b2b17467 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64d54cb95b264c18b45d90822507fae1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135367be6e3f4b3d965ee0d99fdca524', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120799) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:12:44.029541 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-22d96fe2-529d-4ecb-ba90-0872b2b17467 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] 10.222.0.17 "GET /compute/v2.1/servers/703acb74-65e6-4a60-9dd0-bf986498889e" status: 200 len: 1322 microversion: 2.1 time: 0.337404 Aug 23 07:12:44.030849 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 40/81] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:12:43 2022] GET /compute/v2.1/servers/703acb74-65e6-4a60-9dd0-bf986498889e => generated 1322 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:12:44.606107 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-c7639961-3013-4857-be1c-93c7a09a0c96 tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] Calling method '>' {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:12:44.606656 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.compute.api [None req-c7639961-3013-4857-be1c-93c7a09a0c96 tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] [instance: 9d984b5d-f788-4a4c-8609-471747c44fb8] Fetching instance by UUID {{(pid=120798) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:12:44.612875 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-c7639961-3013-4857-be1c-93c7a09a0c96 tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:12:44.613348 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-c7639961-3013-4857-be1c-93c7a09a0c96 tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:12:44.613773 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-c7639961-3013-4857-be1c-93c7a09a0c96 tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:12:44.614871 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-c7639961-3013-4857-be1c-93c7a09a0c96 tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:12:44.615311 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-c7639961-3013-4857-be1c-93c7a09a0c96 tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:12:44.615765 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-c7639961-3013-4857-be1c-93c7a09a0c96 tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:12:44.750506 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.policy [None req-c7639961-3013-4857-be1c-93c7a09a0c96 tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cbcc9668f454c0e8c27495a1827d703', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24307daab4d24f979c30e081163c3bfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120798) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:12:44.758427 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [None req-c7639961-3013-4857-be1c-93c7a09a0c96 tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] 10.222.0.17 "GET /compute/v2.1/servers/9d984b5d-f788-4a4c-8609-471747c44fb8" status: 200 len: 1315 microversion: 2.1 time: 0.156289 Aug 23 07:12:44.759189 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 42/82] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:12:44 2022] GET /compute/v2.1/servers/9d984b5d-f788-4a4c-8609-471747c44fb8 => generated 1315 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:12:44.912691 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-771579d0-9b58-409c-8687-6752aacfbbda tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Calling method '>' {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:12:44.913430 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.compute.api [None req-771579d0-9b58-409c-8687-6752aacfbbda tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] [instance: 057628ba-a74f-426e-ba25-a3b79c3b6339] Fetching instance by UUID {{(pid=120799) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:12:44.919545 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-771579d0-9b58-409c-8687-6752aacfbbda tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:12:44.920020 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-771579d0-9b58-409c-8687-6752aacfbbda tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:12:44.920440 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-771579d0-9b58-409c-8687-6752aacfbbda tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:12:44.921110 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-771579d0-9b58-409c-8687-6752aacfbbda tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:12:44.921551 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-771579d0-9b58-409c-8687-6752aacfbbda tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:12:44.921963 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-771579d0-9b58-409c-8687-6752aacfbbda tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:12:44.983263 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.policy [None req-771579d0-9b58-409c-8687-6752aacfbbda tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '471dc5c1db64411ab1d80ad6c038e519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb44f62fa62e46528712f24479cbb19f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120799) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:12:44.991163 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-771579d0-9b58-409c-8687-6752aacfbbda tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] 10.222.0.17 "GET /compute/v2.1/servers/057628ba-a74f-426e-ba25-a3b79c3b6339" status: 200 len: 1244 microversion: 2.1 time: 0.082368 Aug 23 07:12:44.992131 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 41/83] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:12:44 2022] GET /compute/v2.1/servers/057628ba-a74f-426e-ba25-a3b79c3b6339 => generated 1244 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:12:45.059092 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-02188b79-c4d9-488e-8182-cbfb261d368e tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Calling method '>' {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:12:45.059872 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.compute.api [None req-02188b79-c4d9-488e-8182-cbfb261d368e tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] [instance: 703acb74-65e6-4a60-9dd0-bf986498889e] Fetching instance by UUID {{(pid=120798) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:12:45.068086 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-02188b79-c4d9-488e-8182-cbfb261d368e tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:12:45.068568 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-02188b79-c4d9-488e-8182-cbfb261d368e tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:12:45.068996 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-02188b79-c4d9-488e-8182-cbfb261d368e tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:12:45.069837 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-02188b79-c4d9-488e-8182-cbfb261d368e tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:12:45.070856 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-02188b79-c4d9-488e-8182-cbfb261d368e tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:12:45.071443 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-02188b79-c4d9-488e-8182-cbfb261d368e tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:12:45.207744 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.policy [None req-02188b79-c4d9-488e-8182-cbfb261d368e tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64d54cb95b264c18b45d90822507fae1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135367be6e3f4b3d965ee0d99fdca524', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120798) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:12:45.215633 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [None req-02188b79-c4d9-488e-8182-cbfb261d368e tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] 10.222.0.17 "GET /compute/v2.1/servers/703acb74-65e6-4a60-9dd0-bf986498889e" status: 200 len: 1322 microversion: 2.1 time: 0.161388 Aug 23 07:12:45.216217 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 43/84] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:12:45 2022] GET /compute/v2.1/servers/703acb74-65e6-4a60-9dd0-bf986498889e => generated 1322 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:12:45.780555 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-1e96b7af-bfa8-42ce-a275-d71e9ae9bc82 tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] Calling method '>' {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:12:45.781242 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.compute.api [None req-1e96b7af-bfa8-42ce-a275-d71e9ae9bc82 tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] [instance: 9d984b5d-f788-4a4c-8609-471747c44fb8] Fetching instance by UUID {{(pid=120799) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:12:45.788565 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-1e96b7af-bfa8-42ce-a275-d71e9ae9bc82 tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:12:45.789117 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-1e96b7af-bfa8-42ce-a275-d71e9ae9bc82 tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:12:45.789620 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-1e96b7af-bfa8-42ce-a275-d71e9ae9bc82 tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:12:45.792369 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-1e96b7af-bfa8-42ce-a275-d71e9ae9bc82 tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:12:45.792900 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-1e96b7af-bfa8-42ce-a275-d71e9ae9bc82 tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:12:45.793382 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-1e96b7af-bfa8-42ce-a275-d71e9ae9bc82 tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:12:45.933113 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.policy [None req-1e96b7af-bfa8-42ce-a275-d71e9ae9bc82 tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cbcc9668f454c0e8c27495a1827d703', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24307daab4d24f979c30e081163c3bfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120799) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:12:45.941332 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-1e96b7af-bfa8-42ce-a275-d71e9ae9bc82 tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] 10.222.0.17 "GET /compute/v2.1/servers/9d984b5d-f788-4a4c-8609-471747c44fb8" status: 200 len: 1315 microversion: 2.1 time: 0.165498 Aug 23 07:12:45.941894 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 42/85] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:12:45 2022] GET /compute/v2.1/servers/9d984b5d-f788-4a4c-8609-471747c44fb8 => generated 1315 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:12:46.013663 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-3cce077b-fc4e-4573-85cb-3b76975a5760 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Calling method '>' {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:12:46.014307 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.compute.api [None req-3cce077b-fc4e-4573-85cb-3b76975a5760 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] [instance: 057628ba-a74f-426e-ba25-a3b79c3b6339] Fetching instance by UUID {{(pid=120798) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:12:46.022038 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-3cce077b-fc4e-4573-85cb-3b76975a5760 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:12:46.022585 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-3cce077b-fc4e-4573-85cb-3b76975a5760 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:12:46.023085 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-3cce077b-fc4e-4573-85cb-3b76975a5760 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:12:46.023928 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-3cce077b-fc4e-4573-85cb-3b76975a5760 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:12:46.024451 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-3cce077b-fc4e-4573-85cb-3b76975a5760 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:12:46.024985 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-3cce077b-fc4e-4573-85cb-3b76975a5760 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:12:46.102472 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.policy [None req-3cce077b-fc4e-4573-85cb-3b76975a5760 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '471dc5c1db64411ab1d80ad6c038e519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb44f62fa62e46528712f24479cbb19f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120798) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:12:46.106020 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG dbcounter [-] [120798] Writing DB stats nova_cell1:SELECT=100 {{(pid=120798) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:12:46.113200 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [None req-3cce077b-fc4e-4573-85cb-3b76975a5760 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] 10.222.0.17 "GET /compute/v2.1/servers/057628ba-a74f-426e-ba25-a3b79c3b6339" status: 200 len: 1244 microversion: 2.1 time: 0.103986 Aug 23 07:12:46.114009 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 44/86] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:12:46 2022] GET /compute/v2.1/servers/057628ba-a74f-426e-ba25-a3b79c3b6339 => generated 1244 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:12:46.240773 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-bab6e1ce-4999-4cc5-a8d3-af0ed46986db tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Calling method '>' {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:12:46.241656 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.compute.api [None req-bab6e1ce-4999-4cc5-a8d3-af0ed46986db tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] [instance: 703acb74-65e6-4a60-9dd0-bf986498889e] Fetching instance by UUID {{(pid=120799) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:12:46.251574 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-bab6e1ce-4999-4cc5-a8d3-af0ed46986db tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:12:46.252436 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-bab6e1ce-4999-4cc5-a8d3-af0ed46986db tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:12:46.253108 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-bab6e1ce-4999-4cc5-a8d3-af0ed46986db tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:12:46.254213 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-bab6e1ce-4999-4cc5-a8d3-af0ed46986db tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:12:46.254989 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-bab6e1ce-4999-4cc5-a8d3-af0ed46986db tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:12:46.255734 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-bab6e1ce-4999-4cc5-a8d3-af0ed46986db tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:12:46.393033 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.policy [None req-bab6e1ce-4999-4cc5-a8d3-af0ed46986db tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64d54cb95b264c18b45d90822507fae1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135367be6e3f4b3d965ee0d99fdca524', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120799) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:12:46.402967 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-bab6e1ce-4999-4cc5-a8d3-af0ed46986db tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] 10.222.0.17 "GET /compute/v2.1/servers/703acb74-65e6-4a60-9dd0-bf986498889e" status: 200 len: 1322 microversion: 2.1 time: 0.166591 Aug 23 07:12:46.402967 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 43/87] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:12:46 2022] GET /compute/v2.1/servers/703acb74-65e6-4a60-9dd0-bf986498889e => generated 1322 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:12:46.974418 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-f014928d-3af9-4768-a82f-0e2f04a1c692 tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] Calling method '>' {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:12:46.975512 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.compute.api [None req-f014928d-3af9-4768-a82f-0e2f04a1c692 tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] [instance: 9d984b5d-f788-4a4c-8609-471747c44fb8] Fetching instance by UUID {{(pid=120798) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:12:46.985921 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-f014928d-3af9-4768-a82f-0e2f04a1c692 tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:12:46.986717 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-f014928d-3af9-4768-a82f-0e2f04a1c692 tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:12:46.987468 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-f014928d-3af9-4768-a82f-0e2f04a1c692 tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:12:46.988591 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-f014928d-3af9-4768-a82f-0e2f04a1c692 tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:12:46.989333 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-f014928d-3af9-4768-a82f-0e2f04a1c692 tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:12:46.990027 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-f014928d-3af9-4768-a82f-0e2f04a1c692 tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:12:47.137012 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-e61b5a70-f67e-438d-b3e6-7d3b6c6805e6 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Calling method '>' {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:12:47.137703 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.compute.api [None req-e61b5a70-f67e-438d-b3e6-7d3b6c6805e6 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] [instance: 057628ba-a74f-426e-ba25-a3b79c3b6339] Fetching instance by UUID {{(pid=120799) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:12:47.144192 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-e61b5a70-f67e-438d-b3e6-7d3b6c6805e6 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:12:47.144713 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-e61b5a70-f67e-438d-b3e6-7d3b6c6805e6 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:12:47.145143 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-e61b5a70-f67e-438d-b3e6-7d3b6c6805e6 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:12:47.145831 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-e61b5a70-f67e-438d-b3e6-7d3b6c6805e6 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:12:47.146280 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-e61b5a70-f67e-438d-b3e6-7d3b6c6805e6 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:12:47.146704 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-e61b5a70-f67e-438d-b3e6-7d3b6c6805e6 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:12:47.238041 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.policy [None req-e61b5a70-f67e-438d-b3e6-7d3b6c6805e6 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '471dc5c1db64411ab1d80ad6c038e519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb44f62fa62e46528712f24479cbb19f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120799) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:12:47.247591 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-e61b5a70-f67e-438d-b3e6-7d3b6c6805e6 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] 10.222.0.17 "GET /compute/v2.1/servers/057628ba-a74f-426e-ba25-a3b79c3b6339" status: 200 len: 1244 microversion: 2.1 time: 0.114543 Aug 23 07:12:47.248645 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 44/88] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:12:47 2022] GET /compute/v2.1/servers/057628ba-a74f-426e-ba25-a3b79c3b6339 => generated 1244 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:12:47.259978 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.policy [None req-f014928d-3af9-4768-a82f-0e2f04a1c692 tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cbcc9668f454c0e8c27495a1827d703', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24307daab4d24f979c30e081163c3bfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120798) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:12:47.267600 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [None req-f014928d-3af9-4768-a82f-0e2f04a1c692 tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] 10.222.0.17 "GET /compute/v2.1/servers/9d984b5d-f788-4a4c-8609-471747c44fb8" status: 200 len: 1315 microversion: 2.1 time: 0.299685 Aug 23 07:12:47.293093 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 45/89] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:12:46 2022] GET /compute/v2.1/servers/9d984b5d-f788-4a4c-8609-471747c44fb8 => generated 1315 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:12:47.427481 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-0410ee29-2629-435a-9033-bc533c772d39 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Calling method '>' {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:12:47.428430 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.compute.api [None req-0410ee29-2629-435a-9033-bc533c772d39 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] [instance: 703acb74-65e6-4a60-9dd0-bf986498889e] Fetching instance by UUID {{(pid=120799) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:12:47.438179 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-0410ee29-2629-435a-9033-bc533c772d39 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:12:47.438971 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-0410ee29-2629-435a-9033-bc533c772d39 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:12:47.439712 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-0410ee29-2629-435a-9033-bc533c772d39 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:12:47.440835 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-0410ee29-2629-435a-9033-bc533c772d39 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:12:47.441530 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-0410ee29-2629-435a-9033-bc533c772d39 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:12:47.442207 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-0410ee29-2629-435a-9033-bc533c772d39 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:12:47.600660 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.policy [None req-0410ee29-2629-435a-9033-bc533c772d39 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64d54cb95b264c18b45d90822507fae1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135367be6e3f4b3d965ee0d99fdca524', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120799) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:12:47.608725 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-0410ee29-2629-435a-9033-bc533c772d39 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] 10.222.0.17 "GET /compute/v2.1/servers/703acb74-65e6-4a60-9dd0-bf986498889e" status: 200 len: 1322 microversion: 2.1 time: 0.190871 Aug 23 07:12:47.609259 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 45/90] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:12:47 2022] GET /compute/v2.1/servers/703acb74-65e6-4a60-9dd0-bf986498889e => generated 1322 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:12:48.268743 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-1c6f4fff-a6e4-4f6a-be9b-d3d023ae0b49 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Calling method '>' {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:12:48.269352 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.compute.api [None req-1c6f4fff-a6e4-4f6a-be9b-d3d023ae0b49 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] [instance: 057628ba-a74f-426e-ba25-a3b79c3b6339] Fetching instance by UUID {{(pid=120798) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:12:48.275852 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-1c6f4fff-a6e4-4f6a-be9b-d3d023ae0b49 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:12:48.276177 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-1c6f4fff-a6e4-4f6a-be9b-d3d023ae0b49 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:12:48.276583 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-1c6f4fff-a6e4-4f6a-be9b-d3d023ae0b49 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:12:48.277274 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-1c6f4fff-a6e4-4f6a-be9b-d3d023ae0b49 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:12:48.277708 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-1c6f4fff-a6e4-4f6a-be9b-d3d023ae0b49 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:12:48.278116 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-1c6f4fff-a6e4-4f6a-be9b-d3d023ae0b49 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:12:48.288827 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-8b54e785-ad56-4f05-af57-e51c4ec23e00 tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] Calling method '>' {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:12:48.289831 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.compute.api [None req-8b54e785-ad56-4f05-af57-e51c4ec23e00 tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] [instance: 9d984b5d-f788-4a4c-8609-471747c44fb8] Fetching instance by UUID {{(pid=120799) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:12:48.296848 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-8b54e785-ad56-4f05-af57-e51c4ec23e00 tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:12:48.297416 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-8b54e785-ad56-4f05-af57-e51c4ec23e00 tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:12:48.297896 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-8b54e785-ad56-4f05-af57-e51c4ec23e00 tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:12:48.298831 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-8b54e785-ad56-4f05-af57-e51c4ec23e00 tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:12:48.299381 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-8b54e785-ad56-4f05-af57-e51c4ec23e00 tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:12:48.299894 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-8b54e785-ad56-4f05-af57-e51c4ec23e00 tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:12:48.346135 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.policy [None req-1c6f4fff-a6e4-4f6a-be9b-d3d023ae0b49 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '471dc5c1db64411ab1d80ad6c038e519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb44f62fa62e46528712f24479cbb19f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120798) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:12:48.354225 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [None req-1c6f4fff-a6e4-4f6a-be9b-d3d023ae0b49 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] 10.222.0.17 "GET /compute/v2.1/servers/057628ba-a74f-426e-ba25-a3b79c3b6339" status: 200 len: 1236 microversion: 2.1 time: 0.089103 Aug 23 07:12:48.354952 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 46/91] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:12:48 2022] GET /compute/v2.1/servers/057628ba-a74f-426e-ba25-a3b79c3b6339 => generated 1236 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:12:48.440761 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.policy [None req-8b54e785-ad56-4f05-af57-e51c4ec23e00 tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cbcc9668f454c0e8c27495a1827d703', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24307daab4d24f979c30e081163c3bfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120799) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:12:48.448050 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-8b54e785-ad56-4f05-af57-e51c4ec23e00 tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] 10.222.0.17 "GET /compute/v2.1/servers/9d984b5d-f788-4a4c-8609-471747c44fb8" status: 200 len: 1315 microversion: 2.1 time: 0.163201 Aug 23 07:12:48.448665 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 46/92] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:12:48 2022] GET /compute/v2.1/servers/9d984b5d-f788-4a4c-8609-471747c44fb8 => generated 1315 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:12:48.629557 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-cef8d953-f1f4-402f-8620-8f6b2ed18b4c tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Calling method '>' {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:12:48.630259 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.compute.api [None req-cef8d953-f1f4-402f-8620-8f6b2ed18b4c tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] [instance: 703acb74-65e6-4a60-9dd0-bf986498889e] Fetching instance by UUID {{(pid=120798) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:12:48.636549 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-cef8d953-f1f4-402f-8620-8f6b2ed18b4c tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:12:48.637069 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-cef8d953-f1f4-402f-8620-8f6b2ed18b4c tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:12:48.637489 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-cef8d953-f1f4-402f-8620-8f6b2ed18b4c tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:12:48.638165 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-cef8d953-f1f4-402f-8620-8f6b2ed18b4c tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:12:48.638603 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-cef8d953-f1f4-402f-8620-8f6b2ed18b4c tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:12:48.639059 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-cef8d953-f1f4-402f-8620-8f6b2ed18b4c tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:12:48.794867 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.policy [None req-cef8d953-f1f4-402f-8620-8f6b2ed18b4c tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64d54cb95b264c18b45d90822507fae1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135367be6e3f4b3d965ee0d99fdca524', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120798) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:12:48.807084 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [None req-cef8d953-f1f4-402f-8620-8f6b2ed18b4c tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] 10.222.0.17 "GET /compute/v2.1/servers/703acb74-65e6-4a60-9dd0-bf986498889e" status: 200 len: 1322 microversion: 2.1 time: 0.182016 Aug 23 07:12:48.807917 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 47/93] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:12:48 2022] GET /compute/v2.1/servers/703acb74-65e6-4a60-9dd0-bf986498889e => generated 1322 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:12:49.379659 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-24344337-6120-42e2-ab3f-1e00fc839b85 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Calling method '>' {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:12:49.380653 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.compute.api [None req-24344337-6120-42e2-ab3f-1e00fc839b85 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] [instance: 057628ba-a74f-426e-ba25-a3b79c3b6339] Fetching instance by UUID {{(pid=120799) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:12:49.391530 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-24344337-6120-42e2-ab3f-1e00fc839b85 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:12:49.392209 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-24344337-6120-42e2-ab3f-1e00fc839b85 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:12:49.392919 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-24344337-6120-42e2-ab3f-1e00fc839b85 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:12:49.394030 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-24344337-6120-42e2-ab3f-1e00fc839b85 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:12:49.394764 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-24344337-6120-42e2-ab3f-1e00fc839b85 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:12:49.395511 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-24344337-6120-42e2-ab3f-1e00fc839b85 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:12:49.459403 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.policy [None req-24344337-6120-42e2-ab3f-1e00fc839b85 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '471dc5c1db64411ab1d80ad6c038e519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb44f62fa62e46528712f24479cbb19f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120799) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:12:49.469010 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-24344337-6120-42e2-ab3f-1e00fc839b85 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] 10.222.0.17 "GET /compute/v2.1/servers/057628ba-a74f-426e-ba25-a3b79c3b6339" status: 200 len: 1236 microversion: 2.1 time: 0.094630 Aug 23 07:12:49.469010 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 47/94] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:12:49 2022] GET /compute/v2.1/servers/057628ba-a74f-426e-ba25-a3b79c3b6339 => generated 1236 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:12:49.469301 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-5a847b3b-e371-4b0f-acc8-bff7ffe38046 tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] Calling method '>' {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:12:49.470046 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.compute.api [None req-5a847b3b-e371-4b0f-acc8-bff7ffe38046 tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] [instance: 9d984b5d-f788-4a4c-8609-471747c44fb8] Fetching instance by UUID {{(pid=120798) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:12:49.476621 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-5a847b3b-e371-4b0f-acc8-bff7ffe38046 tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:12:49.477171 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-5a847b3b-e371-4b0f-acc8-bff7ffe38046 tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:12:49.480107 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-5a847b3b-e371-4b0f-acc8-bff7ffe38046 tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:12:49.480107 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-5a847b3b-e371-4b0f-acc8-bff7ffe38046 tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:12:49.480107 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-5a847b3b-e371-4b0f-acc8-bff7ffe38046 tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:12:49.480107 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-5a847b3b-e371-4b0f-acc8-bff7ffe38046 tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:12:49.626309 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.policy [None req-5a847b3b-e371-4b0f-acc8-bff7ffe38046 tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cbcc9668f454c0e8c27495a1827d703', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24307daab4d24f979c30e081163c3bfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120798) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:12:49.634022 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [None req-5a847b3b-e371-4b0f-acc8-bff7ffe38046 tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] 10.222.0.17 "GET /compute/v2.1/servers/9d984b5d-f788-4a4c-8609-471747c44fb8" status: 200 len: 1315 microversion: 2.1 time: 0.168883 Aug 23 07:12:49.634664 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 48/95] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:12:49 2022] GET /compute/v2.1/servers/9d984b5d-f788-4a4c-8609-471747c44fb8 => generated 1315 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:12:49.837695 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-f61c9bf9-1218-4a29-9667-45b6bdad6bb2 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Calling method '>' {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:12:49.838711 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.compute.api [None req-f61c9bf9-1218-4a29-9667-45b6bdad6bb2 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] [instance: 703acb74-65e6-4a60-9dd0-bf986498889e] Fetching instance by UUID {{(pid=120799) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:12:49.848745 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-f61c9bf9-1218-4a29-9667-45b6bdad6bb2 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:12:49.849533 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-f61c9bf9-1218-4a29-9667-45b6bdad6bb2 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:12:49.850246 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-f61c9bf9-1218-4a29-9667-45b6bdad6bb2 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:12:49.851357 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-f61c9bf9-1218-4a29-9667-45b6bdad6bb2 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:12:49.852145 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-f61c9bf9-1218-4a29-9667-45b6bdad6bb2 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:12:49.852843 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-f61c9bf9-1218-4a29-9667-45b6bdad6bb2 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:12:49.994311 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.policy [None req-f61c9bf9-1218-4a29-9667-45b6bdad6bb2 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64d54cb95b264c18b45d90822507fae1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135367be6e3f4b3d965ee0d99fdca524', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120799) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:12:50.002622 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-f61c9bf9-1218-4a29-9667-45b6bdad6bb2 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] 10.222.0.17 "GET /compute/v2.1/servers/703acb74-65e6-4a60-9dd0-bf986498889e" status: 200 len: 1322 microversion: 2.1 time: 0.171865 Aug 23 07:12:50.003191 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 48/96] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:12:49 2022] GET /compute/v2.1/servers/703acb74-65e6-4a60-9dd0-bf986498889e => generated 1322 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:12:50.492757 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-a7868d07-8cd7-4473-99a9-d8046ef9e982 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Calling method '>' {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:12:50.493752 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.compute.api [None req-a7868d07-8cd7-4473-99a9-d8046ef9e982 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] [instance: 057628ba-a74f-426e-ba25-a3b79c3b6339] Fetching instance by UUID {{(pid=120798) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:12:50.503882 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-a7868d07-8cd7-4473-99a9-d8046ef9e982 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:12:50.504713 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-a7868d07-8cd7-4473-99a9-d8046ef9e982 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:12:50.505395 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-a7868d07-8cd7-4473-99a9-d8046ef9e982 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:12:50.506518 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-a7868d07-8cd7-4473-99a9-d8046ef9e982 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:12:50.507263 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-a7868d07-8cd7-4473-99a9-d8046ef9e982 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:12:50.508005 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-a7868d07-8cd7-4473-99a9-d8046ef9e982 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:12:50.570665 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.policy [None req-a7868d07-8cd7-4473-99a9-d8046ef9e982 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '471dc5c1db64411ab1d80ad6c038e519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb44f62fa62e46528712f24479cbb19f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120798) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:12:50.578644 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [None req-a7868d07-8cd7-4473-99a9-d8046ef9e982 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] 10.222.0.17 "GET /compute/v2.1/servers/057628ba-a74f-426e-ba25-a3b79c3b6339" status: 200 len: 1236 microversion: 2.1 time: 0.092522 Aug 23 07:12:50.579204 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 49/97] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:12:50 2022] GET /compute/v2.1/servers/057628ba-a74f-426e-ba25-a3b79c3b6339 => generated 1236 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:12:50.654298 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-493051d7-fd78-47b3-9cc3-cf2e643255bb tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] Calling method '>' {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:12:50.654927 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.compute.api [None req-493051d7-fd78-47b3-9cc3-cf2e643255bb tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] [instance: 9d984b5d-f788-4a4c-8609-471747c44fb8] Fetching instance by UUID {{(pid=120799) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:12:50.656796 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG dbcounter [-] [120799] Writing DB stats nova_cell0:SELECT=2 {{(pid=120799) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:12:50.662232 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-493051d7-fd78-47b3-9cc3-cf2e643255bb tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:12:50.662699 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-493051d7-fd78-47b3-9cc3-cf2e643255bb tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:12:50.663119 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-493051d7-fd78-47b3-9cc3-cf2e643255bb tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:12:50.663825 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-493051d7-fd78-47b3-9cc3-cf2e643255bb tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:12:50.664274 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-493051d7-fd78-47b3-9cc3-cf2e643255bb tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:12:50.664680 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-493051d7-fd78-47b3-9cc3-cf2e643255bb tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:12:50.819217 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.policy [None req-493051d7-fd78-47b3-9cc3-cf2e643255bb tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cbcc9668f454c0e8c27495a1827d703', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24307daab4d24f979c30e081163c3bfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120799) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:12:50.827105 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-493051d7-fd78-47b3-9cc3-cf2e643255bb tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] 10.222.0.17 "GET /compute/v2.1/servers/9d984b5d-f788-4a4c-8609-471747c44fb8" status: 200 len: 1315 microversion: 2.1 time: 0.176829 Aug 23 07:12:50.827695 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 49/98] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:12:50 2022] GET /compute/v2.1/servers/9d984b5d-f788-4a4c-8609-471747c44fb8 => generated 1315 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:12:51.027484 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-cb0a591a-8050-4224-9333-26a84b3e370d tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Calling method '>' {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:12:51.028352 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.compute.api [None req-cb0a591a-8050-4224-9333-26a84b3e370d tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] [instance: 703acb74-65e6-4a60-9dd0-bf986498889e] Fetching instance by UUID {{(pid=120798) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:12:51.031332 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG dbcounter [-] [120798] Writing DB stats nova_cell0:SELECT=6 {{(pid=120798) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:12:51.040258 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-cb0a591a-8050-4224-9333-26a84b3e370d tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:12:51.041143 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-cb0a591a-8050-4224-9333-26a84b3e370d tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:12:51.041596 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-cb0a591a-8050-4224-9333-26a84b3e370d tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:12:51.042291 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-cb0a591a-8050-4224-9333-26a84b3e370d tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:12:51.042730 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-cb0a591a-8050-4224-9333-26a84b3e370d tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:12:51.043147 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-cb0a591a-8050-4224-9333-26a84b3e370d tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:12:51.188793 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.policy [None req-cb0a591a-8050-4224-9333-26a84b3e370d tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64d54cb95b264c18b45d90822507fae1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135367be6e3f4b3d965ee0d99fdca524', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120798) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:12:51.196565 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [None req-cb0a591a-8050-4224-9333-26a84b3e370d tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] 10.222.0.17 "GET /compute/v2.1/servers/703acb74-65e6-4a60-9dd0-bf986498889e" status: 200 len: 1322 microversion: 2.1 time: 0.175745 Aug 23 07:12:51.197252 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 50/99] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:12:51 2022] GET /compute/v2.1/servers/703acb74-65e6-4a60-9dd0-bf986498889e => generated 1322 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:12:51.603132 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-b4ec4a24-24ad-4f67-901d-40fcfc1bd216 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Calling method '>' {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:12:51.604178 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.compute.api [None req-b4ec4a24-24ad-4f67-901d-40fcfc1bd216 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] [instance: 057628ba-a74f-426e-ba25-a3b79c3b6339] Fetching instance by UUID {{(pid=120799) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:12:51.607133 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG dbcounter [-] [120799] Writing DB stats nova_cell0:SELECT=2 {{(pid=120799) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:12:51.616135 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-b4ec4a24-24ad-4f67-901d-40fcfc1bd216 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:12:51.616926 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-b4ec4a24-24ad-4f67-901d-40fcfc1bd216 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:12:51.617645 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-b4ec4a24-24ad-4f67-901d-40fcfc1bd216 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:12:51.618750 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-b4ec4a24-24ad-4f67-901d-40fcfc1bd216 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:12:51.619491 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-b4ec4a24-24ad-4f67-901d-40fcfc1bd216 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:12:51.619909 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-b4ec4a24-24ad-4f67-901d-40fcfc1bd216 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:12:51.681630 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.policy [None req-b4ec4a24-24ad-4f67-901d-40fcfc1bd216 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '471dc5c1db64411ab1d80ad6c038e519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb44f62fa62e46528712f24479cbb19f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120799) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:12:51.690300 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-b4ec4a24-24ad-4f67-901d-40fcfc1bd216 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] 10.222.0.17 "GET /compute/v2.1/servers/057628ba-a74f-426e-ba25-a3b79c3b6339" status: 200 len: 1236 microversion: 2.1 time: 0.093621 Aug 23 07:12:51.690847 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 50/100] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:12:51 2022] GET /compute/v2.1/servers/057628ba-a74f-426e-ba25-a3b79c3b6339 => generated 1236 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:12:51.848299 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-b030a314-60cb-42c3-9116-bf11601cf8fb tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] Calling method '>' {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:12:51.849034 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.compute.api [None req-b030a314-60cb-42c3-9116-bf11601cf8fb tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] [instance: 9d984b5d-f788-4a4c-8609-471747c44fb8] Fetching instance by UUID {{(pid=120798) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:12:51.851946 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG dbcounter [-] [120798] Writing DB stats nova_cell0:SELECT=4 {{(pid=120798) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:12:51.852673 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG dbcounter [-] [120798] Writing DB stats nova_api:SELECT=83,nova_api:INSERT=6 {{(pid=120798) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:12:51.857302 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-b030a314-60cb-42c3-9116-bf11601cf8fb tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:12:51.857735 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-b030a314-60cb-42c3-9116-bf11601cf8fb tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:12:51.858169 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-b030a314-60cb-42c3-9116-bf11601cf8fb tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:12:51.858923 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-b030a314-60cb-42c3-9116-bf11601cf8fb tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:12:51.859377 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-b030a314-60cb-42c3-9116-bf11601cf8fb tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:12:51.859829 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-b030a314-60cb-42c3-9116-bf11601cf8fb tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:12:51.993496 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.policy [None req-b030a314-60cb-42c3-9116-bf11601cf8fb tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cbcc9668f454c0e8c27495a1827d703', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24307daab4d24f979c30e081163c3bfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120798) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:12:52.004116 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [None req-b030a314-60cb-42c3-9116-bf11601cf8fb tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] 10.222.0.17 "GET /compute/v2.1/servers/9d984b5d-f788-4a4c-8609-471747c44fb8" status: 200 len: 1315 microversion: 2.1 time: 0.159545 Aug 23 07:12:52.004992 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 51/101] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:12:51 2022] GET /compute/v2.1/servers/9d984b5d-f788-4a4c-8609-471747c44fb8 => generated 1315 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:12:52.217734 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-5ae78bc7-8339-41d8-822d-0399608f4a30 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Calling method '>' {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:12:52.218349 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.compute.api [None req-5ae78bc7-8339-41d8-822d-0399608f4a30 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] [instance: 703acb74-65e6-4a60-9dd0-bf986498889e] Fetching instance by UUID {{(pid=120799) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:12:52.224629 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-5ae78bc7-8339-41d8-822d-0399608f4a30 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:12:52.225102 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-5ae78bc7-8339-41d8-822d-0399608f4a30 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:12:52.225525 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-5ae78bc7-8339-41d8-822d-0399608f4a30 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:12:52.226198 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-5ae78bc7-8339-41d8-822d-0399608f4a30 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:12:52.226635 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-5ae78bc7-8339-41d8-822d-0399608f4a30 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:12:52.227052 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-5ae78bc7-8339-41d8-822d-0399608f4a30 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:12:52.357000 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.policy [None req-5ae78bc7-8339-41d8-822d-0399608f4a30 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64d54cb95b264c18b45d90822507fae1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135367be6e3f4b3d965ee0d99fdca524', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120799) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:12:52.364761 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-5ae78bc7-8339-41d8-822d-0399608f4a30 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] 10.222.0.17 "GET /compute/v2.1/servers/703acb74-65e6-4a60-9dd0-bf986498889e" status: 200 len: 1322 microversion: 2.1 time: 0.150878 Aug 23 07:12:52.365323 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 51/102] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:12:52 2022] GET /compute/v2.1/servers/703acb74-65e6-4a60-9dd0-bf986498889e => generated 1322 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:12:52.712479 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-47963051-1395-4157-aa24-191097d8b946 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Calling method '>' {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:12:52.713109 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.compute.api [None req-47963051-1395-4157-aa24-191097d8b946 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] [instance: 057628ba-a74f-426e-ba25-a3b79c3b6339] Fetching instance by UUID {{(pid=120798) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:12:52.719679 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-47963051-1395-4157-aa24-191097d8b946 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:12:52.720267 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-47963051-1395-4157-aa24-191097d8b946 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:12:52.720751 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-47963051-1395-4157-aa24-191097d8b946 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:12:52.721434 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-47963051-1395-4157-aa24-191097d8b946 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:12:52.721885 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-47963051-1395-4157-aa24-191097d8b946 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:12:52.722302 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-47963051-1395-4157-aa24-191097d8b946 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:12:52.795222 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.policy [None req-47963051-1395-4157-aa24-191097d8b946 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '471dc5c1db64411ab1d80ad6c038e519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb44f62fa62e46528712f24479cbb19f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120798) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:12:52.803182 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [None req-47963051-1395-4157-aa24-191097d8b946 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] 10.222.0.17 "GET /compute/v2.1/servers/057628ba-a74f-426e-ba25-a3b79c3b6339" status: 200 len: 1236 microversion: 2.1 time: 0.094634 Aug 23 07:12:52.803769 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 52/103] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:12:52 2022] GET /compute/v2.1/servers/057628ba-a74f-426e-ba25-a3b79c3b6339 => generated 1236 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:12:53.028343 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-c730a572-1ed2-47ff-bf2c-ae8c32833fd2 tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] Calling method '>' {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:12:53.028915 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.compute.api [None req-c730a572-1ed2-47ff-bf2c-ae8c32833fd2 tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] [instance: 9d984b5d-f788-4a4c-8609-471747c44fb8] Fetching instance by UUID {{(pid=120799) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:12:53.034964 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-c730a572-1ed2-47ff-bf2c-ae8c32833fd2 tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:12:53.035447 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-c730a572-1ed2-47ff-bf2c-ae8c32833fd2 tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:12:53.035887 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-c730a572-1ed2-47ff-bf2c-ae8c32833fd2 tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:12:53.036561 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-c730a572-1ed2-47ff-bf2c-ae8c32833fd2 tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:12:53.037137 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-c730a572-1ed2-47ff-bf2c-ae8c32833fd2 tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:12:53.037623 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-c730a572-1ed2-47ff-bf2c-ae8c32833fd2 tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:12:53.174405 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.policy [None req-c730a572-1ed2-47ff-bf2c-ae8c32833fd2 tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cbcc9668f454c0e8c27495a1827d703', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24307daab4d24f979c30e081163c3bfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120799) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:12:53.182899 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-c730a572-1ed2-47ff-bf2c-ae8c32833fd2 tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] 10.222.0.17 "GET /compute/v2.1/servers/9d984b5d-f788-4a4c-8609-471747c44fb8" status: 200 len: 1315 microversion: 2.1 time: 0.159250 Aug 23 07:12:53.183538 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 52/104] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:12:53 2022] GET /compute/v2.1/servers/9d984b5d-f788-4a4c-8609-471747c44fb8 => generated 1315 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:12:53.386010 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-adb1f3d4-5938-4c43-b42a-c586228e479d tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Calling method '>' {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:12:53.386659 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.compute.api [None req-adb1f3d4-5938-4c43-b42a-c586228e479d tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] [instance: 703acb74-65e6-4a60-9dd0-bf986498889e] Fetching instance by UUID {{(pid=120798) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:12:53.392973 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-adb1f3d4-5938-4c43-b42a-c586228e479d tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:12:53.393596 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-adb1f3d4-5938-4c43-b42a-c586228e479d tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:12:53.394124 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-adb1f3d4-5938-4c43-b42a-c586228e479d tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:12:53.394885 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-adb1f3d4-5938-4c43-b42a-c586228e479d tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:12:53.395453 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-adb1f3d4-5938-4c43-b42a-c586228e479d tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:12:53.395880 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-adb1f3d4-5938-4c43-b42a-c586228e479d tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:12:53.529962 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.policy [None req-adb1f3d4-5938-4c43-b42a-c586228e479d tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64d54cb95b264c18b45d90822507fae1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135367be6e3f4b3d965ee0d99fdca524', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120798) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:12:53.537870 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [None req-adb1f3d4-5938-4c43-b42a-c586228e479d tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] 10.222.0.17 "GET /compute/v2.1/servers/703acb74-65e6-4a60-9dd0-bf986498889e" status: 200 len: 1322 microversion: 2.1 time: 0.155992 Aug 23 07:12:53.538448 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 53/105] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:12:53 2022] GET /compute/v2.1/servers/703acb74-65e6-4a60-9dd0-bf986498889e => generated 1322 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:12:53.824807 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-8664de41-7a28-4abd-bec1-529b12fc4757 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Calling method '>' {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:12:53.825511 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.compute.api [None req-8664de41-7a28-4abd-bec1-529b12fc4757 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] [instance: 057628ba-a74f-426e-ba25-a3b79c3b6339] Fetching instance by UUID {{(pid=120799) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:12:53.832702 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-8664de41-7a28-4abd-bec1-529b12fc4757 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:12:53.833282 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-8664de41-7a28-4abd-bec1-529b12fc4757 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:12:53.833796 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-8664de41-7a28-4abd-bec1-529b12fc4757 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:12:53.834591 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-8664de41-7a28-4abd-bec1-529b12fc4757 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:12:53.835239 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-8664de41-7a28-4abd-bec1-529b12fc4757 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:12:53.835730 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-8664de41-7a28-4abd-bec1-529b12fc4757 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:12:53.900969 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.policy [None req-8664de41-7a28-4abd-bec1-529b12fc4757 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '471dc5c1db64411ab1d80ad6c038e519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb44f62fa62e46528712f24479cbb19f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120799) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:12:53.908790 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-8664de41-7a28-4abd-bec1-529b12fc4757 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] 10.222.0.17 "GET /compute/v2.1/servers/057628ba-a74f-426e-ba25-a3b79c3b6339" status: 200 len: 1236 microversion: 2.1 time: 0.088655 Aug 23 07:12:53.909534 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 53/106] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:12:53 2022] GET /compute/v2.1/servers/057628ba-a74f-426e-ba25-a3b79c3b6339 => generated 1236 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:12:54.204681 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-33c5d904-5323-4952-a575-962f5daf41fb tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] Calling method '>' {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:12:54.205379 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.compute.api [None req-33c5d904-5323-4952-a575-962f5daf41fb tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] [instance: 9d984b5d-f788-4a4c-8609-471747c44fb8] Fetching instance by UUID {{(pid=120798) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:12:54.217343 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-33c5d904-5323-4952-a575-962f5daf41fb tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:12:54.217343 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-33c5d904-5323-4952-a575-962f5daf41fb tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:12:54.217343 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-33c5d904-5323-4952-a575-962f5daf41fb tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:12:54.217343 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-33c5d904-5323-4952-a575-962f5daf41fb tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:12:54.217703 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-33c5d904-5323-4952-a575-962f5daf41fb tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:12:54.217703 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-33c5d904-5323-4952-a575-962f5daf41fb tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:12:54.351766 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.policy [None req-33c5d904-5323-4952-a575-962f5daf41fb tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cbcc9668f454c0e8c27495a1827d703', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24307daab4d24f979c30e081163c3bfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120798) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:12:54.359581 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [None req-33c5d904-5323-4952-a575-962f5daf41fb tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] 10.222.0.17 "GET /compute/v2.1/servers/9d984b5d-f788-4a4c-8609-471747c44fb8" status: 200 len: 1315 microversion: 2.1 time: 0.159969 Aug 23 07:12:54.364162 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 54/107] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:12:54 2022] GET /compute/v2.1/servers/9d984b5d-f788-4a4c-8609-471747c44fb8 => generated 1315 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:12:54.558260 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-6325b607-ff37-4550-8073-c3c0ed0ff2f5 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Calling method '>' {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:12:54.558864 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.compute.api [None req-6325b607-ff37-4550-8073-c3c0ed0ff2f5 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] [instance: 703acb74-65e6-4a60-9dd0-bf986498889e] Fetching instance by UUID {{(pid=120799) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:12:54.565132 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-6325b607-ff37-4550-8073-c3c0ed0ff2f5 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:12:54.565612 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-6325b607-ff37-4550-8073-c3c0ed0ff2f5 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:12:54.566036 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-6325b607-ff37-4550-8073-c3c0ed0ff2f5 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:12:54.566719 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-6325b607-ff37-4550-8073-c3c0ed0ff2f5 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:12:54.567164 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-6325b607-ff37-4550-8073-c3c0ed0ff2f5 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:12:54.567610 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-6325b607-ff37-4550-8073-c3c0ed0ff2f5 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:12:54.583090 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG dbcounter [-] [120799] Writing DB stats nova_cell1:SELECT=100 {{(pid=120799) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:12:54.696891 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.policy [None req-6325b607-ff37-4550-8073-c3c0ed0ff2f5 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64d54cb95b264c18b45d90822507fae1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135367be6e3f4b3d965ee0d99fdca524', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120799) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:12:54.705276 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-6325b607-ff37-4550-8073-c3c0ed0ff2f5 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] 10.222.0.17 "GET /compute/v2.1/servers/703acb74-65e6-4a60-9dd0-bf986498889e" status: 200 len: 1322 microversion: 2.1 time: 0.150869 Aug 23 07:12:54.705839 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 54/108] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:12:54 2022] GET /compute/v2.1/servers/703acb74-65e6-4a60-9dd0-bf986498889e => generated 1322 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:12:54.933849 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-6296521f-37e7-45e3-8b77-b0714e9bd466 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Calling method '>' {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:12:54.934835 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.compute.api [None req-6296521f-37e7-45e3-8b77-b0714e9bd466 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] [instance: 057628ba-a74f-426e-ba25-a3b79c3b6339] Fetching instance by UUID {{(pid=120798) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:12:54.945120 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-6296521f-37e7-45e3-8b77-b0714e9bd466 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:12:54.945959 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-6296521f-37e7-45e3-8b77-b0714e9bd466 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:12:54.946660 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-6296521f-37e7-45e3-8b77-b0714e9bd466 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:12:54.947660 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-6296521f-37e7-45e3-8b77-b0714e9bd466 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:12:54.948249 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-6296521f-37e7-45e3-8b77-b0714e9bd466 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:12:54.948650 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-6296521f-37e7-45e3-8b77-b0714e9bd466 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:12:55.012822 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.policy [None req-6296521f-37e7-45e3-8b77-b0714e9bd466 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '471dc5c1db64411ab1d80ad6c038e519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb44f62fa62e46528712f24479cbb19f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120798) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:12:55.020467 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [None req-6296521f-37e7-45e3-8b77-b0714e9bd466 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] 10.222.0.17 "GET /compute/v2.1/servers/057628ba-a74f-426e-ba25-a3b79c3b6339" status: 200 len: 1236 microversion: 2.1 time: 0.093166 Aug 23 07:12:55.021002 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 55/109] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:12:54 2022] GET /compute/v2.1/servers/057628ba-a74f-426e-ba25-a3b79c3b6339 => generated 1236 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:12:55.380863 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-80737d94-836e-46fc-b738-88840233eeec tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] Calling method '>' {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:12:55.381500 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.compute.api [None req-80737d94-836e-46fc-b738-88840233eeec tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] [instance: 9d984b5d-f788-4a4c-8609-471747c44fb8] Fetching instance by UUID {{(pid=120799) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:12:55.387835 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-80737d94-836e-46fc-b738-88840233eeec tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:12:55.388318 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-80737d94-836e-46fc-b738-88840233eeec tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:12:55.388752 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-80737d94-836e-46fc-b738-88840233eeec tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:12:55.389441 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-80737d94-836e-46fc-b738-88840233eeec tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:12:55.389891 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-80737d94-836e-46fc-b738-88840233eeec tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:12:55.390296 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-80737d94-836e-46fc-b738-88840233eeec tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:12:55.523553 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.policy [None req-80737d94-836e-46fc-b738-88840233eeec tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cbcc9668f454c0e8c27495a1827d703', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24307daab4d24f979c30e081163c3bfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120799) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:12:55.531586 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-80737d94-836e-46fc-b738-88840233eeec tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] 10.222.0.17 "GET /compute/v2.1/servers/9d984b5d-f788-4a4c-8609-471747c44fb8" status: 200 len: 1315 microversion: 2.1 time: 0.154624 Aug 23 07:12:55.532161 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 55/110] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:12:55 2022] GET /compute/v2.1/servers/9d984b5d-f788-4a4c-8609-471747c44fb8 => generated 1315 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:12:55.726145 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-8f2cb358-3efa-41ed-bc30-ddf247bc0c0f tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Calling method '>' {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:12:55.726711 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.compute.api [None req-8f2cb358-3efa-41ed-bc30-ddf247bc0c0f tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] [instance: 703acb74-65e6-4a60-9dd0-bf986498889e] Fetching instance by UUID {{(pid=120798) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:12:55.733152 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-8f2cb358-3efa-41ed-bc30-ddf247bc0c0f tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:12:55.733627 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-8f2cb358-3efa-41ed-bc30-ddf247bc0c0f tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:12:55.734058 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-8f2cb358-3efa-41ed-bc30-ddf247bc0c0f tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:12:55.734747 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-8f2cb358-3efa-41ed-bc30-ddf247bc0c0f tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:12:55.735190 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-8f2cb358-3efa-41ed-bc30-ddf247bc0c0f tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:12:55.735647 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-8f2cb358-3efa-41ed-bc30-ddf247bc0c0f tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:12:55.876516 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.policy [None req-8f2cb358-3efa-41ed-bc30-ddf247bc0c0f tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64d54cb95b264c18b45d90822507fae1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135367be6e3f4b3d965ee0d99fdca524', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120798) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:12:55.882412 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [None req-8f2cb358-3efa-41ed-bc30-ddf247bc0c0f tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] 10.222.0.17 "GET /compute/v2.1/servers/703acb74-65e6-4a60-9dd0-bf986498889e" status: 200 len: 1322 microversion: 2.1 time: 0.159878 Aug 23 07:12:55.883302 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 56/111] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:12:55 2022] GET /compute/v2.1/servers/703acb74-65e6-4a60-9dd0-bf986498889e => generated 1322 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:12:56.041671 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-5513fbb8-7b69-41f9-87dd-e958990d0557 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Calling method '>' {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:12:56.042255 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.compute.api [None req-5513fbb8-7b69-41f9-87dd-e958990d0557 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] [instance: 057628ba-a74f-426e-ba25-a3b79c3b6339] Fetching instance by UUID {{(pid=120799) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:12:56.048701 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-5513fbb8-7b69-41f9-87dd-e958990d0557 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:12:56.049155 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-5513fbb8-7b69-41f9-87dd-e958990d0557 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:12:56.049869 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-5513fbb8-7b69-41f9-87dd-e958990d0557 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:12:56.050260 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-5513fbb8-7b69-41f9-87dd-e958990d0557 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:12:56.050705 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-5513fbb8-7b69-41f9-87dd-e958990d0557 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:12:56.051123 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-5513fbb8-7b69-41f9-87dd-e958990d0557 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:12:56.115112 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.policy [None req-5513fbb8-7b69-41f9-87dd-e958990d0557 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '471dc5c1db64411ab1d80ad6c038e519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb44f62fa62e46528712f24479cbb19f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120799) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:12:56.123065 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-5513fbb8-7b69-41f9-87dd-e958990d0557 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] 10.222.0.17 "GET /compute/v2.1/servers/057628ba-a74f-426e-ba25-a3b79c3b6339" status: 200 len: 1236 microversion: 2.1 time: 0.085401 Aug 23 07:12:56.123665 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 56/112] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:12:56 2022] GET /compute/v2.1/servers/057628ba-a74f-426e-ba25-a3b79c3b6339 => generated 1236 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:12:56.552880 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-a4c5bbd8-f800-4c7c-bad4-fe303300fbb3 tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] Calling method '>' {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:12:56.554054 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.compute.api [None req-a4c5bbd8-f800-4c7c-bad4-fe303300fbb3 tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] [instance: 9d984b5d-f788-4a4c-8609-471747c44fb8] Fetching instance by UUID {{(pid=120798) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:12:56.561210 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-a4c5bbd8-f800-4c7c-bad4-fe303300fbb3 tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:12:56.561751 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-a4c5bbd8-f800-4c7c-bad4-fe303300fbb3 tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:12:56.562477 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-a4c5bbd8-f800-4c7c-bad4-fe303300fbb3 tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:12:56.563271 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-a4c5bbd8-f800-4c7c-bad4-fe303300fbb3 tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:12:56.563877 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-a4c5bbd8-f800-4c7c-bad4-fe303300fbb3 tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:12:56.564625 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-a4c5bbd8-f800-4c7c-bad4-fe303300fbb3 tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:12:56.903657 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-29812adb-6bbc-47dc-9097-cc0c3488654e tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Calling method '>' {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:12:56.904246 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.compute.api [None req-29812adb-6bbc-47dc-9097-cc0c3488654e tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] [instance: 703acb74-65e6-4a60-9dd0-bf986498889e] Fetching instance by UUID {{(pid=120799) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:12:56.910547 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-29812adb-6bbc-47dc-9097-cc0c3488654e tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:12:56.911027 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-29812adb-6bbc-47dc-9097-cc0c3488654e tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:12:56.911453 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-29812adb-6bbc-47dc-9097-cc0c3488654e tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:12:56.912146 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-29812adb-6bbc-47dc-9097-cc0c3488654e tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:12:56.912574 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-29812adb-6bbc-47dc-9097-cc0c3488654e tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:12:56.912973 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-29812adb-6bbc-47dc-9097-cc0c3488654e tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:12:57.038419 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.policy [None req-a4c5bbd8-f800-4c7c-bad4-fe303300fbb3 tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cbcc9668f454c0e8c27495a1827d703', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24307daab4d24f979c30e081163c3bfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120798) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:12:57.047918 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [None req-a4c5bbd8-f800-4c7c-bad4-fe303300fbb3 tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] 10.222.0.17 "GET /compute/v2.1/servers/9d984b5d-f788-4a4c-8609-471747c44fb8" status: 200 len: 1315 microversion: 2.1 time: 0.499329 Aug 23 07:12:57.048489 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 57/113] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:12:56 2022] GET /compute/v2.1/servers/9d984b5d-f788-4a4c-8609-471747c44fb8 => generated 1315 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:12:57.102192 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.policy [None req-29812adb-6bbc-47dc-9097-cc0c3488654e tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64d54cb95b264c18b45d90822507fae1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135367be6e3f4b3d965ee0d99fdca524', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120799) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:12:57.110130 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-29812adb-6bbc-47dc-9097-cc0c3488654e tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] 10.222.0.17 "GET /compute/v2.1/servers/703acb74-65e6-4a60-9dd0-bf986498889e" status: 200 len: 1322 microversion: 2.1 time: 0.210315 Aug 23 07:12:57.123131 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 57/114] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:12:56 2022] GET /compute/v2.1/servers/703acb74-65e6-4a60-9dd0-bf986498889e => generated 1322 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 07:12:57.143826 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-36600c32-8bba-4325-a886-dbde53179c9a tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Calling method '>' {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:12:57.144516 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.compute.api [None req-36600c32-8bba-4325-a886-dbde53179c9a tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] [instance: 057628ba-a74f-426e-ba25-a3b79c3b6339] Fetching instance by UUID {{(pid=120798) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:12:57.151032 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-36600c32-8bba-4325-a886-dbde53179c9a tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:12:57.151531 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-36600c32-8bba-4325-a886-dbde53179c9a tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:12:57.151963 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-36600c32-8bba-4325-a886-dbde53179c9a tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:12:57.152638 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-36600c32-8bba-4325-a886-dbde53179c9a tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:12:57.153079 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-36600c32-8bba-4325-a886-dbde53179c9a tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:12:57.153497 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-36600c32-8bba-4325-a886-dbde53179c9a tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:12:57.215719 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.policy [None req-36600c32-8bba-4325-a886-dbde53179c9a tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '471dc5c1db64411ab1d80ad6c038e519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb44f62fa62e46528712f24479cbb19f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120798) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:12:57.223635 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [None req-36600c32-8bba-4325-a886-dbde53179c9a tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] 10.222.0.17 "GET /compute/v2.1/servers/057628ba-a74f-426e-ba25-a3b79c3b6339" status: 200 len: 1300 microversion: 2.1 time: 0.083594 Aug 23 07:12:57.224201 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 58/115] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:12:57 2022] GET /compute/v2.1/servers/057628ba-a74f-426e-ba25-a3b79c3b6339 => generated 1300 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:12:58.069263 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-69277aa0-c7e1-43bc-8521-8e2735d5daa0 tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] Calling method '>' {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:12:58.069872 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.compute.api [None req-69277aa0-c7e1-43bc-8521-8e2735d5daa0 tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] [instance: 9d984b5d-f788-4a4c-8609-471747c44fb8] Fetching instance by UUID {{(pid=120799) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:12:58.076720 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-69277aa0-c7e1-43bc-8521-8e2735d5daa0 tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:12:58.077263 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-69277aa0-c7e1-43bc-8521-8e2735d5daa0 tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:12:58.082810 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-69277aa0-c7e1-43bc-8521-8e2735d5daa0 tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:12:58.083615 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-69277aa0-c7e1-43bc-8521-8e2735d5daa0 tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:12:58.084087 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-69277aa0-c7e1-43bc-8521-8e2735d5daa0 tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:12:58.084517 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-69277aa0-c7e1-43bc-8521-8e2735d5daa0 tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:12:58.138184 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-1767ae3a-66f8-4839-845b-b5034e110834 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Calling method '>' {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:12:58.139371 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.compute.api [None req-1767ae3a-66f8-4839-845b-b5034e110834 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] [instance: 703acb74-65e6-4a60-9dd0-bf986498889e] Fetching instance by UUID {{(pid=120798) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:12:58.151252 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-1767ae3a-66f8-4839-845b-b5034e110834 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:12:58.151865 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-1767ae3a-66f8-4839-845b-b5034e110834 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:12:58.153152 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-1767ae3a-66f8-4839-845b-b5034e110834 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:12:58.153949 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-1767ae3a-66f8-4839-845b-b5034e110834 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:12:58.154473 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-1767ae3a-66f8-4839-845b-b5034e110834 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:12:58.155627 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-1767ae3a-66f8-4839-845b-b5034e110834 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:12:58.258196 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.policy [None req-69277aa0-c7e1-43bc-8521-8e2735d5daa0 tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cbcc9668f454c0e8c27495a1827d703', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24307daab4d24f979c30e081163c3bfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120799) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:12:58.266678 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-69277aa0-c7e1-43bc-8521-8e2735d5daa0 tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] 10.222.0.17 "GET /compute/v2.1/servers/9d984b5d-f788-4a4c-8609-471747c44fb8" status: 200 len: 1315 microversion: 2.1 time: 0.201236 Aug 23 07:12:58.267258 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 58/116] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:12:58 2022] GET /compute/v2.1/servers/9d984b5d-f788-4a4c-8609-471747c44fb8 => generated 1315 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:12:58.272076 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-54fa8ae6-99d6-4ba6-bda5-2d5c0d4e5381 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Calling method '>' {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:12:58.272745 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.compute.api [None req-54fa8ae6-99d6-4ba6-bda5-2d5c0d4e5381 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] [instance: 057628ba-a74f-426e-ba25-a3b79c3b6339] Fetching instance by UUID {{(pid=120799) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:12:58.279136 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-54fa8ae6-99d6-4ba6-bda5-2d5c0d4e5381 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:12:58.279715 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-54fa8ae6-99d6-4ba6-bda5-2d5c0d4e5381 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:12:58.280142 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-54fa8ae6-99d6-4ba6-bda5-2d5c0d4e5381 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:12:58.280926 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-54fa8ae6-99d6-4ba6-bda5-2d5c0d4e5381 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:12:58.281405 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-54fa8ae6-99d6-4ba6-bda5-2d5c0d4e5381 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:12:58.281831 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-54fa8ae6-99d6-4ba6-bda5-2d5c0d4e5381 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:12:58.361924 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.policy [None req-54fa8ae6-99d6-4ba6-bda5-2d5c0d4e5381 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '471dc5c1db64411ab1d80ad6c038e519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb44f62fa62e46528712f24479cbb19f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120799) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:12:58.365103 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.policy [None req-1767ae3a-66f8-4839-845b-b5034e110834 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64d54cb95b264c18b45d90822507fae1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135367be6e3f4b3d965ee0d99fdca524', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120798) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:12:58.375111 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-54fa8ae6-99d6-4ba6-bda5-2d5c0d4e5381 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] 10.222.0.17 "GET /compute/v2.1/servers/057628ba-a74f-426e-ba25-a3b79c3b6339" status: 200 len: 1310 microversion: 2.1 time: 0.106213 Aug 23 07:12:58.375585 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [None req-1767ae3a-66f8-4839-845b-b5034e110834 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] 10.222.0.17 "GET /compute/v2.1/servers/703acb74-65e6-4a60-9dd0-bf986498889e" status: 200 len: 1322 microversion: 2.1 time: 0.248941 Aug 23 07:12:58.375771 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 59/117] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:12:58 2022] GET /compute/v2.1/servers/057628ba-a74f-426e-ba25-a3b79c3b6339 => generated 1310 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:12:58.388300 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 59/118] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:12:58 2022] GET /compute/v2.1/servers/703acb74-65e6-4a60-9dd0-bf986498889e => generated 1322 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:12:59.286736 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-13add8e6-fd39-4d13-a2cc-d9de7840585f tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] Calling method '>' {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:12:59.288249 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.compute.api [None req-13add8e6-fd39-4d13-a2cc-d9de7840585f tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] [instance: 9d984b5d-f788-4a4c-8609-471747c44fb8] Fetching instance by UUID {{(pid=120799) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:12:59.296906 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-13add8e6-fd39-4d13-a2cc-d9de7840585f tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:12:59.299331 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-13add8e6-fd39-4d13-a2cc-d9de7840585f tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:12:59.300051 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-13add8e6-fd39-4d13-a2cc-d9de7840585f tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:12:59.300935 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-13add8e6-fd39-4d13-a2cc-d9de7840585f tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:12:59.301753 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-13add8e6-fd39-4d13-a2cc-d9de7840585f tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:12:59.302317 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-13add8e6-fd39-4d13-a2cc-d9de7840585f tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:12:59.396227 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-aba79d73-af4f-4812-a8fc-133533529d8c tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Calling method '>' {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:12:59.396755 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.compute.api [None req-aba79d73-af4f-4812-a8fc-133533529d8c tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] [instance: 703acb74-65e6-4a60-9dd0-bf986498889e] Fetching instance by UUID {{(pid=120798) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:12:59.405197 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-aba79d73-af4f-4812-a8fc-133533529d8c tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:12:59.405898 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-aba79d73-af4f-4812-a8fc-133533529d8c tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:12:59.406477 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-aba79d73-af4f-4812-a8fc-133533529d8c tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:12:59.407328 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-aba79d73-af4f-4812-a8fc-133533529d8c tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:12:59.408011 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-aba79d73-af4f-4812-a8fc-133533529d8c tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:12:59.408580 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-aba79d73-af4f-4812-a8fc-133533529d8c tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:12:59.515501 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.policy [None req-13add8e6-fd39-4d13-a2cc-d9de7840585f tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cbcc9668f454c0e8c27495a1827d703', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24307daab4d24f979c30e081163c3bfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120799) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:12:59.526436 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-13add8e6-fd39-4d13-a2cc-d9de7840585f tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] 10.222.0.17 "GET /compute/v2.1/servers/9d984b5d-f788-4a4c-8609-471747c44fb8" status: 200 len: 1315 microversion: 2.1 time: 0.243509 Aug 23 07:12:59.527327 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 60/119] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:12:59 2022] GET /compute/v2.1/servers/9d984b5d-f788-4a4c-8609-471747c44fb8 => generated 1315 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:12:59.532125 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-ab71bc36-48d5-4b21-90ae-8277631681ac tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Calling method '>' {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:12:59.532941 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.compute.api [None req-ab71bc36-48d5-4b21-90ae-8277631681ac tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] [instance: 057628ba-a74f-426e-ba25-a3b79c3b6339] Fetching instance by UUID {{(pid=120799) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:12:59.539094 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-ab71bc36-48d5-4b21-90ae-8277631681ac tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:12:59.539637 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-ab71bc36-48d5-4b21-90ae-8277631681ac tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:12:59.540048 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-ab71bc36-48d5-4b21-90ae-8277631681ac tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:12:59.540919 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-ab71bc36-48d5-4b21-90ae-8277631681ac tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:12:59.542029 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-ab71bc36-48d5-4b21-90ae-8277631681ac tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:12:59.542438 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-ab71bc36-48d5-4b21-90ae-8277631681ac tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:12:59.574129 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.policy [None req-aba79d73-af4f-4812-a8fc-133533529d8c tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64d54cb95b264c18b45d90822507fae1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135367be6e3f4b3d965ee0d99fdca524', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120798) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:12:59.583922 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [None req-aba79d73-af4f-4812-a8fc-133533529d8c tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] 10.222.0.17 "GET /compute/v2.1/servers/703acb74-65e6-4a60-9dd0-bf986498889e" status: 200 len: 1322 microversion: 2.1 time: 0.191613 Aug 23 07:12:59.585251 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 60/120] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:12:59 2022] GET /compute/v2.1/servers/703acb74-65e6-4a60-9dd0-bf986498889e => generated 1322 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 07:12:59.613021 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.policy [None req-ab71bc36-48d5-4b21-90ae-8277631681ac tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '471dc5c1db64411ab1d80ad6c038e519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb44f62fa62e46528712f24479cbb19f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120799) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:12:59.622523 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-ab71bc36-48d5-4b21-90ae-8277631681ac tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] 10.222.0.17 "GET /compute/v2.1/servers/057628ba-a74f-426e-ba25-a3b79c3b6339" status: 200 len: 1298 microversion: 2.1 time: 0.093979 Aug 23 07:12:59.623386 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 61/121] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:12:59 2022] GET /compute/v2.1/servers/057628ba-a74f-426e-ba25-a3b79c3b6339 => generated 1298 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:13:00.116024 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [req-0dd54262-1773-44be-b625-ba109ec3c284 req-40fa94d7-b84f-495b-9f6a-8d9f19e2e4b9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6915ed26-7e2f-41b9-aada-adcb2c2015d3", "name": "network-vif-plugged", "status": "completed", "tag": "b8077cfc-5527-4264-938d-c6318acc4e35"}]} {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 07:13:00.125987 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [req-0dd54262-1773-44be-b625-ba109ec3c284 req-40fa94d7-b84f-495b-9f6a-8d9f19e2e4b9 service nova] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:13:00.126456 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [req-0dd54262-1773-44be-b625-ba109ec3c284 req-40fa94d7-b84f-495b-9f6a-8d9f19e2e4b9 service nova] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:13:00.126871 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [req-0dd54262-1773-44be-b625-ba109ec3c284 req-40fa94d7-b84f-495b-9f6a-8d9f19e2e4b9 service nova] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:13:00.137796 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.compute.server_external_events [req-0dd54262-1773-44be-b625-ba109ec3c284 req-40fa94d7-b84f-495b-9f6a-8d9f19e2e4b9 service nova] Creating event network-vif-plugged:b8077cfc-5527-4264-938d-c6318acc4e35 for instance 6915ed26-7e2f-41b9-aada-adcb2c2015d3 on hv-cinder-85409 Aug 23 07:13:00.143140 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [req-0dd54262-1773-44be-b625-ba109ec3c284 req-40fa94d7-b84f-495b-9f6a-8d9f19e2e4b9 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.157999 Aug 23 07:13:00.143763 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 61/122] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Aug 23 07:12:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 07:13:00.546346 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-58615aa0-5266-44d0-ab4f-1591e4bb26fd tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] Calling method '>' {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:13:00.546981 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.compute.api [None req-58615aa0-5266-44d0-ab4f-1591e4bb26fd tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] [instance: 9d984b5d-f788-4a4c-8609-471747c44fb8] Fetching instance by UUID {{(pid=120799) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:13:00.553162 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-58615aa0-5266-44d0-ab4f-1591e4bb26fd tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:13:00.553648 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-58615aa0-5266-44d0-ab4f-1591e4bb26fd tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:13:00.554080 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-58615aa0-5266-44d0-ab4f-1591e4bb26fd tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:13:00.554742 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-58615aa0-5266-44d0-ab4f-1591e4bb26fd tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:13:00.555183 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-58615aa0-5266-44d0-ab4f-1591e4bb26fd tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:13:00.555626 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-58615aa0-5266-44d0-ab4f-1591e4bb26fd tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:13:00.605414 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-77e0adf2-8d2e-421f-bd4f-6f66e29456e3 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Calling method '>' {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:13:00.610930 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.compute.api [None req-77e0adf2-8d2e-421f-bd4f-6f66e29456e3 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] [instance: 703acb74-65e6-4a60-9dd0-bf986498889e] Fetching instance by UUID {{(pid=120798) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:13:00.617708 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-77e0adf2-8d2e-421f-bd4f-6f66e29456e3 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:13:00.618230 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-77e0adf2-8d2e-421f-bd4f-6f66e29456e3 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:13:00.618645 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-77e0adf2-8d2e-421f-bd4f-6f66e29456e3 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:13:00.619780 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-77e0adf2-8d2e-421f-bd4f-6f66e29456e3 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:13:00.620180 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-77e0adf2-8d2e-421f-bd4f-6f66e29456e3 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:13:00.620630 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-77e0adf2-8d2e-421f-bd4f-6f66e29456e3 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:13:00.625045 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG dbcounter [-] [120798] Writing DB stats nova_cell1:SELECT=100 {{(pid=120798) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:13:00.756217 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.policy [None req-58615aa0-5266-44d0-ab4f-1591e4bb26fd tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cbcc9668f454c0e8c27495a1827d703', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24307daab4d24f979c30e081163c3bfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120799) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:13:00.764725 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-58615aa0-5266-44d0-ab4f-1591e4bb26fd tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] 10.222.0.17 "GET /compute/v2.1/servers/9d984b5d-f788-4a4c-8609-471747c44fb8" status: 200 len: 1315 microversion: 2.1 time: 0.222312 Aug 23 07:13:00.765292 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 62/123] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:13:00 2022] GET /compute/v2.1/servers/9d984b5d-f788-4a4c-8609-471747c44fb8 => generated 1315 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:13:00.769975 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-8914921f-3293-4c83-860b-d111bbcfa445 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Calling method '>' {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:13:00.770639 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.compute.api [None req-8914921f-3293-4c83-860b-d111bbcfa445 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] [instance: 057628ba-a74f-426e-ba25-a3b79c3b6339] Fetching instance by UUID {{(pid=120799) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:13:00.776981 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-8914921f-3293-4c83-860b-d111bbcfa445 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:13:00.777541 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-8914921f-3293-4c83-860b-d111bbcfa445 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:13:00.778170 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-8914921f-3293-4c83-860b-d111bbcfa445 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:13:00.779084 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-8914921f-3293-4c83-860b-d111bbcfa445 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:13:00.779629 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-8914921f-3293-4c83-860b-d111bbcfa445 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:13:00.780114 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-8914921f-3293-4c83-860b-d111bbcfa445 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:13:00.793785 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.policy [None req-77e0adf2-8d2e-421f-bd4f-6f66e29456e3 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64d54cb95b264c18b45d90822507fae1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135367be6e3f4b3d965ee0d99fdca524', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120798) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:13:00.802187 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [None req-77e0adf2-8d2e-421f-bd4f-6f66e29456e3 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] 10.222.0.17 "GET /compute/v2.1/servers/703acb74-65e6-4a60-9dd0-bf986498889e" status: 200 len: 1322 microversion: 2.1 time: 0.200954 Aug 23 07:13:00.802754 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 62/124] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:13:00 2022] GET /compute/v2.1/servers/703acb74-65e6-4a60-9dd0-bf986498889e => generated 1322 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 07:13:00.851948 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.policy [None req-8914921f-3293-4c83-860b-d111bbcfa445 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '471dc5c1db64411ab1d80ad6c038e519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb44f62fa62e46528712f24479cbb19f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120799) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:13:00.859889 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-8914921f-3293-4c83-860b-d111bbcfa445 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] 10.222.0.17 "GET /compute/v2.1/servers/057628ba-a74f-426e-ba25-a3b79c3b6339" status: 200 len: 1298 microversion: 2.1 time: 0.093323 Aug 23 07:13:00.860454 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 63/125] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:13:00 2022] GET /compute/v2.1/servers/057628ba-a74f-426e-ba25-a3b79c3b6339 => generated 1298 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:13:01.790091 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-4589d934-1b4e-44ee-a2c8-221962bcfece tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] Calling method '>' {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:13:01.791184 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.compute.api [None req-4589d934-1b4e-44ee-a2c8-221962bcfece tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] [instance: 9d984b5d-f788-4a4c-8609-471747c44fb8] Fetching instance by UUID {{(pid=120798) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:13:01.797630 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-4589d934-1b4e-44ee-a2c8-221962bcfece tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:13:01.798115 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-4589d934-1b4e-44ee-a2c8-221962bcfece tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:13:01.798546 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-4589d934-1b4e-44ee-a2c8-221962bcfece tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:13:01.799224 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-4589d934-1b4e-44ee-a2c8-221962bcfece tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:13:01.799701 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-4589d934-1b4e-44ee-a2c8-221962bcfece tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:13:01.800117 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-4589d934-1b4e-44ee-a2c8-221962bcfece tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:13:01.823596 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-42ff45b7-692b-4669-b3dc-62ef7ce2173b tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Calling method '>' {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:13:01.824171 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.compute.api [None req-42ff45b7-692b-4669-b3dc-62ef7ce2173b tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] [instance: 703acb74-65e6-4a60-9dd0-bf986498889e] Fetching instance by UUID {{(pid=120799) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:13:01.830598 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-42ff45b7-692b-4669-b3dc-62ef7ce2173b tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:13:01.831073 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-42ff45b7-692b-4669-b3dc-62ef7ce2173b tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:13:01.831851 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-42ff45b7-692b-4669-b3dc-62ef7ce2173b tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:13:01.832551 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-42ff45b7-692b-4669-b3dc-62ef7ce2173b tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:13:01.832997 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-42ff45b7-692b-4669-b3dc-62ef7ce2173b tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:13:01.833419 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-42ff45b7-692b-4669-b3dc-62ef7ce2173b tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:13:01.982678 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.policy [None req-4589d934-1b4e-44ee-a2c8-221962bcfece tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cbcc9668f454c0e8c27495a1827d703', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24307daab4d24f979c30e081163c3bfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120798) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:13:01.990461 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [None req-4589d934-1b4e-44ee-a2c8-221962bcfece tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] 10.222.0.17 "GET /compute/v2.1/servers/9d984b5d-f788-4a4c-8609-471747c44fb8" status: 200 len: 1315 microversion: 2.1 time: 0.206827 Aug 23 07:13:01.991012 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 63/126] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:13:01 2022] GET /compute/v2.1/servers/9d984b5d-f788-4a4c-8609-471747c44fb8 => generated 1315 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:13:01.995776 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-b150a145-9a03-493f-bbf6-472dee9bd668 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Calling method '>' {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:13:01.996378 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.compute.api [None req-b150a145-9a03-493f-bbf6-472dee9bd668 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] [instance: 057628ba-a74f-426e-ba25-a3b79c3b6339] Fetching instance by UUID {{(pid=120798) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:13:02.002257 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-b150a145-9a03-493f-bbf6-472dee9bd668 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:13:02.002729 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-b150a145-9a03-493f-bbf6-472dee9bd668 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:13:02.003152 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-b150a145-9a03-493f-bbf6-472dee9bd668 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:13:02.003857 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-b150a145-9a03-493f-bbf6-472dee9bd668 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:13:02.004306 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-b150a145-9a03-493f-bbf6-472dee9bd668 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:13:02.004716 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-b150a145-9a03-493f-bbf6-472dee9bd668 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:13:02.019142 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.policy [None req-42ff45b7-692b-4669-b3dc-62ef7ce2173b tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64d54cb95b264c18b45d90822507fae1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135367be6e3f4b3d965ee0d99fdca524', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120799) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:13:02.027111 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-42ff45b7-692b-4669-b3dc-62ef7ce2173b tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] 10.222.0.17 "GET /compute/v2.1/servers/703acb74-65e6-4a60-9dd0-bf986498889e" status: 200 len: 1322 microversion: 2.1 time: 0.207469 Aug 23 07:13:02.027694 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 64/127] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:13:01 2022] GET /compute/v2.1/servers/703acb74-65e6-4a60-9dd0-bf986498889e => generated 1322 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:13:02.065777 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.policy [None req-b150a145-9a03-493f-bbf6-472dee9bd668 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '471dc5c1db64411ab1d80ad6c038e519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb44f62fa62e46528712f24479cbb19f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120798) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:13:02.073773 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [None req-b150a145-9a03-493f-bbf6-472dee9bd668 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] 10.222.0.17 "GET /compute/v2.1/servers/057628ba-a74f-426e-ba25-a3b79c3b6339" status: 200 len: 1298 microversion: 2.1 time: 0.081788 Aug 23 07:13:02.074338 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 64/128] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:13:01 2022] GET /compute/v2.1/servers/057628ba-a74f-426e-ba25-a3b79c3b6339 => generated 1298 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:13:03.012557 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-8adda34f-ae3d-4f59-a9b5-b8a7d5c96667 tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] Calling method '>' {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:13:03.013949 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.compute.api [None req-8adda34f-ae3d-4f59-a9b5-b8a7d5c96667 tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] [instance: 9d984b5d-f788-4a4c-8609-471747c44fb8] Fetching instance by UUID {{(pid=120799) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:13:03.021386 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-8adda34f-ae3d-4f59-a9b5-b8a7d5c96667 tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:13:03.021852 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-8adda34f-ae3d-4f59-a9b5-b8a7d5c96667 tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:13:03.022270 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-8adda34f-ae3d-4f59-a9b5-b8a7d5c96667 tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:13:03.022942 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-8adda34f-ae3d-4f59-a9b5-b8a7d5c96667 tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:13:03.023377 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-8adda34f-ae3d-4f59-a9b5-b8a7d5c96667 tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:13:03.023812 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-8adda34f-ae3d-4f59-a9b5-b8a7d5c96667 tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:13:03.050918 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-fad67510-46be-41f1-9c70-398b0511a7dd tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Calling method '>' {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:13:03.052415 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.compute.api [None req-fad67510-46be-41f1-9c70-398b0511a7dd tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] [instance: 703acb74-65e6-4a60-9dd0-bf986498889e] Fetching instance by UUID {{(pid=120798) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:13:03.070582 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-fad67510-46be-41f1-9c70-398b0511a7dd tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:13:03.071460 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-fad67510-46be-41f1-9c70-398b0511a7dd tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:13:03.072444 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-fad67510-46be-41f1-9c70-398b0511a7dd tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:13:03.073248 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-fad67510-46be-41f1-9c70-398b0511a7dd tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:13:03.073771 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-fad67510-46be-41f1-9c70-398b0511a7dd tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:13:03.074665 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-fad67510-46be-41f1-9c70-398b0511a7dd tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:13:03.229496 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.policy [None req-8adda34f-ae3d-4f59-a9b5-b8a7d5c96667 tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cbcc9668f454c0e8c27495a1827d703', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24307daab4d24f979c30e081163c3bfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120799) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:13:03.239942 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-8adda34f-ae3d-4f59-a9b5-b8a7d5c96667 tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] 10.222.0.17 "GET /compute/v2.1/servers/9d984b5d-f788-4a4c-8609-471747c44fb8" status: 200 len: 1315 microversion: 2.1 time: 0.232070 Aug 23 07:13:03.256946 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 65/129] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:13:03 2022] GET /compute/v2.1/servers/9d984b5d-f788-4a4c-8609-471747c44fb8 => generated 1315 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:13:03.272085 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-80b61d76-433e-45fe-b957-61ec7962f0dc tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Calling method '>' {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:13:03.277718 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.policy [None req-fad67510-46be-41f1-9c70-398b0511a7dd tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64d54cb95b264c18b45d90822507fae1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135367be6e3f4b3d965ee0d99fdca524', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120798) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:13:03.283306 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.compute.api [None req-80b61d76-433e-45fe-b957-61ec7962f0dc tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] [instance: 057628ba-a74f-426e-ba25-a3b79c3b6339] Fetching instance by UUID {{(pid=120799) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:13:03.288113 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [None req-fad67510-46be-41f1-9c70-398b0511a7dd tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] 10.222.0.17 "GET /compute/v2.1/servers/703acb74-65e6-4a60-9dd0-bf986498889e" status: 200 len: 1322 microversion: 2.1 time: 0.243624 Aug 23 07:13:03.289123 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 65/130] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:13:03 2022] GET /compute/v2.1/servers/703acb74-65e6-4a60-9dd0-bf986498889e => generated 1322 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 07:13:03.294245 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-80b61d76-433e-45fe-b957-61ec7962f0dc tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:13:03.295059 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-80b61d76-433e-45fe-b957-61ec7962f0dc tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:13:03.296160 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-80b61d76-433e-45fe-b957-61ec7962f0dc tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:13:03.297211 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-80b61d76-433e-45fe-b957-61ec7962f0dc tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:13:03.298415 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-80b61d76-433e-45fe-b957-61ec7962f0dc tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:13:03.299338 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-80b61d76-433e-45fe-b957-61ec7962f0dc tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:13:03.525570 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.policy [None req-80b61d76-433e-45fe-b957-61ec7962f0dc tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '471dc5c1db64411ab1d80ad6c038e519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb44f62fa62e46528712f24479cbb19f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120799) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:13:03.542344 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-80b61d76-433e-45fe-b957-61ec7962f0dc tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] 10.222.0.17 "GET /compute/v2.1/servers/057628ba-a74f-426e-ba25-a3b79c3b6339" status: 200 len: 1365 microversion: 2.1 time: 0.273092 Aug 23 07:13:03.542975 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 66/131] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:13:03 2022] GET /compute/v2.1/servers/057628ba-a74f-426e-ba25-a3b79c3b6339 => generated 1365 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:13:04.272292 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-406eba9b-4c03-41b3-acb2-2e2a112c858e tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] Calling method '>' {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:13:04.273162 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.compute.api [None req-406eba9b-4c03-41b3-acb2-2e2a112c858e tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] [instance: 9d984b5d-f788-4a4c-8609-471747c44fb8] Fetching instance by UUID {{(pid=120798) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:13:04.291498 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-406eba9b-4c03-41b3-acb2-2e2a112c858e tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:13:04.295799 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-406eba9b-4c03-41b3-acb2-2e2a112c858e tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:13:04.296445 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-406eba9b-4c03-41b3-acb2-2e2a112c858e tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:13:04.299257 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-406eba9b-4c03-41b3-acb2-2e2a112c858e tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:13:04.301957 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-406eba9b-4c03-41b3-acb2-2e2a112c858e tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:13:04.303101 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-406eba9b-4c03-41b3-acb2-2e2a112c858e tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:13:04.309140 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-c7c73ed2-bfac-431d-9514-922a185bd77a tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Calling method '>' {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:13:04.309709 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.compute.api [None req-c7c73ed2-bfac-431d-9514-922a185bd77a tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] [instance: 703acb74-65e6-4a60-9dd0-bf986498889e] Fetching instance by UUID {{(pid=120799) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:13:04.325601 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-c7c73ed2-bfac-431d-9514-922a185bd77a tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:13:04.326103 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-c7c73ed2-bfac-431d-9514-922a185bd77a tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:13:04.330787 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-c7c73ed2-bfac-431d-9514-922a185bd77a tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:13:04.334288 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-c7c73ed2-bfac-431d-9514-922a185bd77a tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:13:04.334771 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-c7c73ed2-bfac-431d-9514-922a185bd77a tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:13:04.335235 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-c7c73ed2-bfac-431d-9514-922a185bd77a tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:13:05.031103 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.policy [None req-c7c73ed2-bfac-431d-9514-922a185bd77a tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64d54cb95b264c18b45d90822507fae1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135367be6e3f4b3d965ee0d99fdca524', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120799) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:13:05.045806 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-c7c73ed2-bfac-431d-9514-922a185bd77a tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] 10.222.0.17 "GET /compute/v2.1/servers/703acb74-65e6-4a60-9dd0-bf986498889e" status: 200 len: 1322 microversion: 2.1 time: 0.740520 Aug 23 07:13:05.046769 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 67/132] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:13:04 2022] GET /compute/v2.1/servers/703acb74-65e6-4a60-9dd0-bf986498889e => generated 1322 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:13:05.052073 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-64ccf33c-dfed-4835-8514-9589be6da212 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Calling method '>' {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:13:05.052665 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.compute.api [None req-64ccf33c-dfed-4835-8514-9589be6da212 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] [instance: 057628ba-a74f-426e-ba25-a3b79c3b6339] Fetching instance by UUID {{(pid=120799) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:13:05.064476 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-64ccf33c-dfed-4835-8514-9589be6da212 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:13:05.065266 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-64ccf33c-dfed-4835-8514-9589be6da212 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:13:05.065927 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-64ccf33c-dfed-4835-8514-9589be6da212 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:13:05.067046 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-64ccf33c-dfed-4835-8514-9589be6da212 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:13:05.067894 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-64ccf33c-dfed-4835-8514-9589be6da212 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:13:05.068645 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-64ccf33c-dfed-4835-8514-9589be6da212 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:13:05.127467 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.policy [None req-406eba9b-4c03-41b3-acb2-2e2a112c858e tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cbcc9668f454c0e8c27495a1827d703', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24307daab4d24f979c30e081163c3bfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120798) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:13:05.137788 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [None req-406eba9b-4c03-41b3-acb2-2e2a112c858e tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] 10.222.0.17 "GET /compute/v2.1/servers/9d984b5d-f788-4a4c-8609-471747c44fb8" status: 200 len: 1315 microversion: 2.1 time: 0.869429 Aug 23 07:13:05.138575 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 66/133] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:13:04 2022] GET /compute/v2.1/servers/9d984b5d-f788-4a4c-8609-471747c44fb8 => generated 1315 bytes in 871 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:13:05.143777 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [req-745878ca-fe9d-4637-bc4f-6d331bf1d282 req-f6ce2d00-b292-4c11-85fb-370c7adaa9bd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "057628ba-a74f-426e-ba25-a3b79c3b6339", "tag": "0d1372d3-3c3c-42c8-a793-154da2463304"}]} {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 07:13:05.154552 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [req-745878ca-fe9d-4637-bc4f-6d331bf1d282 req-f6ce2d00-b292-4c11-85fb-370c7adaa9bd service nova] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:13:05.156057 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [req-745878ca-fe9d-4637-bc4f-6d331bf1d282 req-f6ce2d00-b292-4c11-85fb-370c7adaa9bd service nova] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:13:05.156920 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [req-745878ca-fe9d-4637-bc4f-6d331bf1d282 req-f6ce2d00-b292-4c11-85fb-370c7adaa9bd service nova] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:13:05.169517 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.compute.server_external_events [req-745878ca-fe9d-4637-bc4f-6d331bf1d282 req-f6ce2d00-b292-4c11-85fb-370c7adaa9bd service nova] Creating event network-changed:0d1372d3-3c3c-42c8-a793-154da2463304 for instance 057628ba-a74f-426e-ba25-a3b79c3b6339 on hv-cinder-85409 Aug 23 07:13:05.174843 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [req-745878ca-fe9d-4637-bc4f-6d331bf1d282 req-f6ce2d00-b292-4c11-85fb-370c7adaa9bd service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034348 Aug 23 07:13:05.175801 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 67/134] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Aug 23 07:13:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 07:13:05.316125 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.policy [None req-64ccf33c-dfed-4835-8514-9589be6da212 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '471dc5c1db64411ab1d80ad6c038e519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb44f62fa62e46528712f24479cbb19f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120799) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:13:05.325442 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-64ccf33c-dfed-4835-8514-9589be6da212 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] 10.222.0.17 "GET /compute/v2.1/servers/057628ba-a74f-426e-ba25-a3b79c3b6339" status: 200 len: 1365 microversion: 2.1 time: 0.277385 Aug 23 07:13:05.326490 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 68/135] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:13:05 2022] GET /compute/v2.1/servers/057628ba-a74f-426e-ba25-a3b79c3b6339 => generated 1365 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:13:06.067781 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-e5693b31-56f5-400a-ba4d-a91b92ecb51f tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Calling method '>' {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:13:06.069336 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.compute.api [None req-e5693b31-56f5-400a-ba4d-a91b92ecb51f tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] [instance: 703acb74-65e6-4a60-9dd0-bf986498889e] Fetching instance by UUID {{(pid=120798) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:13:06.077500 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-e5693b31-56f5-400a-ba4d-a91b92ecb51f tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:13:06.078414 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-e5693b31-56f5-400a-ba4d-a91b92ecb51f tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:13:06.079068 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-e5693b31-56f5-400a-ba4d-a91b92ecb51f tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:13:06.079850 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-e5693b31-56f5-400a-ba4d-a91b92ecb51f tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:13:06.080361 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-e5693b31-56f5-400a-ba4d-a91b92ecb51f tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:13:06.080833 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-e5693b31-56f5-400a-ba4d-a91b92ecb51f tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:13:06.161661 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-ecc91a3b-2843-4b71-a65b-6587a8f591fa tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] Calling method '>' {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:13:06.162596 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.compute.api [None req-ecc91a3b-2843-4b71-a65b-6587a8f591fa tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] [instance: 9d984b5d-f788-4a4c-8609-471747c44fb8] Fetching instance by UUID {{(pid=120799) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:13:06.177330 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-ecc91a3b-2843-4b71-a65b-6587a8f591fa tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:13:06.178793 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-ecc91a3b-2843-4b71-a65b-6587a8f591fa tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:13:06.179518 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-ecc91a3b-2843-4b71-a65b-6587a8f591fa tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:13:06.180576 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-ecc91a3b-2843-4b71-a65b-6587a8f591fa tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:13:06.181817 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-ecc91a3b-2843-4b71-a65b-6587a8f591fa tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:13:06.182595 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-ecc91a3b-2843-4b71-a65b-6587a8f591fa tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:13:06.303768 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.policy [None req-e5693b31-56f5-400a-ba4d-a91b92ecb51f tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64d54cb95b264c18b45d90822507fae1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135367be6e3f4b3d965ee0d99fdca524', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120798) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:13:06.311894 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [None req-e5693b31-56f5-400a-ba4d-a91b92ecb51f tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] 10.222.0.17 "GET /compute/v2.1/servers/703acb74-65e6-4a60-9dd0-bf986498889e" status: 200 len: 1322 microversion: 2.1 time: 0.249221 Aug 23 07:13:06.319568 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 68/136] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:13:06 2022] GET /compute/v2.1/servers/703acb74-65e6-4a60-9dd0-bf986498889e => generated 1322 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:13:06.346085 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-a7f3e53a-2aec-4bae-977b-5d9659d4c2fe tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Calling method '>' {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:13:06.347324 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.compute.api [None req-a7f3e53a-2aec-4bae-977b-5d9659d4c2fe tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] [instance: 057628ba-a74f-426e-ba25-a3b79c3b6339] Fetching instance by UUID {{(pid=120798) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:13:06.358635 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-a7f3e53a-2aec-4bae-977b-5d9659d4c2fe tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:13:06.359116 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-a7f3e53a-2aec-4bae-977b-5d9659d4c2fe tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:13:06.359697 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-a7f3e53a-2aec-4bae-977b-5d9659d4c2fe tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:13:06.360487 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-a7f3e53a-2aec-4bae-977b-5d9659d4c2fe tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:13:06.360961 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-a7f3e53a-2aec-4bae-977b-5d9659d4c2fe tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:13:06.361372 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-a7f3e53a-2aec-4bae-977b-5d9659d4c2fe tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:13:06.404925 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.policy [None req-ecc91a3b-2843-4b71-a65b-6587a8f591fa tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cbcc9668f454c0e8c27495a1827d703', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24307daab4d24f979c30e081163c3bfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120799) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:13:06.414645 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-ecc91a3b-2843-4b71-a65b-6587a8f591fa tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] 10.222.0.17 "GET /compute/v2.1/servers/9d984b5d-f788-4a4c-8609-471747c44fb8" status: 200 len: 1315 microversion: 2.1 time: 0.259283 Aug 23 07:13:06.416315 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 69/137] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:13:06 2022] GET /compute/v2.1/servers/9d984b5d-f788-4a4c-8609-471747c44fb8 => generated 1315 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:13:06.525346 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.policy [None req-a7f3e53a-2aec-4bae-977b-5d9659d4c2fe tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '471dc5c1db64411ab1d80ad6c038e519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb44f62fa62e46528712f24479cbb19f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120798) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:13:06.533439 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [None req-a7f3e53a-2aec-4bae-977b-5d9659d4c2fe tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] 10.222.0.17 "GET /compute/v2.1/servers/057628ba-a74f-426e-ba25-a3b79c3b6339" status: 200 len: 1365 microversion: 2.1 time: 0.191145 Aug 23 07:13:06.546867 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 69/138] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:13:06 2022] GET /compute/v2.1/servers/057628ba-a74f-426e-ba25-a3b79c3b6339 => generated 1365 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 07:13:07.335369 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-a7a6f5f5-1f98-4190-8546-23bcd15acecc tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Calling method '>' {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:13:07.336176 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.compute.api [None req-a7a6f5f5-1f98-4190-8546-23bcd15acecc tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] [instance: 703acb74-65e6-4a60-9dd0-bf986498889e] Fetching instance by UUID {{(pid=120799) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:13:07.344748 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-a7a6f5f5-1f98-4190-8546-23bcd15acecc tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:13:07.345585 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-a7a6f5f5-1f98-4190-8546-23bcd15acecc tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:13:07.346076 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-a7a6f5f5-1f98-4190-8546-23bcd15acecc tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:13:07.347963 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-a7a6f5f5-1f98-4190-8546-23bcd15acecc tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:13:07.348601 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-a7a6f5f5-1f98-4190-8546-23bcd15acecc tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:13:07.349082 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-a7a6f5f5-1f98-4190-8546-23bcd15acecc tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:13:07.438010 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-44cf4800-6db1-4ef7-bf32-c316a6cd6c5e tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] Calling method '>' {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:13:07.438710 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.compute.api [None req-44cf4800-6db1-4ef7-bf32-c316a6cd6c5e tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] [instance: 9d984b5d-f788-4a4c-8609-471747c44fb8] Fetching instance by UUID {{(pid=120798) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:13:07.445827 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-44cf4800-6db1-4ef7-bf32-c316a6cd6c5e tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:13:07.446304 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-44cf4800-6db1-4ef7-bf32-c316a6cd6c5e tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:13:07.446727 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-44cf4800-6db1-4ef7-bf32-c316a6cd6c5e tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:13:07.448693 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-44cf4800-6db1-4ef7-bf32-c316a6cd6c5e tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:13:07.449151 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-44cf4800-6db1-4ef7-bf32-c316a6cd6c5e tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:13:07.449570 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-44cf4800-6db1-4ef7-bf32-c316a6cd6c5e tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:13:07.812493 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.policy [None req-a7a6f5f5-1f98-4190-8546-23bcd15acecc tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64d54cb95b264c18b45d90822507fae1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135367be6e3f4b3d965ee0d99fdca524', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120799) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:13:07.841603 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-a7a6f5f5-1f98-4190-8546-23bcd15acecc tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] 10.222.0.17 "GET /compute/v2.1/servers/703acb74-65e6-4a60-9dd0-bf986498889e" status: 200 len: 1322 microversion: 2.1 time: 0.511269 Aug 23 07:13:07.842981 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 70/139] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:13:07 2022] GET /compute/v2.1/servers/703acb74-65e6-4a60-9dd0-bf986498889e => generated 1322 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:13:07.851307 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.policy [None req-44cf4800-6db1-4ef7-bf32-c316a6cd6c5e tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cbcc9668f454c0e8c27495a1827d703', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24307daab4d24f979c30e081163c3bfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120798) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:13:07.856519 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-a0fde866-a154-46bf-805d-8a3752dc2e9c tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Calling method '>' {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:13:07.857347 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.compute.api [None req-a0fde866-a154-46bf-805d-8a3752dc2e9c tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] [instance: 057628ba-a74f-426e-ba25-a3b79c3b6339] Fetching instance by UUID {{(pid=120799) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:13:07.865083 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [None req-44cf4800-6db1-4ef7-bf32-c316a6cd6c5e tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] 10.222.0.17 "GET /compute/v2.1/servers/9d984b5d-f788-4a4c-8609-471747c44fb8" status: 200 len: 1315 microversion: 2.1 time: 0.431783 Aug 23 07:13:07.865690 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 70/140] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:13:07 2022] GET /compute/v2.1/servers/9d984b5d-f788-4a4c-8609-471747c44fb8 => generated 1315 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 07:13:07.886081 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-a0fde866-a154-46bf-805d-8a3752dc2e9c tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:13:07.886081 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-a0fde866-a154-46bf-805d-8a3752dc2e9c tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:13:07.886081 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-a0fde866-a154-46bf-805d-8a3752dc2e9c tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:13:07.886081 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-a0fde866-a154-46bf-805d-8a3752dc2e9c tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:13:07.886791 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-a0fde866-a154-46bf-805d-8a3752dc2e9c tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:13:07.886791 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-a0fde866-a154-46bf-805d-8a3752dc2e9c tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:13:07.894306 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG dbcounter [-] [120799] Writing DB stats nova_cell1:SELECT=100 {{(pid=120799) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:13:07.970659 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [req-470c1302-7ab5-4044-bc3a-3ac2a32ce357 req-c898ce97-265e-4345-a30b-20298e8e2b2a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9d984b5d-f788-4a4c-8609-471747c44fb8", "name": "network-vif-plugged", "status": "completed", "tag": "4994a4df-b092-4dfd-afa6-ad9a86dd2c2b"}]} {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 07:13:08.055370 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [req-470c1302-7ab5-4044-bc3a-3ac2a32ce357 req-c898ce97-265e-4345-a30b-20298e8e2b2a service nova] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:13:08.056362 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [req-470c1302-7ab5-4044-bc3a-3ac2a32ce357 req-c898ce97-265e-4345-a30b-20298e8e2b2a service nova] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:13:08.060521 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [req-470c1302-7ab5-4044-bc3a-3ac2a32ce357 req-c898ce97-265e-4345-a30b-20298e8e2b2a service nova] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:13:08.116990 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.compute.server_external_events [req-470c1302-7ab5-4044-bc3a-3ac2a32ce357 req-c898ce97-265e-4345-a30b-20298e8e2b2a service nova] Creating event network-vif-plugged:4994a4df-b092-4dfd-afa6-ad9a86dd2c2b for instance 9d984b5d-f788-4a4c-8609-471747c44fb8 on hv-cinder-85409 Aug 23 07:13:08.132333 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [req-470c1302-7ab5-4044-bc3a-3ac2a32ce357 req-c898ce97-265e-4345-a30b-20298e8e2b2a service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.170165 Aug 23 07:13:08.133845 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 71/141] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Aug 23 07:13:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 07:13:08.512421 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.policy [None req-a0fde866-a154-46bf-805d-8a3752dc2e9c tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '471dc5c1db64411ab1d80ad6c038e519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb44f62fa62e46528712f24479cbb19f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120799) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:13:08.519976 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-a0fde866-a154-46bf-805d-8a3752dc2e9c tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] 10.222.0.17 "GET /compute/v2.1/servers/057628ba-a74f-426e-ba25-a3b79c3b6339" status: 200 len: 1365 microversion: 2.1 time: 0.675831 Aug 23 07:13:08.520537 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 71/142] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:13:07 2022] GET /compute/v2.1/servers/057628ba-a74f-426e-ba25-a3b79c3b6339 => generated 1365 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:13:08.884623 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-9904d55e-3735-44be-81a2-be5f1c2cf0d9 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Calling method '>' {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:13:08.884623 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.compute.api [None req-9904d55e-3735-44be-81a2-be5f1c2cf0d9 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] [instance: 703acb74-65e6-4a60-9dd0-bf986498889e] Fetching instance by UUID {{(pid=120798) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:13:08.884623 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-9904d55e-3735-44be-81a2-be5f1c2cf0d9 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:13:08.884623 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-9904d55e-3735-44be-81a2-be5f1c2cf0d9 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:13:08.885315 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-9904d55e-3735-44be-81a2-be5f1c2cf0d9 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:13:08.885958 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-9904d55e-3735-44be-81a2-be5f1c2cf0d9 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:13:08.891173 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-07dbcf9a-4a1f-4496-8e12-7f7090b35f3f tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] Calling method '>' {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:13:08.891808 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.compute.api [None req-07dbcf9a-4a1f-4496-8e12-7f7090b35f3f tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] [instance: 9d984b5d-f788-4a4c-8609-471747c44fb8] Fetching instance by UUID {{(pid=120799) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:13:08.898456 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-07dbcf9a-4a1f-4496-8e12-7f7090b35f3f tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:13:08.899027 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-9904d55e-3735-44be-81a2-be5f1c2cf0d9 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:13:08.899586 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-9904d55e-3735-44be-81a2-be5f1c2cf0d9 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:13:08.903872 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-07dbcf9a-4a1f-4496-8e12-7f7090b35f3f tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:13:08.904380 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-07dbcf9a-4a1f-4496-8e12-7f7090b35f3f tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:13:08.905396 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-07dbcf9a-4a1f-4496-8e12-7f7090b35f3f tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:13:08.905867 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-07dbcf9a-4a1f-4496-8e12-7f7090b35f3f tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:13:08.906382 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-07dbcf9a-4a1f-4496-8e12-7f7090b35f3f tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:13:09.163146 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.policy [None req-9904d55e-3735-44be-81a2-be5f1c2cf0d9 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64d54cb95b264c18b45d90822507fae1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135367be6e3f4b3d965ee0d99fdca524', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120798) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:13:09.174098 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [None req-9904d55e-3735-44be-81a2-be5f1c2cf0d9 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] 10.222.0.17 "GET /compute/v2.1/servers/703acb74-65e6-4a60-9dd0-bf986498889e" status: 200 len: 1322 microversion: 2.1 time: 0.309834 Aug 23 07:13:09.180638 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 72/143] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:13:08 2022] GET /compute/v2.1/servers/703acb74-65e6-4a60-9dd0-bf986498889e => generated 1322 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:13:09.190566 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.policy [None req-07dbcf9a-4a1f-4496-8e12-7f7090b35f3f tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cbcc9668f454c0e8c27495a1827d703', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24307daab4d24f979c30e081163c3bfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120799) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:13:09.202807 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-07dbcf9a-4a1f-4496-8e12-7f7090b35f3f tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] 10.222.0.17 "GET /compute/v2.1/servers/9d984b5d-f788-4a4c-8609-471747c44fb8" status: 200 len: 1315 microversion: 2.1 time: 0.315367 Aug 23 07:13:09.204253 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 72/144] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:13:08 2022] GET /compute/v2.1/servers/9d984b5d-f788-4a4c-8609-471747c44fb8 => generated 1315 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 07:13:09.542345 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-1b5f6b8e-4302-4dca-9606-752544c6e96b tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Calling method '>' {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:13:09.543033 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.compute.api [None req-1b5f6b8e-4302-4dca-9606-752544c6e96b tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] [instance: 057628ba-a74f-426e-ba25-a3b79c3b6339] Fetching instance by UUID {{(pid=120798) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:13:09.551242 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-1b5f6b8e-4302-4dca-9606-752544c6e96b tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:13:09.553694 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-1b5f6b8e-4302-4dca-9606-752544c6e96b tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:13:09.554145 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-1b5f6b8e-4302-4dca-9606-752544c6e96b tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:13:09.556730 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-1b5f6b8e-4302-4dca-9606-752544c6e96b tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:13:09.560345 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-1b5f6b8e-4302-4dca-9606-752544c6e96b tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:13:09.562186 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-1b5f6b8e-4302-4dca-9606-752544c6e96b tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:13:10.152008 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.policy [None req-1b5f6b8e-4302-4dca-9606-752544c6e96b tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '471dc5c1db64411ab1d80ad6c038e519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb44f62fa62e46528712f24479cbb19f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120798) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:13:10.161777 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [None req-1b5f6b8e-4302-4dca-9606-752544c6e96b tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] 10.222.0.17 "GET /compute/v2.1/servers/057628ba-a74f-426e-ba25-a3b79c3b6339" status: 200 len: 1365 microversion: 2.1 time: 0.623800 Aug 23 07:13:10.162349 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 73/145] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:13:09 2022] GET /compute/v2.1/servers/057628ba-a74f-426e-ba25-a3b79c3b6339 => generated 1365 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:13:10.200644 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-55d3bf01-b77d-4439-8ef6-fffa4ae80794 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Calling method '>' {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:13:10.202577 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.compute.api [None req-55d3bf01-b77d-4439-8ef6-fffa4ae80794 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] [instance: 703acb74-65e6-4a60-9dd0-bf986498889e] Fetching instance by UUID {{(pid=120799) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:13:10.210454 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-55d3bf01-b77d-4439-8ef6-fffa4ae80794 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:13:10.211150 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-55d3bf01-b77d-4439-8ef6-fffa4ae80794 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:13:10.211786 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-55d3bf01-b77d-4439-8ef6-fffa4ae80794 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:13:10.212757 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-55d3bf01-b77d-4439-8ef6-fffa4ae80794 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:13:10.213414 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-55d3bf01-b77d-4439-8ef6-fffa4ae80794 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:13:10.214060 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-55d3bf01-b77d-4439-8ef6-fffa4ae80794 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:13:10.230852 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-607c307e-b221-4d35-97e0-b1e0e8271125 tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] Calling method '>' {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:13:10.231614 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.compute.api [None req-607c307e-b221-4d35-97e0-b1e0e8271125 tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] [instance: 9d984b5d-f788-4a4c-8609-471747c44fb8] Fetching instance by UUID {{(pid=120798) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:13:10.241262 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-607c307e-b221-4d35-97e0-b1e0e8271125 tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:13:10.242615 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-607c307e-b221-4d35-97e0-b1e0e8271125 tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:13:10.247440 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-607c307e-b221-4d35-97e0-b1e0e8271125 tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:13:10.248314 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-607c307e-b221-4d35-97e0-b1e0e8271125 tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:13:10.248875 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-607c307e-b221-4d35-97e0-b1e0e8271125 tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:13:10.249416 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-607c307e-b221-4d35-97e0-b1e0e8271125 tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:13:10.458611 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.policy [None req-55d3bf01-b77d-4439-8ef6-fffa4ae80794 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64d54cb95b264c18b45d90822507fae1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135367be6e3f4b3d965ee0d99fdca524', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120799) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:13:10.473492 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-55d3bf01-b77d-4439-8ef6-fffa4ae80794 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] 10.222.0.17 "GET /compute/v2.1/servers/703acb74-65e6-4a60-9dd0-bf986498889e" status: 200 len: 1322 microversion: 2.1 time: 0.275467 Aug 23 07:13:10.478119 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 73/146] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:13:10 2022] GET /compute/v2.1/servers/703acb74-65e6-4a60-9dd0-bf986498889e => generated 1322 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:13:10.504371 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.policy [None req-607c307e-b221-4d35-97e0-b1e0e8271125 tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cbcc9668f454c0e8c27495a1827d703', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24307daab4d24f979c30e081163c3bfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120798) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:13:10.513469 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [None req-607c307e-b221-4d35-97e0-b1e0e8271125 tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] 10.222.0.17 "GET /compute/v2.1/servers/9d984b5d-f788-4a4c-8609-471747c44fb8" status: 200 len: 1315 microversion: 2.1 time: 0.287050 Aug 23 07:13:10.514310 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 74/147] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:13:10 2022] GET /compute/v2.1/servers/9d984b5d-f788-4a4c-8609-471747c44fb8 => generated 1315 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:13:11.183572 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-63b53366-7ef7-40b7-8ea8-7e9326ea012d tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Calling method '>' {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:13:11.184399 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.compute.api [None req-63b53366-7ef7-40b7-8ea8-7e9326ea012d tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] [instance: 057628ba-a74f-426e-ba25-a3b79c3b6339] Fetching instance by UUID {{(pid=120799) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:13:11.191354 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-63b53366-7ef7-40b7-8ea8-7e9326ea012d tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:13:11.191929 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-63b53366-7ef7-40b7-8ea8-7e9326ea012d tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:13:11.192557 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-63b53366-7ef7-40b7-8ea8-7e9326ea012d tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:13:11.193375 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-63b53366-7ef7-40b7-8ea8-7e9326ea012d tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:13:11.193894 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-63b53366-7ef7-40b7-8ea8-7e9326ea012d tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:13:11.194376 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-63b53366-7ef7-40b7-8ea8-7e9326ea012d tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:13:11.334464 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.policy [None req-63b53366-7ef7-40b7-8ea8-7e9326ea012d tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '471dc5c1db64411ab1d80ad6c038e519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb44f62fa62e46528712f24479cbb19f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120799) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:13:11.342375 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-63b53366-7ef7-40b7-8ea8-7e9326ea012d tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] 10.222.0.17 "GET /compute/v2.1/servers/057628ba-a74f-426e-ba25-a3b79c3b6339" status: 200 len: 1365 microversion: 2.1 time: 0.164207 Aug 23 07:13:11.343108 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 74/148] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:13:11 2022] GET /compute/v2.1/servers/057628ba-a74f-426e-ba25-a3b79c3b6339 => generated 1365 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:13:11.498472 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-41b7bc4b-f725-44bc-abd5-8dcbc27c91e9 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Calling method '>' {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:13:11.499217 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.compute.api [None req-41b7bc4b-f725-44bc-abd5-8dcbc27c91e9 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] [instance: 703acb74-65e6-4a60-9dd0-bf986498889e] Fetching instance by UUID {{(pid=120798) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:13:11.506464 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-41b7bc4b-f725-44bc-abd5-8dcbc27c91e9 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:13:11.507062 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-41b7bc4b-f725-44bc-abd5-8dcbc27c91e9 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:13:11.507658 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-41b7bc4b-f725-44bc-abd5-8dcbc27c91e9 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:13:11.508379 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-41b7bc4b-f725-44bc-abd5-8dcbc27c91e9 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:13:11.509028 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-41b7bc4b-f725-44bc-abd5-8dcbc27c91e9 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:13:11.509406 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-41b7bc4b-f725-44bc-abd5-8dcbc27c91e9 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:13:11.537323 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-0945cb00-e6b1-4551-8ad0-5526aa79335d tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] Calling method '>' {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:13:11.538009 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.compute.api [None req-0945cb00-e6b1-4551-8ad0-5526aa79335d tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] [instance: 9d984b5d-f788-4a4c-8609-471747c44fb8] Fetching instance by UUID {{(pid=120799) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:13:11.546027 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG dbcounter [-] [120799] Writing DB stats nova_api:SELECT=78 {{(pid=120799) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:13:11.547945 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-0945cb00-e6b1-4551-8ad0-5526aa79335d tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:13:11.548566 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-0945cb00-e6b1-4551-8ad0-5526aa79335d tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:13:11.549242 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-0945cb00-e6b1-4551-8ad0-5526aa79335d tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:13:11.549877 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-0945cb00-e6b1-4551-8ad0-5526aa79335d tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:13:11.550515 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-0945cb00-e6b1-4551-8ad0-5526aa79335d tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:13:11.551058 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-0945cb00-e6b1-4551-8ad0-5526aa79335d tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:13:11.718937 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.policy [None req-41b7bc4b-f725-44bc-abd5-8dcbc27c91e9 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64d54cb95b264c18b45d90822507fae1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135367be6e3f4b3d965ee0d99fdca524', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120798) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:13:11.727013 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [None req-41b7bc4b-f725-44bc-abd5-8dcbc27c91e9 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] 10.222.0.17 "GET /compute/v2.1/servers/703acb74-65e6-4a60-9dd0-bf986498889e" status: 200 len: 1322 microversion: 2.1 time: 0.232123 Aug 23 07:13:11.730652 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 75/149] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:13:11 2022] GET /compute/v2.1/servers/703acb74-65e6-4a60-9dd0-bf986498889e => generated 1322 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:13:11.754080 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.policy [None req-0945cb00-e6b1-4551-8ad0-5526aa79335d tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cbcc9668f454c0e8c27495a1827d703', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24307daab4d24f979c30e081163c3bfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120799) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:13:11.762314 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-0945cb00-e6b1-4551-8ad0-5526aa79335d tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] 10.222.0.17 "GET /compute/v2.1/servers/9d984b5d-f788-4a4c-8609-471747c44fb8" status: 200 len: 1315 microversion: 2.1 time: 0.230656 Aug 23 07:13:11.763454 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 75/150] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:13:11 2022] GET /compute/v2.1/servers/9d984b5d-f788-4a4c-8609-471747c44fb8 => generated 1315 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:13:12.363090 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-96c2535d-9d07-4f7d-ab4e-48eecabad150 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Calling method '>' {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:13:12.363951 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.compute.api [None req-96c2535d-9d07-4f7d-ab4e-48eecabad150 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] [instance: 057628ba-a74f-426e-ba25-a3b79c3b6339] Fetching instance by UUID {{(pid=120798) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:13:12.371301 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-96c2535d-9d07-4f7d-ab4e-48eecabad150 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:13:12.372096 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-96c2535d-9d07-4f7d-ab4e-48eecabad150 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:13:12.372518 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-96c2535d-9d07-4f7d-ab4e-48eecabad150 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:13:12.373238 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-96c2535d-9d07-4f7d-ab4e-48eecabad150 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:13:12.373682 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-96c2535d-9d07-4f7d-ab4e-48eecabad150 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:13:12.374093 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-96c2535d-9d07-4f7d-ab4e-48eecabad150 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:13:12.527118 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.policy [None req-96c2535d-9d07-4f7d-ab4e-48eecabad150 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '471dc5c1db64411ab1d80ad6c038e519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb44f62fa62e46528712f24479cbb19f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120798) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:13:12.535560 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [None req-96c2535d-9d07-4f7d-ab4e-48eecabad150 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] 10.222.0.17 "GET /compute/v2.1/servers/057628ba-a74f-426e-ba25-a3b79c3b6339" status: 200 len: 1365 microversion: 2.1 time: 0.176202 Aug 23 07:13:12.536128 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 76/151] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:13:12 2022] GET /compute/v2.1/servers/057628ba-a74f-426e-ba25-a3b79c3b6339 => generated 1365 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:13:12.756480 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-84f74776-8bdd-409a-8977-5b9eab6a6014 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Calling method '>' {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:13:12.760078 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.compute.api [None req-84f74776-8bdd-409a-8977-5b9eab6a6014 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] [instance: 703acb74-65e6-4a60-9dd0-bf986498889e] Fetching instance by UUID {{(pid=120799) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:13:12.768631 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-84f74776-8bdd-409a-8977-5b9eab6a6014 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:13:12.773840 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-84f74776-8bdd-409a-8977-5b9eab6a6014 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:13:12.774437 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-84f74776-8bdd-409a-8977-5b9eab6a6014 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:13:12.775539 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-84f74776-8bdd-409a-8977-5b9eab6a6014 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:13:12.778455 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-84f74776-8bdd-409a-8977-5b9eab6a6014 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:13:12.779158 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-84f74776-8bdd-409a-8977-5b9eab6a6014 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:13:12.787106 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-1f3fa650-414a-4406-94ba-9beabb5e56aa tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] Calling method '>' {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:13:12.788001 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.compute.api [None req-1f3fa650-414a-4406-94ba-9beabb5e56aa tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] [instance: 9d984b5d-f788-4a4c-8609-471747c44fb8] Fetching instance by UUID {{(pid=120798) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:13:12.797639 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-1f3fa650-414a-4406-94ba-9beabb5e56aa tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:13:12.798393 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-1f3fa650-414a-4406-94ba-9beabb5e56aa tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:13:12.799143 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-1f3fa650-414a-4406-94ba-9beabb5e56aa tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:13:12.800127 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-1f3fa650-414a-4406-94ba-9beabb5e56aa tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:13:12.800739 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-1f3fa650-414a-4406-94ba-9beabb5e56aa tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:13:12.809904 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-1f3fa650-414a-4406-94ba-9beabb5e56aa tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:13:13.042280 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.policy [None req-84f74776-8bdd-409a-8977-5b9eab6a6014 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64d54cb95b264c18b45d90822507fae1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135367be6e3f4b3d965ee0d99fdca524', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120799) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:13:13.056653 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.policy [None req-1f3fa650-414a-4406-94ba-9beabb5e56aa tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cbcc9668f454c0e8c27495a1827d703', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24307daab4d24f979c30e081163c3bfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120798) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:13:13.066413 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [None req-1f3fa650-414a-4406-94ba-9beabb5e56aa tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] 10.222.0.17 "GET /compute/v2.1/servers/9d984b5d-f788-4a4c-8609-471747c44fb8" status: 200 len: 1315 microversion: 2.1 time: 0.286395 Aug 23 07:13:13.066958 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-84f74776-8bdd-409a-8977-5b9eab6a6014 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] 10.222.0.17 "GET /compute/v2.1/servers/703acb74-65e6-4a60-9dd0-bf986498889e" status: 200 len: 1322 microversion: 2.1 time: 0.322946 Aug 23 07:13:13.067537 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 77/152] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:13:12 2022] GET /compute/v2.1/servers/9d984b5d-f788-4a4c-8609-471747c44fb8 => generated 1315 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:13:13.075445 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 76/153] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:13:12 2022] GET /compute/v2.1/servers/703acb74-65e6-4a60-9dd0-bf986498889e => generated 1322 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:13:13.557019 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-181662dd-c015-44b7-b399-f33e0ae7369c tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Calling method '>' {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:13:13.558080 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.compute.api [None req-181662dd-c015-44b7-b399-f33e0ae7369c tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] [instance: 057628ba-a74f-426e-ba25-a3b79c3b6339] Fetching instance by UUID {{(pid=120798) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:13:13.564270 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-181662dd-c015-44b7-b399-f33e0ae7369c tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:13:13.564745 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-181662dd-c015-44b7-b399-f33e0ae7369c tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:13:13.565173 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-181662dd-c015-44b7-b399-f33e0ae7369c tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:13:13.565856 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-181662dd-c015-44b7-b399-f33e0ae7369c tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:13:13.566477 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-181662dd-c015-44b7-b399-f33e0ae7369c tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:13:13.567039 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-181662dd-c015-44b7-b399-f33e0ae7369c tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:13:13.764619 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.policy [None req-181662dd-c015-44b7-b399-f33e0ae7369c tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '471dc5c1db64411ab1d80ad6c038e519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb44f62fa62e46528712f24479cbb19f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120798) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:13:13.774672 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [None req-181662dd-c015-44b7-b399-f33e0ae7369c tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] 10.222.0.17 "GET /compute/v2.1/servers/057628ba-a74f-426e-ba25-a3b79c3b6339" status: 200 len: 1365 microversion: 2.1 time: 0.221084 Aug 23 07:13:13.776734 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 78/154] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:13:13 2022] GET /compute/v2.1/servers/057628ba-a74f-426e-ba25-a3b79c3b6339 => generated 1365 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 07:13:14.087759 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-fdd3ada2-826c-4686-8747-4b394c0db09b tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Calling method '>' {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:13:14.088707 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.compute.api [None req-fdd3ada2-826c-4686-8747-4b394c0db09b tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] [instance: 703acb74-65e6-4a60-9dd0-bf986498889e] Fetching instance by UUID {{(pid=120799) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:13:14.092496 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-2d09f4f3-a510-4068-9521-ed5fb4bf8b91 tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] Calling method '>' {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:13:14.093376 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.compute.api [None req-2d09f4f3-a510-4068-9521-ed5fb4bf8b91 tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] [instance: 9d984b5d-f788-4a4c-8609-471747c44fb8] Fetching instance by UUID {{(pid=120798) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:13:14.094595 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-fdd3ada2-826c-4686-8747-4b394c0db09b tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:13:14.095251 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-fdd3ada2-826c-4686-8747-4b394c0db09b tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:13:14.095681 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-fdd3ada2-826c-4686-8747-4b394c0db09b tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:13:14.096505 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-fdd3ada2-826c-4686-8747-4b394c0db09b tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:13:14.097132 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-fdd3ada2-826c-4686-8747-4b394c0db09b tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:13:14.097603 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-fdd3ada2-826c-4686-8747-4b394c0db09b tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:13:14.099940 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-2d09f4f3-a510-4068-9521-ed5fb4bf8b91 tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:13:14.100500 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-2d09f4f3-a510-4068-9521-ed5fb4bf8b91 tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:13:14.101188 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-2d09f4f3-a510-4068-9521-ed5fb4bf8b91 tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:13:14.102002 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-2d09f4f3-a510-4068-9521-ed5fb4bf8b91 tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:13:14.102525 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-2d09f4f3-a510-4068-9521-ed5fb4bf8b91 tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:13:14.103132 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-2d09f4f3-a510-4068-9521-ed5fb4bf8b91 tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:13:14.466214 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.policy [None req-fdd3ada2-826c-4686-8747-4b394c0db09b tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64d54cb95b264c18b45d90822507fae1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135367be6e3f4b3d965ee0d99fdca524', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120799) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:13:14.474061 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-fdd3ada2-826c-4686-8747-4b394c0db09b tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] 10.222.0.17 "GET /compute/v2.1/servers/703acb74-65e6-4a60-9dd0-bf986498889e" status: 200 len: 1322 microversion: 2.1 time: 0.390409 Aug 23 07:13:14.474875 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 77/155] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:13:14 2022] GET /compute/v2.1/servers/703acb74-65e6-4a60-9dd0-bf986498889e => generated 1322 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:13:14.477005 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.policy [None req-2d09f4f3-a510-4068-9521-ed5fb4bf8b91 tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cbcc9668f454c0e8c27495a1827d703', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24307daab4d24f979c30e081163c3bfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120798) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:13:14.485256 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [None req-2d09f4f3-a510-4068-9521-ed5fb4bf8b91 tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] 10.222.0.17 "GET /compute/v2.1/servers/9d984b5d-f788-4a4c-8609-471747c44fb8" status: 200 len: 1315 microversion: 2.1 time: 0.397947 Aug 23 07:13:14.485798 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 79/156] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:13:14 2022] GET /compute/v2.1/servers/9d984b5d-f788-4a4c-8609-471747c44fb8 => generated 1315 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 07:13:14.797124 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-f46b9a1f-67d3-4822-be1c-9ee6c04dc4d9 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Calling method '>' {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:13:14.797726 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.compute.api [None req-f46b9a1f-67d3-4822-be1c-9ee6c04dc4d9 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] [instance: 057628ba-a74f-426e-ba25-a3b79c3b6339] Fetching instance by UUID {{(pid=120799) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:13:14.803848 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-f46b9a1f-67d3-4822-be1c-9ee6c04dc4d9 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:13:14.804344 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-f46b9a1f-67d3-4822-be1c-9ee6c04dc4d9 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:13:14.804769 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-f46b9a1f-67d3-4822-be1c-9ee6c04dc4d9 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:13:14.805446 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-f46b9a1f-67d3-4822-be1c-9ee6c04dc4d9 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:13:14.805918 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-f46b9a1f-67d3-4822-be1c-9ee6c04dc4d9 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:13:14.806491 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-f46b9a1f-67d3-4822-be1c-9ee6c04dc4d9 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:13:14.941474 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.policy [None req-f46b9a1f-67d3-4822-be1c-9ee6c04dc4d9 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '471dc5c1db64411ab1d80ad6c038e519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb44f62fa62e46528712f24479cbb19f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120799) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:13:14.949824 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-f46b9a1f-67d3-4822-be1c-9ee6c04dc4d9 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] 10.222.0.17 "GET /compute/v2.1/servers/057628ba-a74f-426e-ba25-a3b79c3b6339" status: 200 len: 1365 microversion: 2.1 time: 0.156700 Aug 23 07:13:14.950396 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 78/157] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:13:14 2022] GET /compute/v2.1/servers/057628ba-a74f-426e-ba25-a3b79c3b6339 => generated 1365 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:13:15.495783 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-09fead01-a6a3-4ebe-b7bf-f2738888847b tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Calling method '>' {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:13:15.496466 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.compute.api [None req-09fead01-a6a3-4ebe-b7bf-f2738888847b tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] [instance: 703acb74-65e6-4a60-9dd0-bf986498889e] Fetching instance by UUID {{(pid=120798) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:13:15.504327 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-09fead01-a6a3-4ebe-b7bf-f2738888847b tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:13:15.504881 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-09fead01-a6a3-4ebe-b7bf-f2738888847b tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:13:15.505376 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-09fead01-a6a3-4ebe-b7bf-f2738888847b tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:13:15.505932 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-9f8f1ad2-6505-4a59-a264-fcea461734f5 tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] Calling method '>' {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:13:15.506364 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-09fead01-a6a3-4ebe-b7bf-f2738888847b tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:13:15.506530 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.compute.api [None req-9f8f1ad2-6505-4a59-a264-fcea461734f5 tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] [instance: 9d984b5d-f788-4a4c-8609-471747c44fb8] Fetching instance by UUID {{(pid=120799) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:13:15.506729 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-09fead01-a6a3-4ebe-b7bf-f2738888847b tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:13:15.507226 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-09fead01-a6a3-4ebe-b7bf-f2738888847b tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:13:15.512136 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG dbcounter [-] [120798] Writing DB stats nova_cell1:SELECT=100 {{(pid=120798) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:13:15.513322 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-9f8f1ad2-6505-4a59-a264-fcea461734f5 tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:13:15.513782 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-9f8f1ad2-6505-4a59-a264-fcea461734f5 tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:13:15.514222 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-9f8f1ad2-6505-4a59-a264-fcea461734f5 tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:13:15.514916 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-9f8f1ad2-6505-4a59-a264-fcea461734f5 tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:13:15.515381 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-9f8f1ad2-6505-4a59-a264-fcea461734f5 tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:13:15.516182 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-9f8f1ad2-6505-4a59-a264-fcea461734f5 tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:13:15.738427 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.policy [None req-9f8f1ad2-6505-4a59-a264-fcea461734f5 tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cbcc9668f454c0e8c27495a1827d703', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24307daab4d24f979c30e081163c3bfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120799) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:13:15.744083 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.policy [None req-09fead01-a6a3-4ebe-b7bf-f2738888847b tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64d54cb95b264c18b45d90822507fae1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135367be6e3f4b3d965ee0d99fdca524', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120798) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:13:15.749257 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-9f8f1ad2-6505-4a59-a264-fcea461734f5 tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] 10.222.0.17 "GET /compute/v2.1/servers/9d984b5d-f788-4a4c-8609-471747c44fb8" status: 200 len: 1315 microversion: 2.1 time: 0.246941 Aug 23 07:13:15.753871 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [None req-09fead01-a6a3-4ebe-b7bf-f2738888847b tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] 10.222.0.17 "GET /compute/v2.1/servers/703acb74-65e6-4a60-9dd0-bf986498889e" status: 200 len: 1322 microversion: 2.1 time: 0.262098 Aug 23 07:13:15.764124 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 79/158] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:13:15 2022] GET /compute/v2.1/servers/9d984b5d-f788-4a4c-8609-471747c44fb8 => generated 1315 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:13:15.767352 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 80/159] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:13:15 2022] GET /compute/v2.1/servers/703acb74-65e6-4a60-9dd0-bf986498889e => generated 1322 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:13:15.974465 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-d4c59352-45e5-4324-ad5a-7a2c15930e2c tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Calling method '>' {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:13:15.975073 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.compute.api [None req-d4c59352-45e5-4324-ad5a-7a2c15930e2c tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] [instance: 057628ba-a74f-426e-ba25-a3b79c3b6339] Fetching instance by UUID {{(pid=120799) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:13:15.981331 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-d4c59352-45e5-4324-ad5a-7a2c15930e2c tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:13:15.981851 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-d4c59352-45e5-4324-ad5a-7a2c15930e2c tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:13:15.982395 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-d4c59352-45e5-4324-ad5a-7a2c15930e2c tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:13:15.983161 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-d4c59352-45e5-4324-ad5a-7a2c15930e2c tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:13:15.983856 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-d4c59352-45e5-4324-ad5a-7a2c15930e2c tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:13:15.984322 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-d4c59352-45e5-4324-ad5a-7a2c15930e2c tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:13:16.145524 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.policy [None req-d4c59352-45e5-4324-ad5a-7a2c15930e2c tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '471dc5c1db64411ab1d80ad6c038e519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb44f62fa62e46528712f24479cbb19f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120799) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:13:16.156617 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-d4c59352-45e5-4324-ad5a-7a2c15930e2c tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] 10.222.0.17 "GET /compute/v2.1/servers/057628ba-a74f-426e-ba25-a3b79c3b6339" status: 200 len: 1365 microversion: 2.1 time: 0.188234 Aug 23 07:13:16.157463 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 80/160] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:13:15 2022] GET /compute/v2.1/servers/057628ba-a74f-426e-ba25-a3b79c3b6339 => generated 1365 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:13:16.771018 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-ae267afd-7b7a-4035-8e6f-e7be27717aa6 tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] Calling method '>' {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:13:16.771877 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.compute.api [None req-ae267afd-7b7a-4035-8e6f-e7be27717aa6 tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] [instance: 9d984b5d-f788-4a4c-8609-471747c44fb8] Fetching instance by UUID {{(pid=120798) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:13:16.778771 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-ae267afd-7b7a-4035-8e6f-e7be27717aa6 tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:13:16.779290 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-ae267afd-7b7a-4035-8e6f-e7be27717aa6 tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:13:16.779774 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-ae267afd-7b7a-4035-8e6f-e7be27717aa6 tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:13:16.780630 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-ae267afd-7b7a-4035-8e6f-e7be27717aa6 tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:13:16.781080 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-ae267afd-7b7a-4035-8e6f-e7be27717aa6 tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:13:16.781490 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-ae267afd-7b7a-4035-8e6f-e7be27717aa6 tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:13:16.784747 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-ff07947c-6da0-4306-920d-28ac1ed2efb8 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Calling method '>' {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:13:16.785933 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.compute.api [None req-ff07947c-6da0-4306-920d-28ac1ed2efb8 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] [instance: 703acb74-65e6-4a60-9dd0-bf986498889e] Fetching instance by UUID {{(pid=120799) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:13:16.796228 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-ff07947c-6da0-4306-920d-28ac1ed2efb8 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:13:16.798398 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-ff07947c-6da0-4306-920d-28ac1ed2efb8 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:13:16.798848 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-ff07947c-6da0-4306-920d-28ac1ed2efb8 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:13:16.806585 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-ff07947c-6da0-4306-920d-28ac1ed2efb8 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:13:16.807248 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-ff07947c-6da0-4306-920d-28ac1ed2efb8 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:13:16.807968 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-ff07947c-6da0-4306-920d-28ac1ed2efb8 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:13:17.007199 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.policy [None req-ae267afd-7b7a-4035-8e6f-e7be27717aa6 tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cbcc9668f454c0e8c27495a1827d703', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24307daab4d24f979c30e081163c3bfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120798) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:13:17.013883 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.policy [None req-ff07947c-6da0-4306-920d-28ac1ed2efb8 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64d54cb95b264c18b45d90822507fae1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135367be6e3f4b3d965ee0d99fdca524', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120799) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:13:17.019107 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [None req-ae267afd-7b7a-4035-8e6f-e7be27717aa6 tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] 10.222.0.17 "GET /compute/v2.1/servers/9d984b5d-f788-4a4c-8609-471747c44fb8" status: 200 len: 1315 microversion: 2.1 time: 0.252425 Aug 23 07:13:17.022216 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-ff07947c-6da0-4306-920d-28ac1ed2efb8 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] 10.222.0.17 "GET /compute/v2.1/servers/703acb74-65e6-4a60-9dd0-bf986498889e" status: 200 len: 1322 microversion: 2.1 time: 0.252108 Aug 23 07:13:17.022736 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 81/161] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:13:16 2022] GET /compute/v2.1/servers/703acb74-65e6-4a60-9dd0-bf986498889e => generated 1322 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:13:17.034200 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 81/162] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:13:16 2022] GET /compute/v2.1/servers/9d984b5d-f788-4a4c-8609-471747c44fb8 => generated 1315 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:13:17.186612 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-60d5012c-0ae4-4a0e-bd48-89cb26096726 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Calling method '>' {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:13:17.187232 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.compute.api [None req-60d5012c-0ae4-4a0e-bd48-89cb26096726 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] [instance: 057628ba-a74f-426e-ba25-a3b79c3b6339] Fetching instance by UUID {{(pid=120799) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:13:17.193852 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-60d5012c-0ae4-4a0e-bd48-89cb26096726 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:13:17.194474 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-60d5012c-0ae4-4a0e-bd48-89cb26096726 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:13:17.194757 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-60d5012c-0ae4-4a0e-bd48-89cb26096726 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:13:17.195452 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-60d5012c-0ae4-4a0e-bd48-89cb26096726 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:13:17.196051 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-60d5012c-0ae4-4a0e-bd48-89cb26096726 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:13:17.196462 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-60d5012c-0ae4-4a0e-bd48-89cb26096726 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:13:17.378780 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.policy [None req-60d5012c-0ae4-4a0e-bd48-89cb26096726 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '471dc5c1db64411ab1d80ad6c038e519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb44f62fa62e46528712f24479cbb19f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120799) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:13:17.395517 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-60d5012c-0ae4-4a0e-bd48-89cb26096726 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] 10.222.0.17 "GET /compute/v2.1/servers/057628ba-a74f-426e-ba25-a3b79c3b6339" status: 200 len: 1365 microversion: 2.1 time: 0.221760 Aug 23 07:13:17.399487 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 82/163] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:13:17 2022] GET /compute/v2.1/servers/057628ba-a74f-426e-ba25-a3b79c3b6339 => generated 1365 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:13:18.043947 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-e716787d-6730-42c1-b296-da1a30c95ee8 tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] Calling method '>' {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:13:18.044552 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.compute.api [None req-e716787d-6730-42c1-b296-da1a30c95ee8 tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] [instance: 9d984b5d-f788-4a4c-8609-471747c44fb8] Fetching instance by UUID {{(pid=120798) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:13:18.055543 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-42501bd1-8cae-43e2-b6ee-36f7d5855c31 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Calling method '>' {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:13:18.056226 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-e716787d-6730-42c1-b296-da1a30c95ee8 tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:13:18.056328 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-e716787d-6730-42c1-b296-da1a30c95ee8 tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:13:18.056966 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-e716787d-6730-42c1-b296-da1a30c95ee8 tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:13:18.057103 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.compute.api [None req-42501bd1-8cae-43e2-b6ee-36f7d5855c31 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] [instance: 703acb74-65e6-4a60-9dd0-bf986498889e] Fetching instance by UUID {{(pid=120799) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:13:18.058458 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-e716787d-6730-42c1-b296-da1a30c95ee8 tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:13:18.059264 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-e716787d-6730-42c1-b296-da1a30c95ee8 tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:13:18.060167 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-e716787d-6730-42c1-b296-da1a30c95ee8 tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:13:18.067057 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-42501bd1-8cae-43e2-b6ee-36f7d5855c31 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:13:18.067586 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-42501bd1-8cae-43e2-b6ee-36f7d5855c31 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:13:18.068174 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-42501bd1-8cae-43e2-b6ee-36f7d5855c31 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:13:18.069019 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-42501bd1-8cae-43e2-b6ee-36f7d5855c31 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:13:18.069611 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-42501bd1-8cae-43e2-b6ee-36f7d5855c31 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:13:18.070194 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-42501bd1-8cae-43e2-b6ee-36f7d5855c31 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:13:18.299719 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.policy [None req-e716787d-6730-42c1-b296-da1a30c95ee8 tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cbcc9668f454c0e8c27495a1827d703', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24307daab4d24f979c30e081163c3bfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120798) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:13:18.309001 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.policy [None req-42501bd1-8cae-43e2-b6ee-36f7d5855c31 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64d54cb95b264c18b45d90822507fae1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135367be6e3f4b3d965ee0d99fdca524', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120799) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:13:18.309424 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [None req-e716787d-6730-42c1-b296-da1a30c95ee8 tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] 10.222.0.17 "GET /compute/v2.1/servers/9d984b5d-f788-4a4c-8609-471747c44fb8" status: 200 len: 1501 microversion: 2.1 time: 0.270794 Aug 23 07:13:18.310230 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 82/164] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:13:18 2022] GET /compute/v2.1/servers/9d984b5d-f788-4a4c-8609-471747c44fb8 => generated 1501 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:13:18.316020 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [req-1189147e-5a96-42c2-be63-1f3de10c2d98 req-bd24f561-3262-4a2b-885a-cc9475ae5b48 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "703acb74-65e6-4a60-9dd0-bf986498889e", "name": "network-vif-plugged", "status": "completed", "tag": "713d5b4f-c65f-4843-862f-a75e5cbe6db4"}]} {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 07:13:18.330307 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [req-1189147e-5a96-42c2-be63-1f3de10c2d98 req-bd24f561-3262-4a2b-885a-cc9475ae5b48 service nova] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:13:18.330960 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [req-1189147e-5a96-42c2-be63-1f3de10c2d98 req-bd24f561-3262-4a2b-885a-cc9475ae5b48 service nova] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:13:18.332327 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [req-1189147e-5a96-42c2-be63-1f3de10c2d98 req-bd24f561-3262-4a2b-885a-cc9475ae5b48 service nova] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:13:18.351159 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.compute.server_external_events [req-1189147e-5a96-42c2-be63-1f3de10c2d98 req-bd24f561-3262-4a2b-885a-cc9475ae5b48 service nova] Creating event network-vif-plugged:713d5b4f-c65f-4843-862f-a75e5cbe6db4 for instance 703acb74-65e6-4a60-9dd0-bf986498889e on hv-cinder-85409 Aug 23 07:13:18.352830 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-42501bd1-8cae-43e2-b6ee-36f7d5855c31 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] 10.222.0.17 "GET /compute/v2.1/servers/703acb74-65e6-4a60-9dd0-bf986498889e" status: 200 len: 1322 microversion: 2.1 time: 0.301381 Aug 23 07:13:18.355217 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 83/165] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:13:18 2022] GET /compute/v2.1/servers/703acb74-65e6-4a60-9dd0-bf986498889e => generated 1322 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 07:13:18.377523 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [req-1189147e-5a96-42c2-be63-1f3de10c2d98 req-bd24f561-3262-4a2b-885a-cc9475ae5b48 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065529 Aug 23 07:13:18.378206 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 83/166] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Aug 23 07:13:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 07:13:18.417979 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-c250b8e4-6e94-4aa9-9f1d-760071df772e tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Calling method '>' {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:13:18.419488 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.compute.api [None req-c250b8e4-6e94-4aa9-9f1d-760071df772e tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] [instance: 057628ba-a74f-426e-ba25-a3b79c3b6339] Fetching instance by UUID {{(pid=120799) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:13:18.429315 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-c250b8e4-6e94-4aa9-9f1d-760071df772e tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:13:18.429795 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-c250b8e4-6e94-4aa9-9f1d-760071df772e tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:13:18.430408 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-c250b8e4-6e94-4aa9-9f1d-760071df772e tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:13:18.431476 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-c250b8e4-6e94-4aa9-9f1d-760071df772e tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:13:18.432060 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-c250b8e4-6e94-4aa9-9f1d-760071df772e tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:13:18.432628 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-c250b8e4-6e94-4aa9-9f1d-760071df772e tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:13:18.630099 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.policy [None req-c250b8e4-6e94-4aa9-9f1d-760071df772e tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '471dc5c1db64411ab1d80ad6c038e519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb44f62fa62e46528712f24479cbb19f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120799) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:13:18.638024 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-c250b8e4-6e94-4aa9-9f1d-760071df772e tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] 10.222.0.17 "GET /compute/v2.1/servers/057628ba-a74f-426e-ba25-a3b79c3b6339" status: 200 len: 1365 microversion: 2.1 time: 0.224309 Aug 23 07:13:18.638639 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 84/167] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:13:18 2022] GET /compute/v2.1/servers/057628ba-a74f-426e-ba25-a3b79c3b6339 => generated 1365 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:13:19.388315 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-11e90f8f-3f86-4296-8c67-5660689b0543 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Calling method '>' {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:13:19.389466 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.compute.api [None req-11e90f8f-3f86-4296-8c67-5660689b0543 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] [instance: 703acb74-65e6-4a60-9dd0-bf986498889e] Fetching instance by UUID {{(pid=120798) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:13:19.401258 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-11e90f8f-3f86-4296-8c67-5660689b0543 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:13:19.402110 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-11e90f8f-3f86-4296-8c67-5660689b0543 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:13:19.402676 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-11e90f8f-3f86-4296-8c67-5660689b0543 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:13:19.403608 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-11e90f8f-3f86-4296-8c67-5660689b0543 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:13:19.404422 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-11e90f8f-3f86-4296-8c67-5660689b0543 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:13:19.405182 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-11e90f8f-3f86-4296-8c67-5660689b0543 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:13:19.541396 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.policy [None req-11e90f8f-3f86-4296-8c67-5660689b0543 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64d54cb95b264c18b45d90822507fae1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135367be6e3f4b3d965ee0d99fdca524', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120798) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:13:19.549301 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [None req-11e90f8f-3f86-4296-8c67-5660689b0543 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] 10.222.0.17 "GET /compute/v2.1/servers/703acb74-65e6-4a60-9dd0-bf986498889e" status: 200 len: 1322 microversion: 2.1 time: 0.168337 Aug 23 07:13:19.549878 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 84/168] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:13:19 2022] GET /compute/v2.1/servers/703acb74-65e6-4a60-9dd0-bf986498889e => generated 1322 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:13:19.659238 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-9636a294-30b3-451b-b3e7-fb245766ddb7 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Calling method '>' {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:13:19.659872 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.compute.api [None req-9636a294-30b3-451b-b3e7-fb245766ddb7 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] [instance: 057628ba-a74f-426e-ba25-a3b79c3b6339] Fetching instance by UUID {{(pid=120799) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:13:19.666196 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-9636a294-30b3-451b-b3e7-fb245766ddb7 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:13:19.666774 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-9636a294-30b3-451b-b3e7-fb245766ddb7 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:13:19.672311 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-9636a294-30b3-451b-b3e7-fb245766ddb7 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:13:19.672311 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-9636a294-30b3-451b-b3e7-fb245766ddb7 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:13:19.672311 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-9636a294-30b3-451b-b3e7-fb245766ddb7 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:13:19.672311 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-9636a294-30b3-451b-b3e7-fb245766ddb7 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:13:19.799649 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.policy [None req-9636a294-30b3-451b-b3e7-fb245766ddb7 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '471dc5c1db64411ab1d80ad6c038e519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb44f62fa62e46528712f24479cbb19f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120799) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:13:19.809606 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-9636a294-30b3-451b-b3e7-fb245766ddb7 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] 10.222.0.17 "GET /compute/v2.1/servers/057628ba-a74f-426e-ba25-a3b79c3b6339" status: 200 len: 1365 microversion: 2.1 time: 0.154362 Aug 23 07:13:19.810194 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 85/169] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:13:19 2022] GET /compute/v2.1/servers/057628ba-a74f-426e-ba25-a3b79c3b6339 => generated 1365 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:13:20.401335 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [req-9cb58d2a-8db7-4a9b-9a93-91f85f05e699 req-acbc98f1-9331-4eef-b80a-0b34f7d6b32e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "057628ba-a74f-426e-ba25-a3b79c3b6339", "name": "network-vif-plugged", "status": "completed", "tag": "0d1372d3-3c3c-42c8-a793-154da2463304"}]} {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 07:13:20.417188 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [req-9cb58d2a-8db7-4a9b-9a93-91f85f05e699 req-acbc98f1-9331-4eef-b80a-0b34f7d6b32e service nova] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:13:20.417653 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [req-9cb58d2a-8db7-4a9b-9a93-91f85f05e699 req-acbc98f1-9331-4eef-b80a-0b34f7d6b32e service nova] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:13:20.418067 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [req-9cb58d2a-8db7-4a9b-9a93-91f85f05e699 req-acbc98f1-9331-4eef-b80a-0b34f7d6b32e service nova] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:13:20.431081 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.compute.server_external_events [req-9cb58d2a-8db7-4a9b-9a93-91f85f05e699 req-acbc98f1-9331-4eef-b80a-0b34f7d6b32e service nova] Creating event network-vif-plugged:0d1372d3-3c3c-42c8-a793-154da2463304 for instance 057628ba-a74f-426e-ba25-a3b79c3b6339 on hv-cinder-85409 Aug 23 07:13:20.437276 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [req-9cb58d2a-8db7-4a9b-9a93-91f85f05e699 req-acbc98f1-9331-4eef-b80a-0b34f7d6b32e service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042483 Aug 23 07:13:20.437864 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 85/170] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Aug 23 07:13:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 07:13:20.573378 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-37234670-8478-4c7a-a58b-feacbb9cf006 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Calling method '>' {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:13:20.574013 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.compute.api [None req-37234670-8478-4c7a-a58b-feacbb9cf006 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] [instance: 703acb74-65e6-4a60-9dd0-bf986498889e] Fetching instance by UUID {{(pid=120799) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:13:20.580916 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-37234670-8478-4c7a-a58b-feacbb9cf006 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:13:20.581699 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-37234670-8478-4c7a-a58b-feacbb9cf006 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:13:20.582191 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-37234670-8478-4c7a-a58b-feacbb9cf006 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:13:20.582906 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-37234670-8478-4c7a-a58b-feacbb9cf006 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:13:20.583375 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-37234670-8478-4c7a-a58b-feacbb9cf006 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:13:20.583852 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-37234670-8478-4c7a-a58b-feacbb9cf006 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:13:20.718700 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.policy [None req-37234670-8478-4c7a-a58b-feacbb9cf006 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64d54cb95b264c18b45d90822507fae1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135367be6e3f4b3d965ee0d99fdca524', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120799) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:13:20.728915 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-37234670-8478-4c7a-a58b-feacbb9cf006 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] 10.222.0.17 "GET /compute/v2.1/servers/703acb74-65e6-4a60-9dd0-bf986498889e" status: 200 len: 1322 microversion: 2.1 time: 0.161442 Aug 23 07:13:20.729447 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 86/171] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:13:20 2022] GET /compute/v2.1/servers/703acb74-65e6-4a60-9dd0-bf986498889e => generated 1322 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:13:20.832386 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-de256d3e-2e78-4c79-85f0-85ceb3208002 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Calling method '>' {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:13:20.833069 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.compute.api [None req-de256d3e-2e78-4c79-85f0-85ceb3208002 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] [instance: 057628ba-a74f-426e-ba25-a3b79c3b6339] Fetching instance by UUID {{(pid=120798) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:13:20.840078 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-de256d3e-2e78-4c79-85f0-85ceb3208002 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:13:20.840555 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-de256d3e-2e78-4c79-85f0-85ceb3208002 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:13:20.840981 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-de256d3e-2e78-4c79-85f0-85ceb3208002 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:13:20.841652 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-de256d3e-2e78-4c79-85f0-85ceb3208002 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:13:20.842090 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-de256d3e-2e78-4c79-85f0-85ceb3208002 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:13:20.842505 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-de256d3e-2e78-4c79-85f0-85ceb3208002 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:13:20.986955 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.policy [None req-de256d3e-2e78-4c79-85f0-85ceb3208002 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '471dc5c1db64411ab1d80ad6c038e519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb44f62fa62e46528712f24479cbb19f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120798) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:13:20.995364 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [None req-de256d3e-2e78-4c79-85f0-85ceb3208002 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] 10.222.0.17 "GET /compute/v2.1/servers/057628ba-a74f-426e-ba25-a3b79c3b6339" status: 200 len: 1365 microversion: 2.1 time: 0.167657 Aug 23 07:13:20.995959 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 86/172] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:13:20 2022] GET /compute/v2.1/servers/057628ba-a74f-426e-ba25-a3b79c3b6339 => generated 1365 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:13:21.750749 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-c3860545-257d-4e03-bc28-60be14d8d8d1 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Calling method '>' {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:13:21.751376 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.compute.api [None req-c3860545-257d-4e03-bc28-60be14d8d8d1 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] [instance: 703acb74-65e6-4a60-9dd0-bf986498889e] Fetching instance by UUID {{(pid=120799) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:13:21.758591 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-c3860545-257d-4e03-bc28-60be14d8d8d1 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:13:21.759064 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-c3860545-257d-4e03-bc28-60be14d8d8d1 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:13:21.759772 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-c3860545-257d-4e03-bc28-60be14d8d8d1 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:13:21.760984 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-c3860545-257d-4e03-bc28-60be14d8d8d1 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:13:21.761452 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-c3860545-257d-4e03-bc28-60be14d8d8d1 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:13:21.761873 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-c3860545-257d-4e03-bc28-60be14d8d8d1 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:13:21.917227 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.policy [None req-c3860545-257d-4e03-bc28-60be14d8d8d1 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64d54cb95b264c18b45d90822507fae1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135367be6e3f4b3d965ee0d99fdca524', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120799) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:13:21.919445 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG dbcounter [-] [120799] Writing DB stats nova_cell1:SELECT=100 {{(pid=120799) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:13:21.932122 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-c3860545-257d-4e03-bc28-60be14d8d8d1 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] 10.222.0.17 "GET /compute/v2.1/servers/703acb74-65e6-4a60-9dd0-bf986498889e" status: 200 len: 1322 microversion: 2.1 time: 0.185206 Aug 23 07:13:21.947934 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 87/173] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:13:21 2022] GET /compute/v2.1/servers/703acb74-65e6-4a60-9dd0-bf986498889e => generated 1322 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:13:22.015162 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-9189e089-4289-4682-99cb-3b4ee187fcc6 tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "434c2bd5-8518-4cb0-9468-5aa3dc6c8770"}} {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 07:13:22.017737 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.compute.api [None req-9189e089-4289-4682-99cb-3b4ee187fcc6 tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] [instance: 9d984b5d-f788-4a4c-8609-471747c44fb8] Fetching instance by UUID {{(pid=120798) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:13:22.026308 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG dbcounter [-] [120798] Writing DB stats nova_api:SELECT=72 {{(pid=120798) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:13:22.030215 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-9189e089-4289-4682-99cb-3b4ee187fcc6 tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:13:22.030824 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-9189e089-4289-4682-99cb-3b4ee187fcc6 tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:13:22.031351 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-9189e089-4289-4682-99cb-3b4ee187fcc6 tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:13:22.031572 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-25e6f46a-ab39-469e-87eb-52eefde74d2d tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Calling method '>' {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:13:22.032236 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.compute.api [None req-25e6f46a-ab39-469e-87eb-52eefde74d2d tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] [instance: 057628ba-a74f-426e-ba25-a3b79c3b6339] Fetching instance by UUID {{(pid=120799) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:13:22.038170 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-9189e089-4289-4682-99cb-3b4ee187fcc6 tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:13:22.038843 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-9189e089-4289-4682-99cb-3b4ee187fcc6 tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:13:22.039270 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-9189e089-4289-4682-99cb-3b4ee187fcc6 tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:13:22.055442 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-25e6f46a-ab39-469e-87eb-52eefde74d2d tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:13:22.057281 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-25e6f46a-ab39-469e-87eb-52eefde74d2d tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:13:22.057938 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-25e6f46a-ab39-469e-87eb-52eefde74d2d tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:13:22.058814 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-25e6f46a-ab39-469e-87eb-52eefde74d2d tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:13:22.059477 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-25e6f46a-ab39-469e-87eb-52eefde74d2d tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:13:22.060066 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-25e6f46a-ab39-469e-87eb-52eefde74d2d tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:13:22.227669 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.policy [None req-25e6f46a-ab39-469e-87eb-52eefde74d2d tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '471dc5c1db64411ab1d80ad6c038e519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb44f62fa62e46528712f24479cbb19f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120799) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:13:22.239966 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-25e6f46a-ab39-469e-87eb-52eefde74d2d tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] 10.222.0.17 "GET /compute/v2.1/servers/057628ba-a74f-426e-ba25-a3b79c3b6339" status: 200 len: 1365 microversion: 2.1 time: 0.217407 Aug 23 07:13:22.244427 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 88/174] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:13:22 2022] GET /compute/v2.1/servers/057628ba-a74f-426e-ba25-a3b79c3b6339 => generated 1365 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:13:22.959943 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-28a57e90-677b-4870-8dcd-8007866337f2 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Calling method '>' {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:13:22.960938 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.compute.api [None req-28a57e90-677b-4870-8dcd-8007866337f2 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] [instance: 703acb74-65e6-4a60-9dd0-bf986498889e] Fetching instance by UUID {{(pid=120799) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:13:22.972128 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-28a57e90-677b-4870-8dcd-8007866337f2 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:13:22.972710 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-28a57e90-677b-4870-8dcd-8007866337f2 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:13:22.973671 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-28a57e90-677b-4870-8dcd-8007866337f2 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:13:22.974525 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-28a57e90-677b-4870-8dcd-8007866337f2 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:13:22.975033 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-28a57e90-677b-4870-8dcd-8007866337f2 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:13:22.975635 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-28a57e90-677b-4870-8dcd-8007866337f2 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:13:23.193836 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.policy [None req-28a57e90-677b-4870-8dcd-8007866337f2 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64d54cb95b264c18b45d90822507fae1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135367be6e3f4b3d965ee0d99fdca524', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120799) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:13:23.202848 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-28a57e90-677b-4870-8dcd-8007866337f2 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] 10.222.0.17 "GET /compute/v2.1/servers/703acb74-65e6-4a60-9dd0-bf986498889e" status: 200 len: 1322 microversion: 2.1 time: 0.248626 Aug 23 07:13:23.203815 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 89/175] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:13:22 2022] GET /compute/v2.1/servers/703acb74-65e6-4a60-9dd0-bf986498889e => generated 1322 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:13:23.264690 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-1ba5ec86-b78b-4132-8a97-071d7bc6fa7d tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Calling method '>' {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:13:23.265296 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.compute.api [None req-1ba5ec86-b78b-4132-8a97-071d7bc6fa7d tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] [instance: 057628ba-a74f-426e-ba25-a3b79c3b6339] Fetching instance by UUID {{(pid=120799) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:13:23.273151 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-1ba5ec86-b78b-4132-8a97-071d7bc6fa7d tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:13:23.273933 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-1ba5ec86-b78b-4132-8a97-071d7bc6fa7d tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:13:23.275027 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-1ba5ec86-b78b-4132-8a97-071d7bc6fa7d tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:13:23.276354 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-1ba5ec86-b78b-4132-8a97-071d7bc6fa7d tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:13:23.277350 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-1ba5ec86-b78b-4132-8a97-071d7bc6fa7d tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:13:23.278172 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-1ba5ec86-b78b-4132-8a97-071d7bc6fa7d tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:13:23.489242 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.policy [None req-1ba5ec86-b78b-4132-8a97-071d7bc6fa7d tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '471dc5c1db64411ab1d80ad6c038e519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb44f62fa62e46528712f24479cbb19f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120799) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:13:23.501257 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-1ba5ec86-b78b-4132-8a97-071d7bc6fa7d tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] 10.222.0.17 "GET /compute/v2.1/servers/057628ba-a74f-426e-ba25-a3b79c3b6339" status: 200 len: 1555 microversion: 2.1 time: 0.241856 Aug 23 07:13:23.503545 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 90/176] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:13:23 2022] GET /compute/v2.1/servers/057628ba-a74f-426e-ba25-a3b79c3b6339 => generated 1555 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:13:23.527240 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-0e31751e-6bcc-4cbd-9a6f-4f59b3b0e702 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Calling method '>' {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:13:23.527728 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.compute.api [None req-0e31751e-6bcc-4cbd-9a6f-4f59b3b0e702 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] [instance: 057628ba-a74f-426e-ba25-a3b79c3b6339] Fetching instance by UUID {{(pid=120799) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:13:23.537261 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-0e31751e-6bcc-4cbd-9a6f-4f59b3b0e702 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:13:23.541124 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-0e31751e-6bcc-4cbd-9a6f-4f59b3b0e702 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:13:23.542090 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-0e31751e-6bcc-4cbd-9a6f-4f59b3b0e702 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:13:23.542830 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-0e31751e-6bcc-4cbd-9a6f-4f59b3b0e702 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:13:23.543484 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-0e31751e-6bcc-4cbd-9a6f-4f59b3b0e702 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:13:23.544121 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-0e31751e-6bcc-4cbd-9a6f-4f59b3b0e702 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:13:23.697139 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-0e31751e-6bcc-4cbd-9a6f-4f59b3b0e702 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] 10.222.0.17 "GET /compute/v2.1/servers/057628ba-a74f-426e-ba25-a3b79c3b6339/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.175774 Aug 23 07:13:23.697945 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 91/177] 10.222.0.17 () {58 vars in 1275 bytes} [Tue Aug 23 07:13:23 2022] GET /compute/v2.1/servers/057628ba-a74f-426e-ba25-a3b79c3b6339/os-interface => generated 284 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 07:13:24.231639 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-912e87cc-4c3d-4bc3-8769-c92ae2e4e2f7 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Calling method '>' {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:13:24.233454 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.compute.api [None req-912e87cc-4c3d-4bc3-8769-c92ae2e4e2f7 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] [instance: 703acb74-65e6-4a60-9dd0-bf986498889e] Fetching instance by UUID {{(pid=120799) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:13:24.268241 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-912e87cc-4c3d-4bc3-8769-c92ae2e4e2f7 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:13:24.279690 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-912e87cc-4c3d-4bc3-8769-c92ae2e4e2f7 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:13:24.280357 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-912e87cc-4c3d-4bc3-8769-c92ae2e4e2f7 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:13:24.281223 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-912e87cc-4c3d-4bc3-8769-c92ae2e4e2f7 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:13:24.283641 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-912e87cc-4c3d-4bc3-8769-c92ae2e4e2f7 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:13:24.284212 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-912e87cc-4c3d-4bc3-8769-c92ae2e4e2f7 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:13:24.440349 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [None req-9189e089-4289-4682-99cb-3b4ee187fcc6 tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] 10.222.0.17 "POST /compute/v2.1/servers/9d984b5d-f788-4a4c-8609-471747c44fb8/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.429687 Aug 23 07:13:24.447797 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 87/178] 10.222.0.17 () {60 vars in 1323 bytes} [Tue Aug 23 07:13:22 2022] POST /compute/v2.1/servers/9d984b5d-f788-4a4c-8609-471747c44fb8/os-volume_attachments => generated 194 bytes in 2438 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 07:13:25.086740 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.policy [None req-912e87cc-4c3d-4bc3-8769-c92ae2e4e2f7 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64d54cb95b264c18b45d90822507fae1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135367be6e3f4b3d965ee0d99fdca524', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120799) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:13:25.105394 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-912e87cc-4c3d-4bc3-8769-c92ae2e4e2f7 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] 10.222.0.17 "GET /compute/v2.1/servers/703acb74-65e6-4a60-9dd0-bf986498889e" status: 200 len: 1516 microversion: 2.1 time: 0.880998 Aug 23 07:13:25.106201 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 92/179] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:13:24 2022] GET /compute/v2.1/servers/703acb74-65e6-4a60-9dd0-bf986498889e => generated 1516 bytes in 883 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:13:25.135685 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-9d62e34d-92df-480f-8137-1a6bc55f7a20 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 07:13:25.140060 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.compute.api [None req-9d62e34d-92df-480f-8137-1a6bc55f7a20 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] [instance: 703acb74-65e6-4a60-9dd0-bf986498889e] Fetching instance by UUID {{(pid=120798) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:13:25.154856 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-9d62e34d-92df-480f-8137-1a6bc55f7a20 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:13:25.155572 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-9d62e34d-92df-480f-8137-1a6bc55f7a20 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:13:25.156158 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-9d62e34d-92df-480f-8137-1a6bc55f7a20 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:13:25.157025 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-9d62e34d-92df-480f-8137-1a6bc55f7a20 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:13:25.157615 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-9d62e34d-92df-480f-8137-1a6bc55f7a20 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:13:25.158324 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-9d62e34d-92df-480f-8137-1a6bc55f7a20 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:13:25.202647 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.objects.instance [None req-9d62e34d-92df-480f-8137-1a6bc55f7a20 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lazy-loading 'flavor' on Instance uuid 703acb74-65e6-4a60-9dd0-bf986498889e {{(pid=120798) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 07:13:25.431913 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [None req-9d62e34d-92df-480f-8137-1a6bc55f7a20 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] 10.222.0.17 "POST /compute/v2.1/servers/703acb74-65e6-4a60-9dd0-bf986498889e/action" status: 200 len: 32 microversion: 2.1 time: 0.302646 Aug 23 07:13:25.437261 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 88/180] 10.222.0.17 () {60 vars in 1278 bytes} [Tue Aug 23 07:13:25 2022] POST /compute/v2.1/servers/703acb74-65e6-4a60-9dd0-bf986498889e/action => generated 32 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 23 07:13:25.442020 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-748a69c4-65df-4024-8a7b-bddf8f406041 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Calling method '>' {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:13:25.442756 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.compute.api [None req-748a69c4-65df-4024-8a7b-bddf8f406041 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] [instance: 703acb74-65e6-4a60-9dd0-bf986498889e] Fetching instance by UUID {{(pid=120799) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:13:25.466764 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-748a69c4-65df-4024-8a7b-bddf8f406041 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:13:25.467323 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-748a69c4-65df-4024-8a7b-bddf8f406041 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:13:25.467815 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-748a69c4-65df-4024-8a7b-bddf8f406041 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:13:25.468646 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-748a69c4-65df-4024-8a7b-bddf8f406041 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:13:25.469122 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-748a69c4-65df-4024-8a7b-bddf8f406041 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:13:25.475807 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-748a69c4-65df-4024-8a7b-bddf8f406041 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:13:25.753358 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.policy [None req-748a69c4-65df-4024-8a7b-bddf8f406041 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64d54cb95b264c18b45d90822507fae1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135367be6e3f4b3d965ee0d99fdca524', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120799) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:13:25.763634 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-748a69c4-65df-4024-8a7b-bddf8f406041 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] 10.222.0.17 "GET /compute/v2.1/servers/703acb74-65e6-4a60-9dd0-bf986498889e" status: 200 len: 1522 microversion: 2.1 time: 0.325498 Aug 23 07:13:25.764224 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 93/181] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:13:25 2022] GET /compute/v2.1/servers/703acb74-65e6-4a60-9dd0-bf986498889e => generated 1522 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 07:13:26.049364 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [req-52169d99-71cd-40b8-8ed9-141183f80502 req-ae226d22-0c60-4f03-94db-e2b00f3ba361 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "057628ba-a74f-426e-ba25-a3b79c3b6339", "tag": "0d1372d3-3c3c-42c8-a793-154da2463304"}]} {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 07:13:26.072875 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [req-52169d99-71cd-40b8-8ed9-141183f80502 req-ae226d22-0c60-4f03-94db-e2b00f3ba361 service nova] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:13:26.073357 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [req-52169d99-71cd-40b8-8ed9-141183f80502 req-ae226d22-0c60-4f03-94db-e2b00f3ba361 service nova] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:13:26.073785 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [req-52169d99-71cd-40b8-8ed9-141183f80502 req-ae226d22-0c60-4f03-94db-e2b00f3ba361 service nova] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:13:26.133292 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.compute.server_external_events [req-52169d99-71cd-40b8-8ed9-141183f80502 req-ae226d22-0c60-4f03-94db-e2b00f3ba361 service nova] Creating event network-changed:0d1372d3-3c3c-42c8-a793-154da2463304 for instance 057628ba-a74f-426e-ba25-a3b79c3b6339 on hv-cinder-85409 Aug 23 07:13:26.148143 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [req-52169d99-71cd-40b8-8ed9-141183f80502 req-ae226d22-0c60-4f03-94db-e2b00f3ba361 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098007 Aug 23 07:13:26.148796 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 89/182] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Aug 23 07:13:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 07:13:26.786259 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-6047c73f-27df-4cd4-9ee0-dc12d37e30fb tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Calling method '>' {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:13:26.787010 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.compute.api [None req-6047c73f-27df-4cd4-9ee0-dc12d37e30fb tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] [instance: 703acb74-65e6-4a60-9dd0-bf986498889e] Fetching instance by UUID {{(pid=120799) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:13:26.795642 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-6047c73f-27df-4cd4-9ee0-dc12d37e30fb tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:13:26.796246 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-6047c73f-27df-4cd4-9ee0-dc12d37e30fb tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:13:26.796685 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-6047c73f-27df-4cd4-9ee0-dc12d37e30fb tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:13:26.799185 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-6047c73f-27df-4cd4-9ee0-dc12d37e30fb tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:13:26.801730 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-6047c73f-27df-4cd4-9ee0-dc12d37e30fb tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:13:26.803340 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-6047c73f-27df-4cd4-9ee0-dc12d37e30fb tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:13:27.405730 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.policy [None req-6047c73f-27df-4cd4-9ee0-dc12d37e30fb tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64d54cb95b264c18b45d90822507fae1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135367be6e3f4b3d965ee0d99fdca524', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120799) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:13:27.430264 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-6047c73f-27df-4cd4-9ee0-dc12d37e30fb tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] 10.222.0.17 "GET /compute/v2.1/servers/703acb74-65e6-4a60-9dd0-bf986498889e" status: 200 len: 1522 microversion: 2.1 time: 0.647904 Aug 23 07:13:27.433449 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 94/183] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:13:26 2022] GET /compute/v2.1/servers/703acb74-65e6-4a60-9dd0-bf986498889e => generated 1522 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:13:28.462808 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-e56e1347-a528-4062-8f6e-35d242cbc39e tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Calling method '>' {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:13:28.464320 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.compute.api [None req-e56e1347-a528-4062-8f6e-35d242cbc39e tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] [instance: 703acb74-65e6-4a60-9dd0-bf986498889e] Fetching instance by UUID {{(pid=120798) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:13:28.471539 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-e56e1347-a528-4062-8f6e-35d242cbc39e tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:13:28.472187 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-e56e1347-a528-4062-8f6e-35d242cbc39e tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:13:28.473052 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-e56e1347-a528-4062-8f6e-35d242cbc39e tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:13:28.474367 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-e56e1347-a528-4062-8f6e-35d242cbc39e tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:13:28.474987 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-e56e1347-a528-4062-8f6e-35d242cbc39e tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:13:28.475624 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-e56e1347-a528-4062-8f6e-35d242cbc39e tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:13:28.916572 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.policy [None req-e56e1347-a528-4062-8f6e-35d242cbc39e tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64d54cb95b264c18b45d90822507fae1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135367be6e3f4b3d965ee0d99fdca524', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120798) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:13:28.925840 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [None req-e56e1347-a528-4062-8f6e-35d242cbc39e tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] 10.222.0.17 "GET /compute/v2.1/servers/703acb74-65e6-4a60-9dd0-bf986498889e" status: 200 len: 1522 microversion: 2.1 time: 0.470119 Aug 23 07:13:28.941175 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 90/184] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:13:28 2022] GET /compute/v2.1/servers/703acb74-65e6-4a60-9dd0-bf986498889e => generated 1522 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:13:29.949176 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-51eb55aa-f001-40ef-84f1-9ae5798dfff4 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Calling method '>' {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:13:29.949913 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.compute.api [None req-51eb55aa-f001-40ef-84f1-9ae5798dfff4 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] [instance: 703acb74-65e6-4a60-9dd0-bf986498889e] Fetching instance by UUID {{(pid=120799) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:13:29.961057 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-51eb55aa-f001-40ef-84f1-9ae5798dfff4 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:13:29.962689 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-51eb55aa-f001-40ef-84f1-9ae5798dfff4 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:13:29.964635 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-51eb55aa-f001-40ef-84f1-9ae5798dfff4 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:13:29.966420 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-51eb55aa-f001-40ef-84f1-9ae5798dfff4 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:13:29.966887 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-51eb55aa-f001-40ef-84f1-9ae5798dfff4 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:13:29.967315 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-51eb55aa-f001-40ef-84f1-9ae5798dfff4 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:13:30.153345 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.policy [None req-51eb55aa-f001-40ef-84f1-9ae5798dfff4 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64d54cb95b264c18b45d90822507fae1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135367be6e3f4b3d965ee0d99fdca524', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120799) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:13:30.161305 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-51eb55aa-f001-40ef-84f1-9ae5798dfff4 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] 10.222.0.17 "GET /compute/v2.1/servers/703acb74-65e6-4a60-9dd0-bf986498889e" status: 200 len: 1522 microversion: 2.1 time: 0.216915 Aug 23 07:13:30.162082 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 95/185] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:13:29 2022] GET /compute/v2.1/servers/703acb74-65e6-4a60-9dd0-bf986498889e => generated 1522 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:13:31.187968 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-de2a2d61-e7f1-4304-b44f-22f2e13a49a0 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Calling method '>' {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:13:31.189613 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.compute.api [None req-de2a2d61-e7f1-4304-b44f-22f2e13a49a0 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] [instance: 703acb74-65e6-4a60-9dd0-bf986498889e] Fetching instance by UUID {{(pid=120798) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:13:31.201545 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-de2a2d61-e7f1-4304-b44f-22f2e13a49a0 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:13:31.202607 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-de2a2d61-e7f1-4304-b44f-22f2e13a49a0 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:13:31.204201 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-de2a2d61-e7f1-4304-b44f-22f2e13a49a0 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:13:31.205824 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-de2a2d61-e7f1-4304-b44f-22f2e13a49a0 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:13:31.207248 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-de2a2d61-e7f1-4304-b44f-22f2e13a49a0 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:13:31.207965 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-de2a2d61-e7f1-4304-b44f-22f2e13a49a0 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:13:31.397081 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.policy [None req-de2a2d61-e7f1-4304-b44f-22f2e13a49a0 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64d54cb95b264c18b45d90822507fae1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135367be6e3f4b3d965ee0d99fdca524', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120798) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:13:31.405300 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [None req-de2a2d61-e7f1-4304-b44f-22f2e13a49a0 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] 10.222.0.17 "GET /compute/v2.1/servers/703acb74-65e6-4a60-9dd0-bf986498889e" status: 200 len: 1522 microversion: 2.1 time: 0.225408 Aug 23 07:13:31.405860 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 91/186] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:13:31 2022] GET /compute/v2.1/servers/703acb74-65e6-4a60-9dd0-bf986498889e => generated 1522 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:13:32.427234 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-eb5cca4f-4cf6-4e86-b5b8-89c22b728951 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Calling method '>' {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:13:32.427864 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.compute.api [None req-eb5cca4f-4cf6-4e86-b5b8-89c22b728951 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] [instance: 703acb74-65e6-4a60-9dd0-bf986498889e] Fetching instance by UUID {{(pid=120799) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:13:32.438396 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-eb5cca4f-4cf6-4e86-b5b8-89c22b728951 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:13:32.438877 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-eb5cca4f-4cf6-4e86-b5b8-89c22b728951 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:13:32.439306 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-eb5cca4f-4cf6-4e86-b5b8-89c22b728951 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:13:32.440061 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-eb5cca4f-4cf6-4e86-b5b8-89c22b728951 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:13:32.440511 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-eb5cca4f-4cf6-4e86-b5b8-89c22b728951 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:13:32.440928 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-eb5cca4f-4cf6-4e86-b5b8-89c22b728951 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:13:32.643478 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.policy [None req-eb5cca4f-4cf6-4e86-b5b8-89c22b728951 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64d54cb95b264c18b45d90822507fae1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135367be6e3f4b3d965ee0d99fdca524', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120799) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:13:32.652275 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-eb5cca4f-4cf6-4e86-b5b8-89c22b728951 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] 10.222.0.17 "GET /compute/v2.1/servers/703acb74-65e6-4a60-9dd0-bf986498889e" status: 200 len: 1522 microversion: 2.1 time: 0.229285 Aug 23 07:13:32.653065 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 96/187] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:13:32 2022] GET /compute/v2.1/servers/703acb74-65e6-4a60-9dd0-bf986498889e => generated 1522 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:13:33.679126 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-c4ea6fcc-20aa-4440-805f-9b4c2235b604 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Calling method '>' {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:13:33.679762 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.compute.api [None req-c4ea6fcc-20aa-4440-805f-9b4c2235b604 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] [instance: 703acb74-65e6-4a60-9dd0-bf986498889e] Fetching instance by UUID {{(pid=120798) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:13:33.695121 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-c4ea6fcc-20aa-4440-805f-9b4c2235b604 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:13:33.695962 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-c4ea6fcc-20aa-4440-805f-9b4c2235b604 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:13:33.698605 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-c4ea6fcc-20aa-4440-805f-9b4c2235b604 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:13:33.699839 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-c4ea6fcc-20aa-4440-805f-9b4c2235b604 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:13:33.700611 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-c4ea6fcc-20aa-4440-805f-9b4c2235b604 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:13:33.701506 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-c4ea6fcc-20aa-4440-805f-9b4c2235b604 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:13:33.855307 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.policy [None req-c4ea6fcc-20aa-4440-805f-9b4c2235b604 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64d54cb95b264c18b45d90822507fae1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135367be6e3f4b3d965ee0d99fdca524', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120798) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:13:33.865171 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [None req-c4ea6fcc-20aa-4440-805f-9b4c2235b604 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] 10.222.0.17 "GET /compute/v2.1/servers/703acb74-65e6-4a60-9dd0-bf986498889e" status: 200 len: 1522 microversion: 2.1 time: 0.190333 Aug 23 07:13:33.877841 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 92/188] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:13:33 2022] GET /compute/v2.1/servers/703acb74-65e6-4a60-9dd0-bf986498889e => generated 1522 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:13:34.889482 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-b60a3197-07ba-46fa-aa9f-de461572e4d0 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Calling method '>' {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:13:34.890155 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.compute.api [None req-b60a3197-07ba-46fa-aa9f-de461572e4d0 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] [instance: 703acb74-65e6-4a60-9dd0-bf986498889e] Fetching instance by UUID {{(pid=120799) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:13:34.898990 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-b60a3197-07ba-46fa-aa9f-de461572e4d0 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:13:34.899616 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-b60a3197-07ba-46fa-aa9f-de461572e4d0 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:13:34.900236 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-b60a3197-07ba-46fa-aa9f-de461572e4d0 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:13:34.900985 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-b60a3197-07ba-46fa-aa9f-de461572e4d0 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:13:34.901521 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-b60a3197-07ba-46fa-aa9f-de461572e4d0 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:13:34.902035 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-b60a3197-07ba-46fa-aa9f-de461572e4d0 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:13:35.061738 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.policy [None req-b60a3197-07ba-46fa-aa9f-de461572e4d0 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64d54cb95b264c18b45d90822507fae1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135367be6e3f4b3d965ee0d99fdca524', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120799) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:13:35.074263 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-b60a3197-07ba-46fa-aa9f-de461572e4d0 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] 10.222.0.17 "GET /compute/v2.1/servers/703acb74-65e6-4a60-9dd0-bf986498889e" status: 200 len: 1522 microversion: 2.1 time: 0.188384 Aug 23 07:13:35.075305 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 97/189] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:13:34 2022] GET /compute/v2.1/servers/703acb74-65e6-4a60-9dd0-bf986498889e => generated 1522 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 07:13:36.096758 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-783921e5-e67b-49e3-b41d-c74518dbd867 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Calling method '>' {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:13:36.097267 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.compute.api [None req-783921e5-e67b-49e3-b41d-c74518dbd867 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] [instance: 703acb74-65e6-4a60-9dd0-bf986498889e] Fetching instance by UUID {{(pid=120798) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:13:36.109273 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-783921e5-e67b-49e3-b41d-c74518dbd867 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:13:36.109976 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-783921e5-e67b-49e3-b41d-c74518dbd867 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:13:36.110405 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-783921e5-e67b-49e3-b41d-c74518dbd867 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:13:36.111096 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-783921e5-e67b-49e3-b41d-c74518dbd867 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:13:36.111570 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-783921e5-e67b-49e3-b41d-c74518dbd867 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:13:36.111986 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-783921e5-e67b-49e3-b41d-c74518dbd867 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:13:36.314136 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.policy [None req-783921e5-e67b-49e3-b41d-c74518dbd867 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64d54cb95b264c18b45d90822507fae1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135367be6e3f4b3d965ee0d99fdca524', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120798) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:13:36.324695 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [None req-783921e5-e67b-49e3-b41d-c74518dbd867 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] 10.222.0.17 "GET /compute/v2.1/servers/703acb74-65e6-4a60-9dd0-bf986498889e" status: 200 len: 1522 microversion: 2.1 time: 0.231889 Aug 23 07:13:36.325377 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 93/190] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:13:36 2022] GET /compute/v2.1/servers/703acb74-65e6-4a60-9dd0-bf986498889e => generated 1522 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:13:37.346103 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-c51ce012-d369-4fab-bab4-f8f303716dde tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Calling method '>' {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:13:37.346695 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.compute.api [None req-c51ce012-d369-4fab-bab4-f8f303716dde tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] [instance: 703acb74-65e6-4a60-9dd0-bf986498889e] Fetching instance by UUID {{(pid=120799) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:13:37.353061 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-c51ce012-d369-4fab-bab4-f8f303716dde tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:13:37.353531 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-c51ce012-d369-4fab-bab4-f8f303716dde tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:13:37.354062 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-c51ce012-d369-4fab-bab4-f8f303716dde tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:13:37.354756 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-c51ce012-d369-4fab-bab4-f8f303716dde tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:13:37.355193 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-c51ce012-d369-4fab-bab4-f8f303716dde tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:13:37.355641 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-c51ce012-d369-4fab-bab4-f8f303716dde tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:13:37.491990 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.policy [None req-c51ce012-d369-4fab-bab4-f8f303716dde tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64d54cb95b264c18b45d90822507fae1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135367be6e3f4b3d965ee0d99fdca524', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120799) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:13:37.499961 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-c51ce012-d369-4fab-bab4-f8f303716dde tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] 10.222.0.17 "GET /compute/v2.1/servers/703acb74-65e6-4a60-9dd0-bf986498889e" status: 200 len: 1522 microversion: 2.1 time: 0.157676 Aug 23 07:13:37.500523 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 98/191] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:13:37 2022] GET /compute/v2.1/servers/703acb74-65e6-4a60-9dd0-bf986498889e => generated 1522 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:13:38.521185 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-c43365b0-8ee1-4e65-90df-9bdad38fdfbc tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Calling method '>' {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:13:38.521761 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.compute.api [None req-c43365b0-8ee1-4e65-90df-9bdad38fdfbc tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] [instance: 703acb74-65e6-4a60-9dd0-bf986498889e] Fetching instance by UUID {{(pid=120798) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:13:38.528761 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-c43365b0-8ee1-4e65-90df-9bdad38fdfbc tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:13:38.529238 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-c43365b0-8ee1-4e65-90df-9bdad38fdfbc tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:13:38.529689 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-c43365b0-8ee1-4e65-90df-9bdad38fdfbc tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:13:38.530384 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-c43365b0-8ee1-4e65-90df-9bdad38fdfbc tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:13:38.530832 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-c43365b0-8ee1-4e65-90df-9bdad38fdfbc tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:13:38.531254 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-c43365b0-8ee1-4e65-90df-9bdad38fdfbc tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:13:38.670779 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.policy [None req-c43365b0-8ee1-4e65-90df-9bdad38fdfbc tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64d54cb95b264c18b45d90822507fae1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135367be6e3f4b3d965ee0d99fdca524', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120798) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:13:38.678589 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [None req-c43365b0-8ee1-4e65-90df-9bdad38fdfbc tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] 10.222.0.17 "GET /compute/v2.1/servers/703acb74-65e6-4a60-9dd0-bf986498889e" status: 200 len: 1522 microversion: 2.1 time: 0.161393 Aug 23 07:13:38.679150 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 94/192] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:13:38 2022] GET /compute/v2.1/servers/703acb74-65e6-4a60-9dd0-bf986498889e => generated 1522 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:13:39.701035 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-8d219b13-5012-4769-aa1e-603a88a7a72e tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Calling method '>' {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:13:39.702408 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.compute.api [None req-8d219b13-5012-4769-aa1e-603a88a7a72e tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] [instance: 703acb74-65e6-4a60-9dd0-bf986498889e] Fetching instance by UUID {{(pid=120799) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:13:39.709571 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-8d219b13-5012-4769-aa1e-603a88a7a72e tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:13:39.710082 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-8d219b13-5012-4769-aa1e-603a88a7a72e tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:13:39.710576 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-8d219b13-5012-4769-aa1e-603a88a7a72e tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:13:39.711260 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-8d219b13-5012-4769-aa1e-603a88a7a72e tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:13:39.711743 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-8d219b13-5012-4769-aa1e-603a88a7a72e tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:13:39.712159 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-8d219b13-5012-4769-aa1e-603a88a7a72e tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:13:39.839056 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-93d84112-d782-459f-a20e-24b1e8baf1af tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] Calling method '>' {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:13:39.840250 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.compute.api [None req-93d84112-d782-459f-a20e-24b1e8baf1af tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] [instance: 9d984b5d-f788-4a4c-8609-471747c44fb8] Fetching instance by UUID {{(pid=120798) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:13:39.847629 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-93d84112-d782-459f-a20e-24b1e8baf1af tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:13:39.848492 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-93d84112-d782-459f-a20e-24b1e8baf1af tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:13:39.849138 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-93d84112-d782-459f-a20e-24b1e8baf1af tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:13:39.850029 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-93d84112-d782-459f-a20e-24b1e8baf1af tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:13:39.850668 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-93d84112-d782-459f-a20e-24b1e8baf1af tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:13:39.851288 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-93d84112-d782-459f-a20e-24b1e8baf1af tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:13:39.871080 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG dbcounter [-] [120798] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=120798) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:13:39.878774 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.policy [None req-8d219b13-5012-4769-aa1e-603a88a7a72e tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64d54cb95b264c18b45d90822507fae1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135367be6e3f4b3d965ee0d99fdca524', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120799) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:13:39.888840 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-8d219b13-5012-4769-aa1e-603a88a7a72e tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] 10.222.0.17 "GET /compute/v2.1/servers/703acb74-65e6-4a60-9dd0-bf986498889e" status: 200 len: 1522 microversion: 2.1 time: 0.192033 Aug 23 07:13:39.889417 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 99/193] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:13:39 2022] GET /compute/v2.1/servers/703acb74-65e6-4a60-9dd0-bf986498889e => generated 1522 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:13:39.909104 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.compute.api [None req-93d84112-d782-459f-a20e-24b1e8baf1af tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] [instance: 9d984b5d-f788-4a4c-8609-471747c44fb8] Going to try to terminate instance {{(pid=120798) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 07:13:40.006515 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [None req-93d84112-d782-459f-a20e-24b1e8baf1af tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] 10.222.0.17 "DELETE /compute/v2.1/servers/9d984b5d-f788-4a4c-8609-471747c44fb8" status: 204 len: 0 microversion: 2.1 time: 0.170989 Aug 23 07:13:40.007112 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 95/194] 10.222.0.17 () {58 vars in 1239 bytes} [Tue Aug 23 07:13:39 2022] DELETE /compute/v2.1/servers/9d984b5d-f788-4a4c-8609-471747c44fb8 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 23 07:13:40.016761 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-e66e1a3e-be82-43ca-9d87-1729894be9ba tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] Calling method '>' {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:13:40.017463 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.compute.api [None req-e66e1a3e-be82-43ca-9d87-1729894be9ba tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] [instance: 9d984b5d-f788-4a4c-8609-471747c44fb8] Fetching instance by UUID {{(pid=120799) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:13:40.023691 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-e66e1a3e-be82-43ca-9d87-1729894be9ba tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:13:40.024173 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-e66e1a3e-be82-43ca-9d87-1729894be9ba tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:13:40.024598 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-e66e1a3e-be82-43ca-9d87-1729894be9ba tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:13:40.025476 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-e66e1a3e-be82-43ca-9d87-1729894be9ba tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:13:40.025927 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-e66e1a3e-be82-43ca-9d87-1729894be9ba tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:13:40.026370 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-e66e1a3e-be82-43ca-9d87-1729894be9ba tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:13:40.162643 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.policy [None req-e66e1a3e-be82-43ca-9d87-1729894be9ba tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cbcc9668f454c0e8c27495a1827d703', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24307daab4d24f979c30e081163c3bfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120799) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:13:40.171017 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-e66e1a3e-be82-43ca-9d87-1729894be9ba tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] 10.222.0.17 "GET /compute/v2.1/servers/9d984b5d-f788-4a4c-8609-471747c44fb8" status: 200 len: 1553 microversion: 2.1 time: 0.159456 Aug 23 07:13:40.171654 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 100/195] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:13:40 2022] GET /compute/v2.1/servers/9d984b5d-f788-4a4c-8609-471747c44fb8 => generated 1553 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:13:40.912483 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-257e854a-10f6-4d51-99c3-038778e6884c tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Calling method '>' {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:13:40.913285 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.compute.api [None req-257e854a-10f6-4d51-99c3-038778e6884c tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] [instance: 703acb74-65e6-4a60-9dd0-bf986498889e] Fetching instance by UUID {{(pid=120798) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:13:40.920744 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-257e854a-10f6-4d51-99c3-038778e6884c tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:13:40.921258 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-257e854a-10f6-4d51-99c3-038778e6884c tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:13:40.921788 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-257e854a-10f6-4d51-99c3-038778e6884c tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:13:40.922750 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-257e854a-10f6-4d51-99c3-038778e6884c tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:13:40.923170 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-257e854a-10f6-4d51-99c3-038778e6884c tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:13:40.923612 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-257e854a-10f6-4d51-99c3-038778e6884c tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:13:41.074757 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.policy [None req-257e854a-10f6-4d51-99c3-038778e6884c tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64d54cb95b264c18b45d90822507fae1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135367be6e3f4b3d965ee0d99fdca524', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120798) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:13:41.084280 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [None req-257e854a-10f6-4d51-99c3-038778e6884c tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] 10.222.0.17 "GET /compute/v2.1/servers/703acb74-65e6-4a60-9dd0-bf986498889e" status: 200 len: 1522 microversion: 2.1 time: 0.177807 Aug 23 07:13:41.084957 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 96/196] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:13:40 2022] GET /compute/v2.1/servers/703acb74-65e6-4a60-9dd0-bf986498889e => generated 1522 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:13:41.196329 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-bb3edba3-924f-432e-abff-a7f20ccdf850 tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] Calling method '>' {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:13:41.197119 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.compute.api [None req-bb3edba3-924f-432e-abff-a7f20ccdf850 tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] [instance: 9d984b5d-f788-4a4c-8609-471747c44fb8] Fetching instance by UUID {{(pid=120799) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:13:41.207210 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-bb3edba3-924f-432e-abff-a7f20ccdf850 tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:13:41.207964 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-bb3edba3-924f-432e-abff-a7f20ccdf850 tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:13:41.208520 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-bb3edba3-924f-432e-abff-a7f20ccdf850 tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:13:41.209469 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-bb3edba3-924f-432e-abff-a7f20ccdf850 tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:13:41.210093 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-bb3edba3-924f-432e-abff-a7f20ccdf850 tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:13:41.210579 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-bb3edba3-924f-432e-abff-a7f20ccdf850 tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:13:41.354557 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.policy [None req-bb3edba3-924f-432e-abff-a7f20ccdf850 tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cbcc9668f454c0e8c27495a1827d703', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24307daab4d24f979c30e081163c3bfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120799) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:13:41.364353 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-bb3edba3-924f-432e-abff-a7f20ccdf850 tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] 10.222.0.17 "GET /compute/v2.1/servers/9d984b5d-f788-4a4c-8609-471747c44fb8" status: 200 len: 1553 microversion: 2.1 time: 0.174598 Aug 23 07:13:41.365076 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 101/197] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:13:41 2022] GET /compute/v2.1/servers/9d984b5d-f788-4a4c-8609-471747c44fb8 => generated 1553 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:13:42.106126 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-55b1228f-e451-49fb-9e76-224cc0a51ee8 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Calling method '>' {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:13:42.106739 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.compute.api [None req-55b1228f-e451-49fb-9e76-224cc0a51ee8 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] [instance: 703acb74-65e6-4a60-9dd0-bf986498889e] Fetching instance by UUID {{(pid=120798) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:13:42.113641 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-55b1228f-e451-49fb-9e76-224cc0a51ee8 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:13:42.114713 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-55b1228f-e451-49fb-9e76-224cc0a51ee8 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:13:42.115152 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-55b1228f-e451-49fb-9e76-224cc0a51ee8 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:13:42.115868 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-55b1228f-e451-49fb-9e76-224cc0a51ee8 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:13:42.116488 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-55b1228f-e451-49fb-9e76-224cc0a51ee8 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:13:42.117136 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-55b1228f-e451-49fb-9e76-224cc0a51ee8 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:13:42.359694 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.policy [None req-55b1228f-e451-49fb-9e76-224cc0a51ee8 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64d54cb95b264c18b45d90822507fae1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135367be6e3f4b3d965ee0d99fdca524', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120798) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:13:42.374468 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [None req-55b1228f-e451-49fb-9e76-224cc0a51ee8 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] 10.222.0.17 "GET /compute/v2.1/servers/703acb74-65e6-4a60-9dd0-bf986498889e" status: 200 len: 1522 microversion: 2.1 time: 0.272757 Aug 23 07:13:42.375245 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 97/198] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:13:42 2022] GET /compute/v2.1/servers/703acb74-65e6-4a60-9dd0-bf986498889e => generated 1522 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:13:42.397101 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-1e6881bf-02fc-4cee-9bdd-ccefceda0c00 tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] Calling method '>' {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:13:42.399356 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.compute.api [None req-1e6881bf-02fc-4cee-9bdd-ccefceda0c00 tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] [instance: 9d984b5d-f788-4a4c-8609-471747c44fb8] Fetching instance by UUID {{(pid=120799) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:13:42.403639 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG dbcounter [-] [120799] Writing DB stats nova_api:SELECT=54 {{(pid=120799) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:13:42.416839 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-1e6881bf-02fc-4cee-9bdd-ccefceda0c00 tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:13:42.420011 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-1e6881bf-02fc-4cee-9bdd-ccefceda0c00 tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:13:42.420658 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-1e6881bf-02fc-4cee-9bdd-ccefceda0c00 tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:13:42.423727 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-1e6881bf-02fc-4cee-9bdd-ccefceda0c00 tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:13:42.425478 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-1e6881bf-02fc-4cee-9bdd-ccefceda0c00 tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:13:42.427008 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-1e6881bf-02fc-4cee-9bdd-ccefceda0c00 tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:13:42.714939 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.policy [None req-1e6881bf-02fc-4cee-9bdd-ccefceda0c00 tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cbcc9668f454c0e8c27495a1827d703', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24307daab4d24f979c30e081163c3bfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120799) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:13:42.724693 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-1e6881bf-02fc-4cee-9bdd-ccefceda0c00 tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] 10.222.0.17 "GET /compute/v2.1/servers/9d984b5d-f788-4a4c-8609-471747c44fb8" status: 200 len: 1553 microversion: 2.1 time: 0.332723 Aug 23 07:13:42.726146 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 102/199] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:13:42 2022] GET /compute/v2.1/servers/9d984b5d-f788-4a4c-8609-471747c44fb8 => generated 1553 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:13:43.396863 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-964d5485-993e-4e75-a011-94b149c97299 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Calling method '>' {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:13:43.405194 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.compute.api [None req-964d5485-993e-4e75-a011-94b149c97299 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] [instance: 703acb74-65e6-4a60-9dd0-bf986498889e] Fetching instance by UUID {{(pid=120798) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:13:43.412935 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-964d5485-993e-4e75-a011-94b149c97299 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:13:43.413610 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-964d5485-993e-4e75-a011-94b149c97299 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:13:43.414040 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-964d5485-993e-4e75-a011-94b149c97299 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:13:43.414698 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-964d5485-993e-4e75-a011-94b149c97299 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:13:43.415312 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-964d5485-993e-4e75-a011-94b149c97299 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:13:43.415746 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-964d5485-993e-4e75-a011-94b149c97299 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:13:43.662292 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [req-4e33e23b-266f-4b5c-a56e-aed2858c0db0 req-b1a5419e-fd31-419f-9949-5c89f8be719c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9d984b5d-f788-4a4c-8609-471747c44fb8", "name": "network-vif-deleted", "tag": "4994a4df-b092-4dfd-afa6-ad9a86dd2c2b"}]} {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 07:13:43.672009 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [req-4e33e23b-266f-4b5c-a56e-aed2858c0db0 req-b1a5419e-fd31-419f-9949-5c89f8be719c service nova] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:13:43.673223 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [req-4e33e23b-266f-4b5c-a56e-aed2858c0db0 req-b1a5419e-fd31-419f-9949-5c89f8be719c service nova] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:13:43.674008 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [req-4e33e23b-266f-4b5c-a56e-aed2858c0db0 req-b1a5419e-fd31-419f-9949-5c89f8be719c service nova] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:13:43.680548 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.policy [None req-964d5485-993e-4e75-a011-94b149c97299 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64d54cb95b264c18b45d90822507fae1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135367be6e3f4b3d965ee0d99fdca524', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120798) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:13:43.691911 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.compute.server_external_events [req-4e33e23b-266f-4b5c-a56e-aed2858c0db0 req-b1a5419e-fd31-419f-9949-5c89f8be719c service nova] Creating event network-vif-deleted:4994a4df-b092-4dfd-afa6-ad9a86dd2c2b for instance 9d984b5d-f788-4a4c-8609-471747c44fb8 on hv-cinder-85409 Aug 23 07:13:43.692843 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [None req-964d5485-993e-4e75-a011-94b149c97299 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] 10.222.0.17 "GET /compute/v2.1/servers/703acb74-65e6-4a60-9dd0-bf986498889e" status: 200 len: 1522 microversion: 2.1 time: 0.300711 Aug 23 07:13:43.694319 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 98/200] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:13:43 2022] GET /compute/v2.1/servers/703acb74-65e6-4a60-9dd0-bf986498889e => generated 1522 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:13:43.703468 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [req-4e33e23b-266f-4b5c-a56e-aed2858c0db0 req-b1a5419e-fd31-419f-9949-5c89f8be719c service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044521 Aug 23 07:13:43.704348 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 103/201] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Aug 23 07:13:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 07:13:43.748627 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-69f944f5-b8bd-4a93-beae-f5a311a680a1 tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] Calling method '>' {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:13:43.750247 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.compute.api [None req-69f944f5-b8bd-4a93-beae-f5a311a680a1 tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] [instance: 9d984b5d-f788-4a4c-8609-471747c44fb8] Fetching instance by UUID {{(pid=120798) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:13:43.757665 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-69f944f5-b8bd-4a93-beae-f5a311a680a1 tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:13:43.758144 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-69f944f5-b8bd-4a93-beae-f5a311a680a1 tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:13:43.758573 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-69f944f5-b8bd-4a93-beae-f5a311a680a1 tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:13:43.759259 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-69f944f5-b8bd-4a93-beae-f5a311a680a1 tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:13:43.759720 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-69f944f5-b8bd-4a93-beae-f5a311a680a1 tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:13:43.760243 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-69f944f5-b8bd-4a93-beae-f5a311a680a1 tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:13:43.830502 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.policy [None req-69f944f5-b8bd-4a93-beae-f5a311a680a1 tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cbcc9668f454c0e8c27495a1827d703', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24307daab4d24f979c30e081163c3bfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120798) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:13:43.839173 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [None req-69f944f5-b8bd-4a93-beae-f5a311a680a1 tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] 10.222.0.17 "GET /compute/v2.1/servers/9d984b5d-f788-4a4c-8609-471747c44fb8" status: 200 len: 1511 microversion: 2.1 time: 0.095468 Aug 23 07:13:43.839769 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 99/202] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:13:43 2022] GET /compute/v2.1/servers/9d984b5d-f788-4a4c-8609-471747c44fb8 => generated 1511 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:13:44.718404 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-0efee4cb-4b50-422d-a5e4-bcb6672263e9 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Calling method '>' {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:13:44.719110 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.compute.api [None req-0efee4cb-4b50-422d-a5e4-bcb6672263e9 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] [instance: 703acb74-65e6-4a60-9dd0-bf986498889e] Fetching instance by UUID {{(pid=120799) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:13:44.725255 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-0efee4cb-4b50-422d-a5e4-bcb6672263e9 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:13:44.725723 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-0efee4cb-4b50-422d-a5e4-bcb6672263e9 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:13:44.726139 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-0efee4cb-4b50-422d-a5e4-bcb6672263e9 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:13:44.726809 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-0efee4cb-4b50-422d-a5e4-bcb6672263e9 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:13:44.727252 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-0efee4cb-4b50-422d-a5e4-bcb6672263e9 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:13:44.727668 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-0efee4cb-4b50-422d-a5e4-bcb6672263e9 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:13:44.873412 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-9a35c49e-d1c6-4296-aa9e-9b2b3cf34653 tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] Calling method '>' {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:13:44.874523 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.compute.api [None req-9a35c49e-d1c6-4296-aa9e-9b2b3cf34653 tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] [instance: 9d984b5d-f788-4a4c-8609-471747c44fb8] Fetching instance by UUID {{(pid=120798) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:13:44.882682 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-9a35c49e-d1c6-4296-aa9e-9b2b3cf34653 tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:13:44.884713 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-9a35c49e-d1c6-4296-aa9e-9b2b3cf34653 tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:13:44.884713 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-9a35c49e-d1c6-4296-aa9e-9b2b3cf34653 tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:13:44.884713 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-9a35c49e-d1c6-4296-aa9e-9b2b3cf34653 tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:13:44.884713 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-9a35c49e-d1c6-4296-aa9e-9b2b3cf34653 tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:13:44.885292 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-9a35c49e-d1c6-4296-aa9e-9b2b3cf34653 tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:13:44.919326 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.policy [None req-0efee4cb-4b50-422d-a5e4-bcb6672263e9 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64d54cb95b264c18b45d90822507fae1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135367be6e3f4b3d965ee0d99fdca524', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120799) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:13:44.928298 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-0efee4cb-4b50-422d-a5e4-bcb6672263e9 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] 10.222.0.17 "GET /compute/v2.1/servers/703acb74-65e6-4a60-9dd0-bf986498889e" status: 200 len: 1522 microversion: 2.1 time: 0.214798 Aug 23 07:13:44.928995 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 104/203] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:13:44 2022] GET /compute/v2.1/servers/703acb74-65e6-4a60-9dd0-bf986498889e => generated 1522 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 07:13:44.951609 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.policy [None req-9a35c49e-d1c6-4296-aa9e-9b2b3cf34653 tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cbcc9668f454c0e8c27495a1827d703', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24307daab4d24f979c30e081163c3bfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120798) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:13:44.960672 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [None req-9a35c49e-d1c6-4296-aa9e-9b2b3cf34653 tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] 10.222.0.17 "GET /compute/v2.1/servers/9d984b5d-f788-4a4c-8609-471747c44fb8" status: 200 len: 1346 microversion: 2.1 time: 0.103644 Aug 23 07:13:44.961243 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 100/204] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:13:44 2022] GET /compute/v2.1/servers/9d984b5d-f788-4a4c-8609-471747c44fb8 => generated 1346 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:13:45.949357 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-a127e184-4dd3-46ae-906a-4458f7ae9363 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Calling method '>' {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:13:45.950797 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.compute.api [None req-a127e184-4dd3-46ae-906a-4458f7ae9363 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] [instance: 703acb74-65e6-4a60-9dd0-bf986498889e] Fetching instance by UUID {{(pid=120799) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:13:45.964424 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-a127e184-4dd3-46ae-906a-4458f7ae9363 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:13:45.964916 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-a127e184-4dd3-46ae-906a-4458f7ae9363 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:13:45.965346 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-a127e184-4dd3-46ae-906a-4458f7ae9363 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:13:45.966040 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-a127e184-4dd3-46ae-906a-4458f7ae9363 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:13:45.966484 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-a127e184-4dd3-46ae-906a-4458f7ae9363 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:13:45.967111 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-a127e184-4dd3-46ae-906a-4458f7ae9363 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:13:45.981965 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-dc9c4102-f163-477b-9c69-c3e8c6e323c9 tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] Calling method '>' {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:13:45.982828 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG dbcounter [-] [120799] Writing DB stats nova_cell1:SELECT=100 {{(pid=120799) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:13:45.982946 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.compute.api [None req-dc9c4102-f163-477b-9c69-c3e8c6e323c9 tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] [instance: 9d984b5d-f788-4a4c-8609-471747c44fb8] Fetching instance by UUID {{(pid=120798) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:13:45.990403 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-dc9c4102-f163-477b-9c69-c3e8c6e323c9 tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:13:45.990890 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-dc9c4102-f163-477b-9c69-c3e8c6e323c9 tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:13:45.991309 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-dc9c4102-f163-477b-9c69-c3e8c6e323c9 tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:13:45.992275 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-dc9c4102-f163-477b-9c69-c3e8c6e323c9 tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:13:45.992714 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-dc9c4102-f163-477b-9c69-c3e8c6e323c9 tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:13:45.993330 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-dc9c4102-f163-477b-9c69-c3e8c6e323c9 tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:13:46.012276 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.wsgi [None req-dc9c4102-f163-477b-9c69-c3e8c6e323c9 tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] HTTP exception thrown: Instance 9d984b5d-f788-4a4c-8609-471747c44fb8 could not be found. Aug 23 07:13:46.017337 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-dc9c4102-f163-477b-9c69-c3e8c6e323c9 tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] Request method failure captured: Aug 23 07:13:46.017337 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: request: GET /compute/v2.1/servers/9d984b5d-f788-4a4c-8609-471747c44fb8 HTTP/1.1 Aug 23 07:13:46.017337 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: Accept: application/json Aug 23 07:13:46.017337 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: Accept-Encoding: identity Aug 23 07:13:46.017337 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: Connection: close Aug 23 07:13:46.017337 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: Content-Length: 0 Aug 23 07:13:46.017337 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: Content-Type: application/json Aug 23 07:13:46.017337 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: Host: 10.222.0.17 Aug 23 07:13:46.017337 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: Openstack-System-Scope: None Aug 23 07:13:46.017337 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: User-Agent: python-urllib3/1.26.11 Aug 23 07:13:46.017337 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-Auth-Token: gAAAAABjBH3Wlp4xHSF1PlR-vQWxui5D6JvUypl2rVUD10jalFI5CCM7mPBBehqrEnO1IHaIvjSqpay6wjZoK9ak2lY93JEnDRjXnIN5bcLHtbhyeqHi90I-eOE0n3o8vTKgQx3MfgmT5n2JaxZpcpJaiaLvQOFBJYbpkNmpgsZzQAY-p0QoAVg Aug 23 07:13:46.017337 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-Domain-Id: None Aug 23 07:13:46.017337 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-Domain-Name: None Aug 23 07:13:46.017337 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-Identity-Status: Confirmed Aug 23 07:13:46.017337 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-Is-Admin-Project: True Aug 23 07:13:46.017337 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-Project-Domain-Id: default Aug 23 07:13:46.017337 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-Project-Domain-Name: Default Aug 23 07:13:46.017337 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-Project-Id: 24307daab4d24f979c30e081163c3bfe Aug 23 07:13:46.017337 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-Project-Name: tempest-DeleteServersTestJSON-1425922145 Aug 23 07:13:46.017337 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-Role: reader,member Aug 23 07:13:46.017337 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-Roles: reader,member Aug 23 07:13:46.018613 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/24307daab4d24f979c30e081163c3bfe"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/24307daab4d24f979c30e081163c3bfe"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_24307daab4d24f979c30e081163c3bfe"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/24307daab4d24f979c30e081163c3bfe"}]}] Aug 23 07:13:46.018613 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-Tenant: tempest-DeleteServersTestJSON-1425922145 Aug 23 07:13:46.018613 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-Tenant-Id: 24307daab4d24f979c30e081163c3bfe Aug 23 07:13:46.018613 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-Tenant-Name: tempest-DeleteServersTestJSON-1425922145 Aug 23 07:13:46.018613 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-User: tempest-DeleteServersTestJSON-1425922145-project Aug 23 07:13:46.018613 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-User-Domain-Id: default Aug 23 07:13:46.018613 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-User-Domain-Name: Default Aug 23 07:13:46.018613 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-User-Id: 6cbcc9668f454c0e8c27495a1827d703 Aug 23 07:13:46.018613 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-User-Name: tempest-DeleteServersTestJSON-1425922145-project Aug 23 07:13:46.018613 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: method: > Aug 23 07:13:46.018613 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: exception: Instance 9d984b5d-f788-4a4c-8609-471747c44fb8 could not be found. Aug 23 07:13:46.018613 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: action_args: {'id': '9d984b5d-f788-4a4c-8609-471747c44fb8'} Aug 23 07:13:46.019527 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 07:13:46.019527 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 07:13:46.019527 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 07:13:46.019527 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 07:13:46.019527 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 07:13:46.019527 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 07:13:46.019527 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 07:13:46.019527 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 07:13:46.019527 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 07:13:46.019527 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 07:13:46.019527 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9d984b5d-f788-4a4c-8609-471747c44fb8 could not be found. Aug 23 07:13:46.019527 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi Aug 23 07:13:46.019527 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 07:13:46.019527 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi Aug 23 07:13:46.019527 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 07:13:46.019527 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 07:13:46.019527 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 07:13:46.019527 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 07:13:46.019527 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 07:13:46.019527 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 07:13:46.020642 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 07:13:46.020642 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 07:13:46.020642 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 07:13:46.020642 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 07:13:46.020642 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 07:13:46.020642 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 07:13:46.020642 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 07:13:46.020642 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9d984b5d-f788-4a4c-8609-471747c44fb8 could not be found. Aug 23 07:13:46.020642 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi Aug 23 07:13:46.020642 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 07:13:46.020642 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi Aug 23 07:13:46.020642 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 07:13:46.020642 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 07:13:46.020642 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 07:13:46.020642 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 07:13:46.020642 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 07:13:46.020642 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9d984b5d-f788-4a4c-8609-471747c44fb8 could not be found. Aug 23 07:13:46.020642 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi Aug 23 07:13:46.021609 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-dc9c4102-f163-477b-9c69-c3e8c6e323c9 tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] Returning 404 to user: Instance 9d984b5d-f788-4a4c-8609-471747c44fb8 could not be found. {{(pid=120798) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 07:13:46.021609 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [None req-dc9c4102-f163-477b-9c69-c3e8c6e323c9 tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] 10.222.0.17 "GET /compute/v2.1/servers/9d984b5d-f788-4a4c-8609-471747c44fb8" status: 404 len: 111 microversion: 2.1 time: 0.041791 Aug 23 07:13:46.021609 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 101/205] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:13:45 2022] GET /compute/v2.1/servers/9d984b5d-f788-4a4c-8609-471747c44fb8 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 07:13:46.141930 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.policy [None req-a127e184-4dd3-46ae-906a-4458f7ae9363 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64d54cb95b264c18b45d90822507fae1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135367be6e3f4b3d965ee0d99fdca524', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120799) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:13:46.154882 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-a127e184-4dd3-46ae-906a-4458f7ae9363 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] 10.222.0.17 "GET /compute/v2.1/servers/703acb74-65e6-4a60-9dd0-bf986498889e" status: 200 len: 1522 microversion: 2.1 time: 0.205142 Aug 23 07:13:46.154882 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 105/206] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:13:45 2022] GET /compute/v2.1/servers/703acb74-65e6-4a60-9dd0-bf986498889e => generated 1522 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:13:46.169351 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-5e9d1c5e-650a-4c6d-ac5e-ee293234c997 tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] Calling method '>' {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:13:46.171628 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.compute.api [None req-5e9d1c5e-650a-4c6d-ac5e-ee293234c997 tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] [instance: 9d984b5d-f788-4a4c-8609-471747c44fb8] Fetching instance by UUID {{(pid=120798) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:13:46.178029 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-5e9d1c5e-650a-4c6d-ac5e-ee293234c997 tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:13:46.178500 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-5e9d1c5e-650a-4c6d-ac5e-ee293234c997 tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:13:46.178921 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-5e9d1c5e-650a-4c6d-ac5e-ee293234c997 tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:13:46.179625 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-5e9d1c5e-650a-4c6d-ac5e-ee293234c997 tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:13:46.180060 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-5e9d1c5e-650a-4c6d-ac5e-ee293234c997 tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:13:46.180467 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-5e9d1c5e-650a-4c6d-ac5e-ee293234c997 tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:13:46.193947 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.wsgi [None req-5e9d1c5e-650a-4c6d-ac5e-ee293234c997 tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] HTTP exception thrown: Instance 9d984b5d-f788-4a4c-8609-471747c44fb8 could not be found. Aug 23 07:13:46.196342 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-5e9d1c5e-650a-4c6d-ac5e-ee293234c997 tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] Request method failure captured: Aug 23 07:13:46.196342 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: request: GET /compute/v2.1/servers/9d984b5d-f788-4a4c-8609-471747c44fb8/os-volume_attachments HTTP/1.1 Aug 23 07:13:46.196342 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: Accept: application/json Aug 23 07:13:46.196342 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: Accept-Encoding: identity Aug 23 07:13:46.196342 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: Connection: close Aug 23 07:13:46.196342 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: Content-Length: 0 Aug 23 07:13:46.196342 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: Content-Type: application/json Aug 23 07:13:46.196342 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: Host: 10.222.0.17 Aug 23 07:13:46.196342 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: Openstack-System-Scope: None Aug 23 07:13:46.196342 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: User-Agent: python-urllib3/1.26.11 Aug 23 07:13:46.196342 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-Auth-Token: gAAAAABjBH3Wlp4xHSF1PlR-vQWxui5D6JvUypl2rVUD10jalFI5CCM7mPBBehqrEnO1IHaIvjSqpay6wjZoK9ak2lY93JEnDRjXnIN5bcLHtbhyeqHi90I-eOE0n3o8vTKgQx3MfgmT5n2JaxZpcpJaiaLvQOFBJYbpkNmpgsZzQAY-p0QoAVg Aug 23 07:13:46.196342 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-Domain-Id: None Aug 23 07:13:46.196342 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-Domain-Name: None Aug 23 07:13:46.196342 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-Identity-Status: Confirmed Aug 23 07:13:46.196342 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-Is-Admin-Project: True Aug 23 07:13:46.196342 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-Project-Domain-Id: default Aug 23 07:13:46.196342 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-Project-Domain-Name: Default Aug 23 07:13:46.196342 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-Project-Id: 24307daab4d24f979c30e081163c3bfe Aug 23 07:13:46.196342 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-Project-Name: tempest-DeleteServersTestJSON-1425922145 Aug 23 07:13:46.196342 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-Role: reader,member Aug 23 07:13:46.196342 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-Roles: reader,member Aug 23 07:13:46.197504 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/24307daab4d24f979c30e081163c3bfe"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/24307daab4d24f979c30e081163c3bfe"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_24307daab4d24f979c30e081163c3bfe"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/24307daab4d24f979c30e081163c3bfe"}]}] Aug 23 07:13:46.197504 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-Tenant: tempest-DeleteServersTestJSON-1425922145 Aug 23 07:13:46.197504 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-Tenant-Id: 24307daab4d24f979c30e081163c3bfe Aug 23 07:13:46.197504 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-Tenant-Name: tempest-DeleteServersTestJSON-1425922145 Aug 23 07:13:46.197504 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-User: tempest-DeleteServersTestJSON-1425922145-project Aug 23 07:13:46.197504 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-User-Domain-Id: default Aug 23 07:13:46.197504 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-User-Domain-Name: Default Aug 23 07:13:46.197504 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-User-Id: 6cbcc9668f454c0e8c27495a1827d703 Aug 23 07:13:46.197504 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-User-Name: tempest-DeleteServersTestJSON-1425922145-project Aug 23 07:13:46.197504 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: method: > Aug 23 07:13:46.197504 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: exception: Instance 9d984b5d-f788-4a4c-8609-471747c44fb8 could not be found. Aug 23 07:13:46.197504 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: action_args: {'server_id': '9d984b5d-f788-4a4c-8609-471747c44fb8'} Aug 23 07:13:46.198215 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 07:13:46.198215 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 07:13:46.198215 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 07:13:46.198215 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 07:13:46.198215 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 07:13:46.198215 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 07:13:46.198215 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 07:13:46.198215 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 07:13:46.198215 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 07:13:46.198215 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 07:13:46.198215 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9d984b5d-f788-4a4c-8609-471747c44fb8 could not be found. Aug 23 07:13:46.198215 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi Aug 23 07:13:46.198215 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 07:13:46.198215 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi Aug 23 07:13:46.198215 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 07:13:46.198215 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 07:13:46.198215 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 07:13:46.198215 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 07:13:46.198215 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 07:13:46.198215 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 07:13:46.199307 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 07:13:46.199307 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 23 07:13:46.199307 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 23 07:13:46.199307 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 23 07:13:46.199307 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 23 07:13:46.199307 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Aug 23 07:13:46.199307 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Aug 23 07:13:46.199307 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 07:13:46.199307 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 07:13:46.199307 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9d984b5d-f788-4a4c-8609-471747c44fb8 could not be found. Aug 23 07:13:46.199307 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi Aug 23 07:13:46.199307 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 07:13:46.199307 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi Aug 23 07:13:46.199307 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 07:13:46.199307 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 07:13:46.199307 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 07:13:46.199307 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 07:13:46.199307 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 07:13:46.199307 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9d984b5d-f788-4a4c-8609-471747c44fb8 could not be found. Aug 23 07:13:46.199307 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi Aug 23 07:13:46.200381 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-5e9d1c5e-650a-4c6d-ac5e-ee293234c997 tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] Returning 404 to user: Instance 9d984b5d-f788-4a4c-8609-471747c44fb8 could not be found. {{(pid=120798) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 07:13:46.200381 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [None req-5e9d1c5e-650a-4c6d-ac5e-ee293234c997 tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] 10.222.0.17 "GET /compute/v2.1/servers/9d984b5d-f788-4a4c-8609-471747c44fb8/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.031749 Aug 23 07:13:46.200381 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 102/207] 10.222.0.17 () {58 vars in 1302 bytes} [Tue Aug 23 07:13:46 2022] GET /compute/v2.1/servers/9d984b5d-f788-4a4c-8609-471747c44fb8/os-volume_attachments => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 07:13:47.171821 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-0b891ef9-64f4-4e16-a1b8-671e2b4c6986 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Calling method '>' {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:13:47.172398 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.compute.api [None req-0b891ef9-64f4-4e16-a1b8-671e2b4c6986 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] [instance: 703acb74-65e6-4a60-9dd0-bf986498889e] Fetching instance by UUID {{(pid=120799) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:13:47.179630 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-0b891ef9-64f4-4e16-a1b8-671e2b4c6986 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:13:47.180360 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-0b891ef9-64f4-4e16-a1b8-671e2b4c6986 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:13:47.181118 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-0b891ef9-64f4-4e16-a1b8-671e2b4c6986 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:13:47.182032 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-0b891ef9-64f4-4e16-a1b8-671e2b4c6986 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:13:47.182485 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-0b891ef9-64f4-4e16-a1b8-671e2b4c6986 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:13:47.182909 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-0b891ef9-64f4-4e16-a1b8-671e2b4c6986 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:13:47.330553 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.policy [None req-0b891ef9-64f4-4e16-a1b8-671e2b4c6986 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64d54cb95b264c18b45d90822507fae1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135367be6e3f4b3d965ee0d99fdca524', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120799) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:13:47.339646 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-0b891ef9-64f4-4e16-a1b8-671e2b4c6986 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] 10.222.0.17 "GET /compute/v2.1/servers/703acb74-65e6-4a60-9dd0-bf986498889e" status: 200 len: 1522 microversion: 2.1 time: 0.171800 Aug 23 07:13:47.340311 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 106/208] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:13:47 2022] GET /compute/v2.1/servers/703acb74-65e6-4a60-9dd0-bf986498889e => generated 1522 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:13:48.364561 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-c5d61655-f8fe-4569-9861-0d6652047017 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Calling method '>' {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:13:48.365484 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.compute.api [None req-c5d61655-f8fe-4569-9861-0d6652047017 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] [instance: 703acb74-65e6-4a60-9dd0-bf986498889e] Fetching instance by UUID {{(pid=120798) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:13:48.376745 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-c5d61655-f8fe-4569-9861-0d6652047017 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:13:48.377681 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-c5d61655-f8fe-4569-9861-0d6652047017 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:13:48.378128 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-c5d61655-f8fe-4569-9861-0d6652047017 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:13:48.378810 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-c5d61655-f8fe-4569-9861-0d6652047017 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:13:48.379250 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-c5d61655-f8fe-4569-9861-0d6652047017 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:13:48.379693 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-c5d61655-f8fe-4569-9861-0d6652047017 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:13:48.517921 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.policy [None req-c5d61655-f8fe-4569-9861-0d6652047017 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64d54cb95b264c18b45d90822507fae1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135367be6e3f4b3d965ee0d99fdca524', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120798) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:13:48.526471 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [None req-c5d61655-f8fe-4569-9861-0d6652047017 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] 10.222.0.17 "GET /compute/v2.1/servers/703acb74-65e6-4a60-9dd0-bf986498889e" status: 200 len: 1522 microversion: 2.1 time: 0.168553 Aug 23 07:13:48.527035 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 103/209] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:13:48 2022] GET /compute/v2.1/servers/703acb74-65e6-4a60-9dd0-bf986498889e => generated 1522 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:13:49.548622 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-8276e0bc-91fa-46b2-bc14-f4c9776a2aac tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Calling method '>' {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:13:49.549305 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.compute.api [None req-8276e0bc-91fa-46b2-bc14-f4c9776a2aac tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] [instance: 703acb74-65e6-4a60-9dd0-bf986498889e] Fetching instance by UUID {{(pid=120799) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:13:49.556700 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-8276e0bc-91fa-46b2-bc14-f4c9776a2aac tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:13:49.557057 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-8276e0bc-91fa-46b2-bc14-f4c9776a2aac tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:13:49.557487 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-8276e0bc-91fa-46b2-bc14-f4c9776a2aac tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:13:49.558782 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-8276e0bc-91fa-46b2-bc14-f4c9776a2aac tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:13:49.559632 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-8276e0bc-91fa-46b2-bc14-f4c9776a2aac tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:13:49.560235 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-8276e0bc-91fa-46b2-bc14-f4c9776a2aac tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:13:49.682595 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-ead1a7cd-376d-4d33-a675-7e66da39f0f9 tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] Calling method '>' {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:13:49.683768 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.compute.api [None req-ead1a7cd-376d-4d33-a675-7e66da39f0f9 tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] [instance: 9d984b5d-f788-4a4c-8609-471747c44fb8] Fetching instance by UUID {{(pid=120798) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:13:49.690516 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-ead1a7cd-376d-4d33-a675-7e66da39f0f9 tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:13:49.690982 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-ead1a7cd-376d-4d33-a675-7e66da39f0f9 tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:13:49.691403 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-ead1a7cd-376d-4d33-a675-7e66da39f0f9 tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:13:49.692334 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-ead1a7cd-376d-4d33-a675-7e66da39f0f9 tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:13:49.692780 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-ead1a7cd-376d-4d33-a675-7e66da39f0f9 tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:13:49.693186 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-ead1a7cd-376d-4d33-a675-7e66da39f0f9 tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:13:49.722727 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.wsgi [None req-ead1a7cd-376d-4d33-a675-7e66da39f0f9 tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] HTTP exception thrown: Instance 9d984b5d-f788-4a4c-8609-471747c44fb8 could not be found. Aug 23 07:13:49.724760 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-ead1a7cd-376d-4d33-a675-7e66da39f0f9 tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] Request method failure captured: Aug 23 07:13:49.724760 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: request: DELETE /compute/v2.1/servers/9d984b5d-f788-4a4c-8609-471747c44fb8 HTTP/1.1 Aug 23 07:13:49.724760 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: Accept: application/json Aug 23 07:13:49.724760 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: Accept-Encoding: identity Aug 23 07:13:49.724760 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: Connection: close Aug 23 07:13:49.724760 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: Content-Length: 0 Aug 23 07:13:49.724760 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: Content-Type: application/json Aug 23 07:13:49.724760 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: Host: 10.222.0.17 Aug 23 07:13:49.724760 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: Openstack-System-Scope: None Aug 23 07:13:49.724760 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: User-Agent: python-urllib3/1.26.11 Aug 23 07:13:49.724760 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-Auth-Token: gAAAAABjBH3Wlp4xHSF1PlR-vQWxui5D6JvUypl2rVUD10jalFI5CCM7mPBBehqrEnO1IHaIvjSqpay6wjZoK9ak2lY93JEnDRjXnIN5bcLHtbhyeqHi90I-eOE0n3o8vTKgQx3MfgmT5n2JaxZpcpJaiaLvQOFBJYbpkNmpgsZzQAY-p0QoAVg Aug 23 07:13:49.724760 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-Domain-Id: None Aug 23 07:13:49.724760 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-Domain-Name: None Aug 23 07:13:49.724760 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-Identity-Status: Confirmed Aug 23 07:13:49.724760 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-Is-Admin-Project: True Aug 23 07:13:49.724760 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-Project-Domain-Id: default Aug 23 07:13:49.724760 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-Project-Domain-Name: Default Aug 23 07:13:49.724760 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-Project-Id: 24307daab4d24f979c30e081163c3bfe Aug 23 07:13:49.724760 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-Project-Name: tempest-DeleteServersTestJSON-1425922145 Aug 23 07:13:49.724760 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-Role: reader,member Aug 23 07:13:49.724760 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-Roles: reader,member Aug 23 07:13:49.725976 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/24307daab4d24f979c30e081163c3bfe"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/24307daab4d24f979c30e081163c3bfe"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_24307daab4d24f979c30e081163c3bfe"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/24307daab4d24f979c30e081163c3bfe"}]}] Aug 23 07:13:49.725976 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-Tenant: tempest-DeleteServersTestJSON-1425922145 Aug 23 07:13:49.725976 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-Tenant-Id: 24307daab4d24f979c30e081163c3bfe Aug 23 07:13:49.725976 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-Tenant-Name: tempest-DeleteServersTestJSON-1425922145 Aug 23 07:13:49.725976 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-User: tempest-DeleteServersTestJSON-1425922145-project Aug 23 07:13:49.725976 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-User-Domain-Id: default Aug 23 07:13:49.725976 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-User-Domain-Name: Default Aug 23 07:13:49.725976 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-User-Id: 6cbcc9668f454c0e8c27495a1827d703 Aug 23 07:13:49.725976 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-User-Name: tempest-DeleteServersTestJSON-1425922145-project Aug 23 07:13:49.725976 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: method: > Aug 23 07:13:49.725976 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: exception: Instance 9d984b5d-f788-4a4c-8609-471747c44fb8 could not be found. Aug 23 07:13:49.725976 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: action_args: {'id': '9d984b5d-f788-4a4c-8609-471747c44fb8'} Aug 23 07:13:49.726927 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 07:13:49.726927 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 07:13:49.726927 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 07:13:49.726927 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 07:13:49.726927 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 07:13:49.726927 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 07:13:49.726927 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 07:13:49.726927 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 07:13:49.726927 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 07:13:49.726927 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 07:13:49.726927 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9d984b5d-f788-4a4c-8609-471747c44fb8 could not be found. Aug 23 07:13:49.726927 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi Aug 23 07:13:49.726927 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 07:13:49.726927 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi Aug 23 07:13:49.726927 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 07:13:49.726927 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 07:13:49.726927 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 07:13:49.726927 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 07:13:49.726927 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 07:13:49.726927 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 07:13:49.728254 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 07:13:49.728254 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 23 07:13:49.728254 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 23 07:13:49.728254 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 23 07:13:49.728254 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 23 07:13:49.728254 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 07:13:49.728254 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 07:13:49.728254 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 07:13:49.728254 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 07:13:49.728254 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9d984b5d-f788-4a4c-8609-471747c44fb8 could not be found. Aug 23 07:13:49.728254 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi Aug 23 07:13:49.728254 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 07:13:49.728254 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi Aug 23 07:13:49.728254 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 07:13:49.728254 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 07:13:49.728254 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 07:13:49.728254 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 07:13:49.728254 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 07:13:49.728254 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9d984b5d-f788-4a4c-8609-471747c44fb8 could not be found. Aug 23 07:13:49.728254 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi Aug 23 07:13:49.732638 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-ead1a7cd-376d-4d33-a675-7e66da39f0f9 tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] Returning 404 to user: Instance 9d984b5d-f788-4a4c-8609-471747c44fb8 could not be found. {{(pid=120798) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 07:13:49.733648 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [None req-ead1a7cd-376d-4d33-a675-7e66da39f0f9 tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] 10.222.0.17 "DELETE /compute/v2.1/servers/9d984b5d-f788-4a4c-8609-471747c44fb8" status: 404 len: 111 microversion: 2.1 time: 0.055402 Aug 23 07:13:49.734502 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 104/210] 10.222.0.17 () {58 vars in 1239 bytes} [Tue Aug 23 07:13:49 2022] DELETE /compute/v2.1/servers/9d984b5d-f788-4a4c-8609-471747c44fb8 => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 07:13:49.737055 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.policy [None req-8276e0bc-91fa-46b2-bc14-f4c9776a2aac tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64d54cb95b264c18b45d90822507fae1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135367be6e3f4b3d965ee0d99fdca524', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120799) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:13:49.742510 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-2cc342c2-82ee-42f3-8586-46d19c8916fc tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] Calling method '>' {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:13:49.743109 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.compute.api [None req-2cc342c2-82ee-42f3-8586-46d19c8916fc tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] [instance: 9d984b5d-f788-4a4c-8609-471747c44fb8] Fetching instance by UUID {{(pid=120798) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:13:49.748207 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-8276e0bc-91fa-46b2-bc14-f4c9776a2aac tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] 10.222.0.17 "GET /compute/v2.1/servers/703acb74-65e6-4a60-9dd0-bf986498889e" status: 200 len: 1522 microversion: 2.1 time: 0.204023 Aug 23 07:13:49.748807 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 107/211] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:13:49 2022] GET /compute/v2.1/servers/703acb74-65e6-4a60-9dd0-bf986498889e => generated 1522 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:13:49.749715 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-2cc342c2-82ee-42f3-8586-46d19c8916fc tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:13:49.750291 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-2cc342c2-82ee-42f3-8586-46d19c8916fc tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:13:49.750760 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-2cc342c2-82ee-42f3-8586-46d19c8916fc tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:13:49.751510 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-2cc342c2-82ee-42f3-8586-46d19c8916fc tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:13:49.752002 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-2cc342c2-82ee-42f3-8586-46d19c8916fc tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:13:49.752416 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-2cc342c2-82ee-42f3-8586-46d19c8916fc tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:13:49.767853 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.wsgi [None req-2cc342c2-82ee-42f3-8586-46d19c8916fc tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] HTTP exception thrown: Instance 9d984b5d-f788-4a4c-8609-471747c44fb8 could not be found. Aug 23 07:13:49.769396 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-2cc342c2-82ee-42f3-8586-46d19c8916fc tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] Request method failure captured: Aug 23 07:13:49.769396 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: request: GET /compute/v2.1/servers/9d984b5d-f788-4a4c-8609-471747c44fb8 HTTP/1.1 Aug 23 07:13:49.769396 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: Accept: application/json Aug 23 07:13:49.769396 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: Accept-Encoding: identity Aug 23 07:13:49.769396 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: Connection: close Aug 23 07:13:49.769396 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: Content-Length: 0 Aug 23 07:13:49.769396 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: Content-Type: application/json Aug 23 07:13:49.769396 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: Host: 10.222.0.17 Aug 23 07:13:49.769396 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: Openstack-System-Scope: None Aug 23 07:13:49.769396 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: User-Agent: python-urllib3/1.26.11 Aug 23 07:13:49.769396 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-Auth-Token: gAAAAABjBH3Wlp4xHSF1PlR-vQWxui5D6JvUypl2rVUD10jalFI5CCM7mPBBehqrEnO1IHaIvjSqpay6wjZoK9ak2lY93JEnDRjXnIN5bcLHtbhyeqHi90I-eOE0n3o8vTKgQx3MfgmT5n2JaxZpcpJaiaLvQOFBJYbpkNmpgsZzQAY-p0QoAVg Aug 23 07:13:49.769396 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-Domain-Id: None Aug 23 07:13:49.769396 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-Domain-Name: None Aug 23 07:13:49.769396 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-Identity-Status: Confirmed Aug 23 07:13:49.769396 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-Is-Admin-Project: True Aug 23 07:13:49.769396 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-Project-Domain-Id: default Aug 23 07:13:49.769396 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-Project-Domain-Name: Default Aug 23 07:13:49.769396 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-Project-Id: 24307daab4d24f979c30e081163c3bfe Aug 23 07:13:49.769396 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-Project-Name: tempest-DeleteServersTestJSON-1425922145 Aug 23 07:13:49.769396 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-Role: reader,member Aug 23 07:13:49.769396 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-Roles: reader,member Aug 23 07:13:49.770642 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/24307daab4d24f979c30e081163c3bfe"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/24307daab4d24f979c30e081163c3bfe"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_24307daab4d24f979c30e081163c3bfe"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/24307daab4d24f979c30e081163c3bfe"}]}] Aug 23 07:13:49.770642 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-Tenant: tempest-DeleteServersTestJSON-1425922145 Aug 23 07:13:49.770642 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-Tenant-Id: 24307daab4d24f979c30e081163c3bfe Aug 23 07:13:49.770642 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-Tenant-Name: tempest-DeleteServersTestJSON-1425922145 Aug 23 07:13:49.770642 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-User: tempest-DeleteServersTestJSON-1425922145-project Aug 23 07:13:49.770642 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-User-Domain-Id: default Aug 23 07:13:49.770642 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-User-Domain-Name: Default Aug 23 07:13:49.770642 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-User-Id: 6cbcc9668f454c0e8c27495a1827d703 Aug 23 07:13:49.770642 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-User-Name: tempest-DeleteServersTestJSON-1425922145-project Aug 23 07:13:49.770642 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: method: > Aug 23 07:13:49.770642 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: exception: Instance 9d984b5d-f788-4a4c-8609-471747c44fb8 could not be found. Aug 23 07:13:49.770642 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: action_args: {'id': '9d984b5d-f788-4a4c-8609-471747c44fb8'} Aug 23 07:13:49.771301 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 07:13:49.771301 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 07:13:49.771301 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 07:13:49.771301 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 07:13:49.771301 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 07:13:49.771301 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 07:13:49.771301 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 07:13:49.771301 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 07:13:49.771301 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 07:13:49.771301 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 07:13:49.771301 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9d984b5d-f788-4a4c-8609-471747c44fb8 could not be found. Aug 23 07:13:49.771301 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi Aug 23 07:13:49.771301 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 07:13:49.771301 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi Aug 23 07:13:49.771301 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 07:13:49.771301 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 07:13:49.771301 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 07:13:49.771301 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 07:13:49.771301 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 07:13:49.771301 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 07:13:49.772492 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 07:13:49.772492 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 07:13:49.772492 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 07:13:49.772492 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 07:13:49.772492 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 07:13:49.772492 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 07:13:49.772492 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 07:13:49.772492 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9d984b5d-f788-4a4c-8609-471747c44fb8 could not be found. Aug 23 07:13:49.772492 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi Aug 23 07:13:49.772492 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 07:13:49.772492 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi Aug 23 07:13:49.772492 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 07:13:49.772492 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 07:13:49.772492 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 07:13:49.772492 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 07:13:49.772492 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 07:13:49.772492 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9d984b5d-f788-4a4c-8609-471747c44fb8 could not be found. Aug 23 07:13:49.772492 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi Aug 23 07:13:49.773453 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-2cc342c2-82ee-42f3-8586-46d19c8916fc tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] Returning 404 to user: Instance 9d984b5d-f788-4a4c-8609-471747c44fb8 could not be found. {{(pid=120798) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 07:13:49.773453 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [None req-2cc342c2-82ee-42f3-8586-46d19c8916fc tempest-DeleteServersTestJSON-1425922145 tempest-DeleteServersTestJSON-1425922145-project] 10.222.0.17 "GET /compute/v2.1/servers/9d984b5d-f788-4a4c-8609-471747c44fb8" status: 404 len: 111 microversion: 2.1 time: 0.032878 Aug 23 07:13:49.773453 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 105/212] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:13:49 2022] GET /compute/v2.1/servers/9d984b5d-f788-4a4c-8609-471747c44fb8 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 23 07:13:50.771374 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-67339d78-6d21-4b0e-8502-aa9b3c28779f tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Calling method '>' {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:13:50.772669 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.compute.api [None req-67339d78-6d21-4b0e-8502-aa9b3c28779f tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] [instance: 703acb74-65e6-4a60-9dd0-bf986498889e] Fetching instance by UUID {{(pid=120799) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:13:50.779203 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-67339d78-6d21-4b0e-8502-aa9b3c28779f tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:13:50.779883 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-67339d78-6d21-4b0e-8502-aa9b3c28779f tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:13:50.780338 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-67339d78-6d21-4b0e-8502-aa9b3c28779f tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:13:50.781085 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-67339d78-6d21-4b0e-8502-aa9b3c28779f tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:13:50.781694 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-67339d78-6d21-4b0e-8502-aa9b3c28779f tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:13:50.782241 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-67339d78-6d21-4b0e-8502-aa9b3c28779f tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:13:51.084312 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.policy [None req-67339d78-6d21-4b0e-8502-aa9b3c28779f tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64d54cb95b264c18b45d90822507fae1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135367be6e3f4b3d965ee0d99fdca524', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120799) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:13:51.095333 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-67339d78-6d21-4b0e-8502-aa9b3c28779f tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] 10.222.0.17 "GET /compute/v2.1/servers/703acb74-65e6-4a60-9dd0-bf986498889e" status: 200 len: 1522 microversion: 2.1 time: 0.328387 Aug 23 07:13:51.096278 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 108/213] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:13:50 2022] GET /compute/v2.1/servers/703acb74-65e6-4a60-9dd0-bf986498889e => generated 1522 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:13:52.118624 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-b0e3130e-7b4e-4d79-ace3-46d8b80ed0db tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Calling method '>' {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:13:52.119946 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.compute.api [None req-b0e3130e-7b4e-4d79-ace3-46d8b80ed0db tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] [instance: 703acb74-65e6-4a60-9dd0-bf986498889e] Fetching instance by UUID {{(pid=120798) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:13:52.123647 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG dbcounter [-] [120798] Writing DB stats nova_api:SELECT=43,nova_api:UPDATE=1 {{(pid=120798) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:13:52.140877 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-b0e3130e-7b4e-4d79-ace3-46d8b80ed0db tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:13:52.142499 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-b0e3130e-7b4e-4d79-ace3-46d8b80ed0db tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:13:52.144130 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-b0e3130e-7b4e-4d79-ace3-46d8b80ed0db tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:13:52.145037 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-b0e3130e-7b4e-4d79-ace3-46d8b80ed0db tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:13:52.146513 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-b0e3130e-7b4e-4d79-ace3-46d8b80ed0db tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:13:52.148515 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-b0e3130e-7b4e-4d79-ace3-46d8b80ed0db tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:13:52.435313 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.policy [None req-b0e3130e-7b4e-4d79-ace3-46d8b80ed0db tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64d54cb95b264c18b45d90822507fae1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135367be6e3f4b3d965ee0d99fdca524', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120798) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:13:52.447008 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [None req-b0e3130e-7b4e-4d79-ace3-46d8b80ed0db tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] 10.222.0.17 "GET /compute/v2.1/servers/703acb74-65e6-4a60-9dd0-bf986498889e" status: 200 len: 1522 microversion: 2.1 time: 0.332518 Aug 23 07:13:52.448235 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 106/214] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:13:52 2022] GET /compute/v2.1/servers/703acb74-65e6-4a60-9dd0-bf986498889e => generated 1522 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:13:53.469311 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-34d2d732-4c50-469b-b7d2-acbe12c26bca tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Calling method '>' {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:13:53.470021 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.compute.api [None req-34d2d732-4c50-469b-b7d2-acbe12c26bca tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] [instance: 703acb74-65e6-4a60-9dd0-bf986498889e] Fetching instance by UUID {{(pid=120799) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:13:53.477279 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-34d2d732-4c50-469b-b7d2-acbe12c26bca tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:13:53.477844 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-34d2d732-4c50-469b-b7d2-acbe12c26bca tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:13:53.478415 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-34d2d732-4c50-469b-b7d2-acbe12c26bca tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:13:53.479230 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-34d2d732-4c50-469b-b7d2-acbe12c26bca tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:13:53.479786 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-34d2d732-4c50-469b-b7d2-acbe12c26bca tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:13:53.480563 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-34d2d732-4c50-469b-b7d2-acbe12c26bca tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:13:53.626417 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.policy [None req-34d2d732-4c50-469b-b7d2-acbe12c26bca tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64d54cb95b264c18b45d90822507fae1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135367be6e3f4b3d965ee0d99fdca524', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120799) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:13:53.638831 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-34d2d732-4c50-469b-b7d2-acbe12c26bca tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] 10.222.0.17 "GET /compute/v2.1/servers/703acb74-65e6-4a60-9dd0-bf986498889e" status: 200 len: 1522 microversion: 2.1 time: 0.173959 Aug 23 07:13:53.639531 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 109/215] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:13:53 2022] GET /compute/v2.1/servers/703acb74-65e6-4a60-9dd0-bf986498889e => generated 1522 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:13:54.660128 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-fb6d9452-e63d-4607-af96-55adbd6c2800 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Calling method '>' {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:13:54.661178 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.compute.api [None req-fb6d9452-e63d-4607-af96-55adbd6c2800 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] [instance: 703acb74-65e6-4a60-9dd0-bf986498889e] Fetching instance by UUID {{(pid=120798) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:13:54.671973 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-fb6d9452-e63d-4607-af96-55adbd6c2800 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:13:54.672893 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-fb6d9452-e63d-4607-af96-55adbd6c2800 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:13:54.673866 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-fb6d9452-e63d-4607-af96-55adbd6c2800 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:13:54.675273 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-fb6d9452-e63d-4607-af96-55adbd6c2800 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:13:54.675995 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-fb6d9452-e63d-4607-af96-55adbd6c2800 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:13:54.676713 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-fb6d9452-e63d-4607-af96-55adbd6c2800 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:13:54.712324 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-ad774d89-b7e1-46f5-89c3-449e4e0470cb tempest-VolumesActionsTest-775986377 tempest-VolumesActionsTest-775986377-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1781426745", "imageRef": "b899fd65-02ae-4b43-bac7-86f38fc3f224", "flavorRef": "452", "networks": [{"uuid": "65ebeea8-bec0-4130-be8f-fea4bfc58160"}]}} {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 07:13:54.770551 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.network.neutron [None req-ad774d89-b7e1-46f5-89c3-449e4e0470cb tempest-VolumesActionsTest-775986377 tempest-VolumesActionsTest-775986377-project] validate_networks() for [('65ebeea8-bec0-4130-be8f-fea4bfc58160', None, None, None, None, None)] {{(pid=120799) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 23 07:13:54.989893 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.policy [None req-fb6d9452-e63d-4607-af96-55adbd6c2800 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64d54cb95b264c18b45d90822507fae1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135367be6e3f4b3d965ee0d99fdca524', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120798) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:13:55.004427 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [None req-fb6d9452-e63d-4607-af96-55adbd6c2800 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] 10.222.0.17 "GET /compute/v2.1/servers/703acb74-65e6-4a60-9dd0-bf986498889e" status: 200 len: 1522 microversion: 2.1 time: 0.348233 Aug 23 07:13:55.023553 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 107/216] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:13:54 2022] GET /compute/v2.1/servers/703acb74-65e6-4a60-9dd0-bf986498889e => generated 1522 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:13:55.393920 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.virt.hardware [None req-ad774d89-b7e1-46f5-89c3-449e4e0470cb tempest-VolumesActionsTest-775986377 tempest-VolumesActionsTest-775986377-project] Flavor limits 0:0:0 {{(pid=120799) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 07:13:55.395229 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.virt.hardware [None req-ad774d89-b7e1-46f5-89c3-449e4e0470cb tempest-VolumesActionsTest-775986377 tempest-VolumesActionsTest-775986377-project] Image limits 0:0:0 {{(pid=120799) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 07:13:55.395741 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.virt.hardware [None req-ad774d89-b7e1-46f5-89c3-449e4e0470cb tempest-VolumesActionsTest-775986377 tempest-VolumesActionsTest-775986377-project] Flavor pref 0:0:0 {{(pid=120799) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 07:13:55.396851 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.virt.hardware [None req-ad774d89-b7e1-46f5-89c3-449e4e0470cb tempest-VolumesActionsTest-775986377 tempest-VolumesActionsTest-775986377-project] Image pref 0:0:0 {{(pid=120799) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 07:13:55.397152 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.virt.hardware [None req-ad774d89-b7e1-46f5-89c3-449e4e0470cb tempest-VolumesActionsTest-775986377 tempest-VolumesActionsTest-775986377-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120799) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 07:13:55.412447 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-ad774d89-b7e1-46f5-89c3-449e4e0470cb tempest-VolumesActionsTest-775986377 tempest-VolumesActionsTest-775986377-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:13:55.412951 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-ad774d89-b7e1-46f5-89c3-449e4e0470cb tempest-VolumesActionsTest-775986377 tempest-VolumesActionsTest-775986377-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:13:55.413485 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-ad774d89-b7e1-46f5-89c3-449e4e0470cb tempest-VolumesActionsTest-775986377 tempest-VolumesActionsTest-775986377-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:13:55.414224 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-ad774d89-b7e1-46f5-89c3-449e4e0470cb tempest-VolumesActionsTest-775986377 tempest-VolumesActionsTest-775986377-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:13:55.414660 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-ad774d89-b7e1-46f5-89c3-449e4e0470cb tempest-VolumesActionsTest-775986377 tempest-VolumesActionsTest-775986377-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:13:55.415246 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-ad774d89-b7e1-46f5-89c3-449e4e0470cb tempest-VolumesActionsTest-775986377 tempest-VolumesActionsTest-775986377-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:13:55.435034 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.quota [None req-ad774d89-b7e1-46f5-89c3-449e4e0470cb tempest-VolumesActionsTest-775986377 tempest-VolumesActionsTest-775986377-project] Getting quotas for project 0a2ef3b6384a4194a26ba51078c425af. Resources: {'ram', 'instances', 'cores'} {{(pid=120799) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 07:13:55.440011 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.quota [None req-ad774d89-b7e1-46f5-89c3-449e4e0470cb tempest-VolumesActionsTest-775986377 tempest-VolumesActionsTest-775986377-project] Getting quotas for user 9f4d65ffaab942f29d449b64805c765a and project 0a2ef3b6384a4194a26ba51078c425af. Resources: {'ram', 'instances', 'cores'} {{(pid=120799) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 07:13:55.455241 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.compute.api [None req-ad774d89-b7e1-46f5-89c3-449e4e0470cb tempest-VolumesActionsTest-775986377 tempest-VolumesActionsTest-775986377-project] Going to run 1 instances... {{(pid=120799) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 23 07:13:55.459781 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.compute.api [None req-ad774d89-b7e1-46f5-89c3-449e4e0470cb tempest-VolumesActionsTest-775986377 tempest-VolumesActionsTest-775986377-project] [instance: 6e6b1d40-6b77-4b49-b468-e936f953f85a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b899fd65-02ae-4b43-bac7-86f38fc3f224',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120799) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 07:13:55.516406 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-ad774d89-b7e1-46f5-89c3-449e4e0470cb tempest-VolumesActionsTest-775986377 tempest-VolumesActionsTest-775986377-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.808077 Aug 23 07:13:55.517149 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 110/217] 10.222.0.17 () {60 vars in 1147 bytes} [Tue Aug 23 07:13:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 810 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 23 07:13:55.529734 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-482a8962-cf91-43e1-a5df-e413f2e9b0e1 tempest-VolumesActionsTest-775986377 tempest-VolumesActionsTest-775986377-project] Calling method '>' {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:13:55.530442 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.compute.api [None req-482a8962-cf91-43e1-a5df-e413f2e9b0e1 tempest-VolumesActionsTest-775986377 tempest-VolumesActionsTest-775986377-project] [instance: 6e6b1d40-6b77-4b49-b468-e936f953f85a] Fetching instance by UUID {{(pid=120798) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:13:55.630874 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.policy [None req-482a8962-cf91-43e1-a5df-e413f2e9b0e1 tempest-VolumesActionsTest-775986377 tempest-VolumesActionsTest-775986377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f4d65ffaab942f29d449b64805c765a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2ef3b6384a4194a26ba51078c425af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120798) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:13:55.640827 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [None req-482a8962-cf91-43e1-a5df-e413f2e9b0e1 tempest-VolumesActionsTest-775986377 tempest-VolumesActionsTest-775986377-project] 10.222.0.17 "GET /compute/v2.1/servers/6e6b1d40-6b77-4b49-b468-e936f953f85a" status: 200 len: 1214 microversion: 2.1 time: 0.115850 Aug 23 07:13:55.641405 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 108/218] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:13:55 2022] GET /compute/v2.1/servers/6e6b1d40-6b77-4b49-b468-e936f953f85a => generated 1214 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:13:56.024821 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-dc24d10a-e7f5-4663-b2e4-80a1827db81f tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Calling method '>' {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:13:56.025939 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.compute.api [None req-dc24d10a-e7f5-4663-b2e4-80a1827db81f tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] [instance: 703acb74-65e6-4a60-9dd0-bf986498889e] Fetching instance by UUID {{(pid=120799) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:13:56.034746 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-dc24d10a-e7f5-4663-b2e4-80a1827db81f tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:13:56.035681 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-dc24d10a-e7f5-4663-b2e4-80a1827db81f tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:13:56.036478 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-dc24d10a-e7f5-4663-b2e4-80a1827db81f tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:13:56.037694 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-dc24d10a-e7f5-4663-b2e4-80a1827db81f tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:13:56.038339 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-dc24d10a-e7f5-4663-b2e4-80a1827db81f tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:13:56.038986 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-dc24d10a-e7f5-4663-b2e4-80a1827db81f tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:13:56.222615 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.policy [None req-dc24d10a-e7f5-4663-b2e4-80a1827db81f tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64d54cb95b264c18b45d90822507fae1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135367be6e3f4b3d965ee0d99fdca524', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120799) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:13:56.232402 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-dc24d10a-e7f5-4663-b2e4-80a1827db81f tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] 10.222.0.17 "GET /compute/v2.1/servers/703acb74-65e6-4a60-9dd0-bf986498889e" status: 200 len: 1522 microversion: 2.1 time: 0.210778 Aug 23 07:13:56.243449 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 111/219] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:13:56 2022] GET /compute/v2.1/servers/703acb74-65e6-4a60-9dd0-bf986498889e => generated 1522 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:13:56.663625 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-106739c4-a410-4bc9-9f52-8eab7e3227a8 tempest-VolumesActionsTest-775986377 tempest-VolumesActionsTest-775986377-project] Calling method '>' {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:13:56.664426 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.compute.api [None req-106739c4-a410-4bc9-9f52-8eab7e3227a8 tempest-VolumesActionsTest-775986377 tempest-VolumesActionsTest-775986377-project] [instance: 6e6b1d40-6b77-4b49-b468-e936f953f85a] Fetching instance by UUID {{(pid=120798) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:13:56.670981 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-106739c4-a410-4bc9-9f52-8eab7e3227a8 tempest-VolumesActionsTest-775986377 tempest-VolumesActionsTest-775986377-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:13:56.671481 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-106739c4-a410-4bc9-9f52-8eab7e3227a8 tempest-VolumesActionsTest-775986377 tempest-VolumesActionsTest-775986377-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:13:56.671904 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-106739c4-a410-4bc9-9f52-8eab7e3227a8 tempest-VolumesActionsTest-775986377 tempest-VolumesActionsTest-775986377-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:13:56.672583 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-106739c4-a410-4bc9-9f52-8eab7e3227a8 tempest-VolumesActionsTest-775986377 tempest-VolumesActionsTest-775986377-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:13:56.673302 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-106739c4-a410-4bc9-9f52-8eab7e3227a8 tempest-VolumesActionsTest-775986377 tempest-VolumesActionsTest-775986377-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:13:56.679383 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-106739c4-a410-4bc9-9f52-8eab7e3227a8 tempest-VolumesActionsTest-775986377 tempest-VolumesActionsTest-775986377-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:13:56.782508 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.policy [None req-106739c4-a410-4bc9-9f52-8eab7e3227a8 tempest-VolumesActionsTest-775986377 tempest-VolumesActionsTest-775986377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f4d65ffaab942f29d449b64805c765a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2ef3b6384a4194a26ba51078c425af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120798) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:13:56.792887 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [None req-106739c4-a410-4bc9-9f52-8eab7e3227a8 tempest-VolumesActionsTest-775986377 tempest-VolumesActionsTest-775986377-project] 10.222.0.17 "GET /compute/v2.1/servers/6e6b1d40-6b77-4b49-b468-e936f953f85a" status: 200 len: 1266 microversion: 2.1 time: 0.134302 Aug 23 07:13:56.804684 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 109/220] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:13:56 2022] GET /compute/v2.1/servers/6e6b1d40-6b77-4b49-b468-e936f953f85a => generated 1266 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:13:57.263439 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-abc9973b-5d35-4bab-8b53-7bac5c3b3bcb tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Calling method '>' {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:13:57.264267 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.compute.api [None req-abc9973b-5d35-4bab-8b53-7bac5c3b3bcb tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] [instance: 703acb74-65e6-4a60-9dd0-bf986498889e] Fetching instance by UUID {{(pid=120799) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:13:57.271948 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-abc9973b-5d35-4bab-8b53-7bac5c3b3bcb tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:13:57.272724 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-abc9973b-5d35-4bab-8b53-7bac5c3b3bcb tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:13:57.273313 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-abc9973b-5d35-4bab-8b53-7bac5c3b3bcb tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:13:57.274197 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-abc9973b-5d35-4bab-8b53-7bac5c3b3bcb tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:13:57.274772 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-abc9973b-5d35-4bab-8b53-7bac5c3b3bcb tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:13:57.275265 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-abc9973b-5d35-4bab-8b53-7bac5c3b3bcb tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:13:57.605874 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.policy [None req-abc9973b-5d35-4bab-8b53-7bac5c3b3bcb tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64d54cb95b264c18b45d90822507fae1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135367be6e3f4b3d965ee0d99fdca524', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120799) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:13:57.616168 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-abc9973b-5d35-4bab-8b53-7bac5c3b3bcb tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] 10.222.0.17 "GET /compute/v2.1/servers/703acb74-65e6-4a60-9dd0-bf986498889e" status: 200 len: 1522 microversion: 2.1 time: 0.357701 Aug 23 07:13:57.616758 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 112/221] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:13:57 2022] GET /compute/v2.1/servers/703acb74-65e6-4a60-9dd0-bf986498889e => generated 1522 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:13:57.816205 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-b725a21c-809f-4f2c-ab59-2b69070c1cdd tempest-VolumesActionsTest-775986377 tempest-VolumesActionsTest-775986377-project] Calling method '>' {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:13:57.818428 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.compute.api [None req-b725a21c-809f-4f2c-ab59-2b69070c1cdd tempest-VolumesActionsTest-775986377 tempest-VolumesActionsTest-775986377-project] [instance: 6e6b1d40-6b77-4b49-b468-e936f953f85a] Fetching instance by UUID {{(pid=120798) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:13:57.826872 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-b725a21c-809f-4f2c-ab59-2b69070c1cdd tempest-VolumesActionsTest-775986377 tempest-VolumesActionsTest-775986377-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:13:57.827661 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-b725a21c-809f-4f2c-ab59-2b69070c1cdd tempest-VolumesActionsTest-775986377 tempest-VolumesActionsTest-775986377-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:13:57.828091 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-b725a21c-809f-4f2c-ab59-2b69070c1cdd tempest-VolumesActionsTest-775986377 tempest-VolumesActionsTest-775986377-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:13:57.829698 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-b725a21c-809f-4f2c-ab59-2b69070c1cdd tempest-VolumesActionsTest-775986377 tempest-VolumesActionsTest-775986377-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:13:57.830150 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-b725a21c-809f-4f2c-ab59-2b69070c1cdd tempest-VolumesActionsTest-775986377 tempest-VolumesActionsTest-775986377-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:13:57.830564 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-b725a21c-809f-4f2c-ab59-2b69070c1cdd tempest-VolumesActionsTest-775986377 tempest-VolumesActionsTest-775986377-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:13:58.097643 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.policy [None req-b725a21c-809f-4f2c-ab59-2b69070c1cdd tempest-VolumesActionsTest-775986377 tempest-VolumesActionsTest-775986377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f4d65ffaab942f29d449b64805c765a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2ef3b6384a4194a26ba51078c425af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120798) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:13:58.112834 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [None req-b725a21c-809f-4f2c-ab59-2b69070c1cdd tempest-VolumesActionsTest-775986377 tempest-VolumesActionsTest-775986377-project] 10.222.0.17 "GET /compute/v2.1/servers/6e6b1d40-6b77-4b49-b468-e936f953f85a" status: 200 len: 1314 microversion: 2.1 time: 0.300494 Aug 23 07:13:58.113447 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 110/222] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:13:57 2022] GET /compute/v2.1/servers/6e6b1d40-6b77-4b49-b468-e936f953f85a => generated 1314 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:13:58.639731 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-d065a10c-2f26-4ec7-8d6c-f9ecf62f646b tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Calling method '>' {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:13:58.640382 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.compute.api [None req-d065a10c-2f26-4ec7-8d6c-f9ecf62f646b tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] [instance: 703acb74-65e6-4a60-9dd0-bf986498889e] Fetching instance by UUID {{(pid=120799) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:13:58.657388 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-d065a10c-2f26-4ec7-8d6c-f9ecf62f646b tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:13:58.657388 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-d065a10c-2f26-4ec7-8d6c-f9ecf62f646b tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:13:58.657388 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-d065a10c-2f26-4ec7-8d6c-f9ecf62f646b tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:13:58.657635 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-d065a10c-2f26-4ec7-8d6c-f9ecf62f646b tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:13:58.657918 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-d065a10c-2f26-4ec7-8d6c-f9ecf62f646b tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:13:58.661909 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-d065a10c-2f26-4ec7-8d6c-f9ecf62f646b tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:13:58.701641 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [req-54682687-1877-470b-9ebd-11f961208cd2 req-b45abb85-eb09-46c0-89e3-ececb4454c64 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6e6b1d40-6b77-4b49-b468-e936f953f85a", "tag": "08e76269-cdd0-400b-805a-c3bc0fe3bde0"}]} {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 07:13:58.718987 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [req-54682687-1877-470b-9ebd-11f961208cd2 req-b45abb85-eb09-46c0-89e3-ececb4454c64 service nova] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:13:58.722191 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [req-54682687-1877-470b-9ebd-11f961208cd2 req-b45abb85-eb09-46c0-89e3-ececb4454c64 service nova] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:13:58.724713 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [req-54682687-1877-470b-9ebd-11f961208cd2 req-b45abb85-eb09-46c0-89e3-ececb4454c64 service nova] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:13:58.739928 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.compute.server_external_events [req-54682687-1877-470b-9ebd-11f961208cd2 req-b45abb85-eb09-46c0-89e3-ececb4454c64 service nova] Creating event network-changed:08e76269-cdd0-400b-805a-c3bc0fe3bde0 for instance 6e6b1d40-6b77-4b49-b468-e936f953f85a on hv-cinder-85409 Aug 23 07:13:58.747075 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [req-54682687-1877-470b-9ebd-11f961208cd2 req-b45abb85-eb09-46c0-89e3-ececb4454c64 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049474 Aug 23 07:13:58.749630 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 111/223] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Aug 23 07:13:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 07:13:58.933963 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.policy [None req-d065a10c-2f26-4ec7-8d6c-f9ecf62f646b tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64d54cb95b264c18b45d90822507fae1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135367be6e3f4b3d965ee0d99fdca524', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120799) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:13:58.941779 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-d065a10c-2f26-4ec7-8d6c-f9ecf62f646b tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] 10.222.0.17 "GET /compute/v2.1/servers/703acb74-65e6-4a60-9dd0-bf986498889e" status: 200 len: 1522 microversion: 2.1 time: 0.306113 Aug 23 07:13:58.942484 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 113/224] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:13:58 2022] GET /compute/v2.1/servers/703acb74-65e6-4a60-9dd0-bf986498889e => generated 1522 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 07:13:59.134942 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-304cb11a-a025-4d27-968e-1b706d2bb0ce tempest-VolumesActionsTest-775986377 tempest-VolumesActionsTest-775986377-project] Calling method '>' {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:13:59.136360 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.compute.api [None req-304cb11a-a025-4d27-968e-1b706d2bb0ce tempest-VolumesActionsTest-775986377 tempest-VolumesActionsTest-775986377-project] [instance: 6e6b1d40-6b77-4b49-b468-e936f953f85a] Fetching instance by UUID {{(pid=120798) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:13:59.155746 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-304cb11a-a025-4d27-968e-1b706d2bb0ce tempest-VolumesActionsTest-775986377 tempest-VolumesActionsTest-775986377-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:13:59.156465 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-304cb11a-a025-4d27-968e-1b706d2bb0ce tempest-VolumesActionsTest-775986377 tempest-VolumesActionsTest-775986377-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:13:59.157407 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-304cb11a-a025-4d27-968e-1b706d2bb0ce tempest-VolumesActionsTest-775986377 tempest-VolumesActionsTest-775986377-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:13:59.158266 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-304cb11a-a025-4d27-968e-1b706d2bb0ce tempest-VolumesActionsTest-775986377 tempest-VolumesActionsTest-775986377-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:13:59.158849 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-304cb11a-a025-4d27-968e-1b706d2bb0ce tempest-VolumesActionsTest-775986377 tempest-VolumesActionsTest-775986377-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:13:59.159404 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-304cb11a-a025-4d27-968e-1b706d2bb0ce tempest-VolumesActionsTest-775986377 tempest-VolumesActionsTest-775986377-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:13:59.345349 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.policy [None req-304cb11a-a025-4d27-968e-1b706d2bb0ce tempest-VolumesActionsTest-775986377 tempest-VolumesActionsTest-775986377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f4d65ffaab942f29d449b64805c765a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2ef3b6384a4194a26ba51078c425af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120798) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:13:59.361751 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [None req-304cb11a-a025-4d27-968e-1b706d2bb0ce tempest-VolumesActionsTest-775986377 tempest-VolumesActionsTest-775986377-project] 10.222.0.17 "GET /compute/v2.1/servers/6e6b1d40-6b77-4b49-b468-e936f953f85a" status: 200 len: 1314 microversion: 2.1 time: 0.230830 Aug 23 07:13:59.362567 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 112/225] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:13:59 2022] GET /compute/v2.1/servers/6e6b1d40-6b77-4b49-b468-e936f953f85a => generated 1314 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:13:59.962488 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-0a282946-1c43-41ce-9027-64a244c8f177 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Calling method '>' {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:13:59.963072 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.compute.api [None req-0a282946-1c43-41ce-9027-64a244c8f177 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] [instance: 703acb74-65e6-4a60-9dd0-bf986498889e] Fetching instance by UUID {{(pid=120799) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:13:59.971308 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-0a282946-1c43-41ce-9027-64a244c8f177 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:13:59.971912 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-0a282946-1c43-41ce-9027-64a244c8f177 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:13:59.972713 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-0a282946-1c43-41ce-9027-64a244c8f177 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:13:59.973914 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-0a282946-1c43-41ce-9027-64a244c8f177 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:13:59.974652 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-0a282946-1c43-41ce-9027-64a244c8f177 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:13:59.975512 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-0a282946-1c43-41ce-9027-64a244c8f177 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:14:00.192596 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.policy [None req-0a282946-1c43-41ce-9027-64a244c8f177 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64d54cb95b264c18b45d90822507fae1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135367be6e3f4b3d965ee0d99fdca524', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120799) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:14:00.203395 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-0a282946-1c43-41ce-9027-64a244c8f177 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] 10.222.0.17 "GET /compute/v2.1/servers/703acb74-65e6-4a60-9dd0-bf986498889e" status: 200 len: 1522 microversion: 2.1 time: 0.244768 Aug 23 07:14:00.203996 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 114/226] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:13:59 2022] GET /compute/v2.1/servers/703acb74-65e6-4a60-9dd0-bf986498889e => generated 1522 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:14:00.387702 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-8cb15f8c-94f7-4f81-bca2-35405eee2710 tempest-VolumesActionsTest-775986377 tempest-VolumesActionsTest-775986377-project] Calling method '>' {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:14:00.388822 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.compute.api [None req-8cb15f8c-94f7-4f81-bca2-35405eee2710 tempest-VolumesActionsTest-775986377 tempest-VolumesActionsTest-775986377-project] [instance: 6e6b1d40-6b77-4b49-b468-e936f953f85a] Fetching instance by UUID {{(pid=120798) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:14:00.398895 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-8cb15f8c-94f7-4f81-bca2-35405eee2710 tempest-VolumesActionsTest-775986377 tempest-VolumesActionsTest-775986377-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:14:00.399782 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-8cb15f8c-94f7-4f81-bca2-35405eee2710 tempest-VolumesActionsTest-775986377 tempest-VolumesActionsTest-775986377-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:14:00.400473 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-8cb15f8c-94f7-4f81-bca2-35405eee2710 tempest-VolumesActionsTest-775986377 tempest-VolumesActionsTest-775986377-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:14:00.401562 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-8cb15f8c-94f7-4f81-bca2-35405eee2710 tempest-VolumesActionsTest-775986377 tempest-VolumesActionsTest-775986377-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:14:00.402314 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-8cb15f8c-94f7-4f81-bca2-35405eee2710 tempest-VolumesActionsTest-775986377 tempest-VolumesActionsTest-775986377-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:14:00.403012 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-8cb15f8c-94f7-4f81-bca2-35405eee2710 tempest-VolumesActionsTest-775986377 tempest-VolumesActionsTest-775986377-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:14:00.566335 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.policy [None req-8cb15f8c-94f7-4f81-bca2-35405eee2710 tempest-VolumesActionsTest-775986377 tempest-VolumesActionsTest-775986377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f4d65ffaab942f29d449b64805c765a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2ef3b6384a4194a26ba51078c425af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120798) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:14:00.575280 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [None req-8cb15f8c-94f7-4f81-bca2-35405eee2710 tempest-VolumesActionsTest-775986377 tempest-VolumesActionsTest-775986377-project] 10.222.0.17 "GET /compute/v2.1/servers/6e6b1d40-6b77-4b49-b468-e936f953f85a" status: 200 len: 1314 microversion: 2.1 time: 0.194699 Aug 23 07:14:00.576015 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 113/227] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:14:00 2022] GET /compute/v2.1/servers/6e6b1d40-6b77-4b49-b468-e936f953f85a => generated 1314 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:14:01.227636 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-8e66b8c3-13f1-4e20-b34b-1282bac09197 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Calling method '>' {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:14:01.227636 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.compute.api [None req-8e66b8c3-13f1-4e20-b34b-1282bac09197 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] [instance: 703acb74-65e6-4a60-9dd0-bf986498889e] Fetching instance by UUID {{(pid=120799) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:14:01.233772 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-8e66b8c3-13f1-4e20-b34b-1282bac09197 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:14:01.234489 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-8e66b8c3-13f1-4e20-b34b-1282bac09197 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:14:01.235128 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-8e66b8c3-13f1-4e20-b34b-1282bac09197 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:14:01.236463 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-8e66b8c3-13f1-4e20-b34b-1282bac09197 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:14:01.237315 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-8e66b8c3-13f1-4e20-b34b-1282bac09197 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:14:01.237914 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-8e66b8c3-13f1-4e20-b34b-1282bac09197 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:14:01.462213 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.policy [None req-8e66b8c3-13f1-4e20-b34b-1282bac09197 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64d54cb95b264c18b45d90822507fae1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135367be6e3f4b3d965ee0d99fdca524', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120799) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:14:01.475646 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-8e66b8c3-13f1-4e20-b34b-1282bac09197 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] 10.222.0.17 "GET /compute/v2.1/servers/703acb74-65e6-4a60-9dd0-bf986498889e" status: 200 len: 1522 microversion: 2.1 time: 0.251256 Aug 23 07:14:01.475646 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 115/228] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:14:01 2022] GET /compute/v2.1/servers/703acb74-65e6-4a60-9dd0-bf986498889e => generated 1522 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:14:01.597247 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-996e08f2-80da-489f-94b1-65c98d5c1b8e tempest-VolumesActionsTest-775986377 tempest-VolumesActionsTest-775986377-project] Calling method '>' {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:14:01.597869 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.compute.api [None req-996e08f2-80da-489f-94b1-65c98d5c1b8e tempest-VolumesActionsTest-775986377 tempest-VolumesActionsTest-775986377-project] [instance: 6e6b1d40-6b77-4b49-b468-e936f953f85a] Fetching instance by UUID {{(pid=120798) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:14:01.604612 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-996e08f2-80da-489f-94b1-65c98d5c1b8e tempest-VolumesActionsTest-775986377 tempest-VolumesActionsTest-775986377-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:14:01.605098 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-996e08f2-80da-489f-94b1-65c98d5c1b8e tempest-VolumesActionsTest-775986377 tempest-VolumesActionsTest-775986377-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:14:01.605529 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-996e08f2-80da-489f-94b1-65c98d5c1b8e tempest-VolumesActionsTest-775986377 tempest-VolumesActionsTest-775986377-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:14:01.606219 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-996e08f2-80da-489f-94b1-65c98d5c1b8e tempest-VolumesActionsTest-775986377 tempest-VolumesActionsTest-775986377-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:14:01.606667 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-996e08f2-80da-489f-94b1-65c98d5c1b8e tempest-VolumesActionsTest-775986377 tempest-VolumesActionsTest-775986377-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:14:01.607117 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-996e08f2-80da-489f-94b1-65c98d5c1b8e tempest-VolumesActionsTest-775986377 tempest-VolumesActionsTest-775986377-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:14:01.795511 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.policy [None req-996e08f2-80da-489f-94b1-65c98d5c1b8e tempest-VolumesActionsTest-775986377 tempest-VolumesActionsTest-775986377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f4d65ffaab942f29d449b64805c765a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2ef3b6384a4194a26ba51078c425af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120798) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:14:01.802206 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG dbcounter [-] [120798] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120798) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:14:01.806057 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [None req-996e08f2-80da-489f-94b1-65c98d5c1b8e tempest-VolumesActionsTest-775986377 tempest-VolumesActionsTest-775986377-project] 10.222.0.17 "GET /compute/v2.1/servers/6e6b1d40-6b77-4b49-b468-e936f953f85a" status: 200 len: 1314 microversion: 2.1 time: 0.212614 Aug 23 07:14:01.807249 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 114/229] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:14:01 2022] GET /compute/v2.1/servers/6e6b1d40-6b77-4b49-b468-e936f953f85a => generated 1314 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:14:02.494534 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-2c7b0d20-7bee-4924-9bb6-1201922e40c0 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Calling method '>' {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:14:02.495232 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.compute.api [None req-2c7b0d20-7bee-4924-9bb6-1201922e40c0 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] [instance: 703acb74-65e6-4a60-9dd0-bf986498889e] Fetching instance by UUID {{(pid=120799) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:14:02.502386 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-2c7b0d20-7bee-4924-9bb6-1201922e40c0 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:14:02.503090 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-2c7b0d20-7bee-4924-9bb6-1201922e40c0 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:14:02.503728 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-2c7b0d20-7bee-4924-9bb6-1201922e40c0 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:14:02.504715 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-2c7b0d20-7bee-4924-9bb6-1201922e40c0 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:14:02.505317 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-2c7b0d20-7bee-4924-9bb6-1201922e40c0 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:14:02.505846 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-2c7b0d20-7bee-4924-9bb6-1201922e40c0 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:14:02.711575 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.policy [None req-2c7b0d20-7bee-4924-9bb6-1201922e40c0 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64d54cb95b264c18b45d90822507fae1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135367be6e3f4b3d965ee0d99fdca524', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120799) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:14:02.726361 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-2c7b0d20-7bee-4924-9bb6-1201922e40c0 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] 10.222.0.17 "GET /compute/v2.1/servers/703acb74-65e6-4a60-9dd0-bf986498889e" status: 200 len: 1522 microversion: 2.1 time: 0.235907 Aug 23 07:14:02.727909 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 116/230] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:14:02 2022] GET /compute/v2.1/servers/703acb74-65e6-4a60-9dd0-bf986498889e => generated 1522 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:14:02.840859 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-20399cf7-ad9b-46b6-a41d-c0ddc752e10c tempest-VolumesActionsTest-775986377 tempest-VolumesActionsTest-775986377-project] Calling method '>' {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:14:02.842027 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.compute.api [None req-20399cf7-ad9b-46b6-a41d-c0ddc752e10c tempest-VolumesActionsTest-775986377 tempest-VolumesActionsTest-775986377-project] [instance: 6e6b1d40-6b77-4b49-b468-e936f953f85a] Fetching instance by UUID {{(pid=120798) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:14:02.857409 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-20399cf7-ad9b-46b6-a41d-c0ddc752e10c tempest-VolumesActionsTest-775986377 tempest-VolumesActionsTest-775986377-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:14:02.857872 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-20399cf7-ad9b-46b6-a41d-c0ddc752e10c tempest-VolumesActionsTest-775986377 tempest-VolumesActionsTest-775986377-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:14:02.858471 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-20399cf7-ad9b-46b6-a41d-c0ddc752e10c tempest-VolumesActionsTest-775986377 tempest-VolumesActionsTest-775986377-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:14:02.859294 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-20399cf7-ad9b-46b6-a41d-c0ddc752e10c tempest-VolumesActionsTest-775986377 tempest-VolumesActionsTest-775986377-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:14:02.859952 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-20399cf7-ad9b-46b6-a41d-c0ddc752e10c tempest-VolumesActionsTest-775986377 tempest-VolumesActionsTest-775986377-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:14:02.860373 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-20399cf7-ad9b-46b6-a41d-c0ddc752e10c tempest-VolumesActionsTest-775986377 tempest-VolumesActionsTest-775986377-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:14:03.043469 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.policy [None req-20399cf7-ad9b-46b6-a41d-c0ddc752e10c tempest-VolumesActionsTest-775986377 tempest-VolumesActionsTest-775986377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f4d65ffaab942f29d449b64805c765a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2ef3b6384a4194a26ba51078c425af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120798) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:14:03.054775 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [None req-20399cf7-ad9b-46b6-a41d-c0ddc752e10c tempest-VolumesActionsTest-775986377 tempest-VolumesActionsTest-775986377-project] 10.222.0.17 "GET /compute/v2.1/servers/6e6b1d40-6b77-4b49-b468-e936f953f85a" status: 200 len: 1314 microversion: 2.1 time: 0.217777 Aug 23 07:14:03.064517 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 115/231] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:14:02 2022] GET /compute/v2.1/servers/6e6b1d40-6b77-4b49-b468-e936f953f85a => generated 1314 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 07:14:03.748961 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-cf16f372-ef79-445d-92e3-e8e8c314ee60 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Calling method '>' {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:14:03.749631 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.compute.api [None req-cf16f372-ef79-445d-92e3-e8e8c314ee60 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] [instance: 703acb74-65e6-4a60-9dd0-bf986498889e] Fetching instance by UUID {{(pid=120799) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:14:03.756258 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-cf16f372-ef79-445d-92e3-e8e8c314ee60 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:14:03.756829 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-cf16f372-ef79-445d-92e3-e8e8c314ee60 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:14:03.757296 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-cf16f372-ef79-445d-92e3-e8e8c314ee60 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:14:03.757982 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-cf16f372-ef79-445d-92e3-e8e8c314ee60 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:14:03.758422 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-cf16f372-ef79-445d-92e3-e8e8c314ee60 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:14:03.758827 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-cf16f372-ef79-445d-92e3-e8e8c314ee60 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:14:03.909027 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.policy [None req-cf16f372-ef79-445d-92e3-e8e8c314ee60 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64d54cb95b264c18b45d90822507fae1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135367be6e3f4b3d965ee0d99fdca524', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120799) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:14:03.919344 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-cf16f372-ef79-445d-92e3-e8e8c314ee60 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] 10.222.0.17 "GET /compute/v2.1/servers/703acb74-65e6-4a60-9dd0-bf986498889e" status: 200 len: 1502 microversion: 2.1 time: 0.174345 Aug 23 07:14:03.919953 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 117/232] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:14:03 2022] GET /compute/v2.1/servers/703acb74-65e6-4a60-9dd0-bf986498889e => generated 1502 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:14:03.940400 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-ddbc4c8e-9a6b-4a7a-b1ec-7d42ba2af88a tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Calling method '>' {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:14:03.941046 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.compute.api [None req-ddbc4c8e-9a6b-4a7a-b1ec-7d42ba2af88a tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] [instance: 6915ed26-7e2f-41b9-aada-adcb2c2015d3] Fetching instance by UUID {{(pid=120798) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:14:03.950243 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-ddbc4c8e-9a6b-4a7a-b1ec-7d42ba2af88a tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:14:03.950980 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-ddbc4c8e-9a6b-4a7a-b1ec-7d42ba2af88a tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:14:03.951641 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-ddbc4c8e-9a6b-4a7a-b1ec-7d42ba2af88a tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:14:03.952457 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-ddbc4c8e-9a6b-4a7a-b1ec-7d42ba2af88a tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:14:03.952776 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-ddbc4c8e-9a6b-4a7a-b1ec-7d42ba2af88a tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:14:03.953201 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-ddbc4c8e-9a6b-4a7a-b1ec-7d42ba2af88a tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:14:04.079319 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-dff66149-4584-44cf-bd91-0f698c113f03 tempest-VolumesActionsTest-775986377 tempest-VolumesActionsTest-775986377-project] Calling method '>' {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:14:04.080183 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.compute.api [None req-dff66149-4584-44cf-bd91-0f698c113f03 tempest-VolumesActionsTest-775986377 tempest-VolumesActionsTest-775986377-project] [instance: 6e6b1d40-6b77-4b49-b468-e936f953f85a] Fetching instance by UUID {{(pid=120799) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:14:04.088400 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-dff66149-4584-44cf-bd91-0f698c113f03 tempest-VolumesActionsTest-775986377 tempest-VolumesActionsTest-775986377-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:14:04.089211 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-dff66149-4584-44cf-bd91-0f698c113f03 tempest-VolumesActionsTest-775986377 tempest-VolumesActionsTest-775986377-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:14:04.089951 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-dff66149-4584-44cf-bd91-0f698c113f03 tempest-VolumesActionsTest-775986377 tempest-VolumesActionsTest-775986377-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:14:04.090893 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-dff66149-4584-44cf-bd91-0f698c113f03 tempest-VolumesActionsTest-775986377 tempest-VolumesActionsTest-775986377-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:14:04.091737 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-dff66149-4584-44cf-bd91-0f698c113f03 tempest-VolumesActionsTest-775986377 tempest-VolumesActionsTest-775986377-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:14:04.092345 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-dff66149-4584-44cf-bd91-0f698c113f03 tempest-VolumesActionsTest-775986377 tempest-VolumesActionsTest-775986377-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:14:04.124904 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.policy [None req-ddbc4c8e-9a6b-4a7a-b1ec-7d42ba2af88a tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64d54cb95b264c18b45d90822507fae1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135367be6e3f4b3d965ee0d99fdca524', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120798) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:14:04.136441 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [None req-ddbc4c8e-9a6b-4a7a-b1ec-7d42ba2af88a tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] 10.222.0.17 "GET /compute/v2.1/servers/6915ed26-7e2f-41b9-aada-adcb2c2015d3" status: 200 len: 1516 microversion: 2.1 time: 0.200732 Aug 23 07:14:04.137597 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 116/233] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:14:03 2022] GET /compute/v2.1/servers/6915ed26-7e2f-41b9-aada-adcb2c2015d3 => generated 1516 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:14:04.275117 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.policy [None req-dff66149-4584-44cf-bd91-0f698c113f03 tempest-VolumesActionsTest-775986377 tempest-VolumesActionsTest-775986377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f4d65ffaab942f29d449b64805c765a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2ef3b6384a4194a26ba51078c425af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120799) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:14:04.283364 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-dff66149-4584-44cf-bd91-0f698c113f03 tempest-VolumesActionsTest-775986377 tempest-VolumesActionsTest-775986377-project] 10.222.0.17 "GET /compute/v2.1/servers/6e6b1d40-6b77-4b49-b468-e936f953f85a" status: 200 len: 1314 microversion: 2.1 time: 0.208991 Aug 23 07:14:04.284992 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 118/234] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:14:04 2022] GET /compute/v2.1/servers/6e6b1d40-6b77-4b49-b468-e936f953f85a => generated 1314 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 07:14:05.309549 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-d45dfd70-58d2-463b-8f19-6c02a2e4b9d9 tempest-VolumesActionsTest-775986377 tempest-VolumesActionsTest-775986377-project] Calling method '>' {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:14:05.310774 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.compute.api [None req-d45dfd70-58d2-463b-8f19-6c02a2e4b9d9 tempest-VolumesActionsTest-775986377 tempest-VolumesActionsTest-775986377-project] [instance: 6e6b1d40-6b77-4b49-b468-e936f953f85a] Fetching instance by UUID {{(pid=120798) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:14:05.321916 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-d45dfd70-58d2-463b-8f19-6c02a2e4b9d9 tempest-VolumesActionsTest-775986377 tempest-VolumesActionsTest-775986377-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:14:05.322746 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-d45dfd70-58d2-463b-8f19-6c02a2e4b9d9 tempest-VolumesActionsTest-775986377 tempest-VolumesActionsTest-775986377-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:14:05.323514 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-d45dfd70-58d2-463b-8f19-6c02a2e4b9d9 tempest-VolumesActionsTest-775986377 tempest-VolumesActionsTest-775986377-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:14:05.324679 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-d45dfd70-58d2-463b-8f19-6c02a2e4b9d9 tempest-VolumesActionsTest-775986377 tempest-VolumesActionsTest-775986377-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:14:05.325461 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-d45dfd70-58d2-463b-8f19-6c02a2e4b9d9 tempest-VolumesActionsTest-775986377 tempest-VolumesActionsTest-775986377-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:14:05.326136 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-d45dfd70-58d2-463b-8f19-6c02a2e4b9d9 tempest-VolumesActionsTest-775986377 tempest-VolumesActionsTest-775986377-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:14:05.501795 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.policy [None req-d45dfd70-58d2-463b-8f19-6c02a2e4b9d9 tempest-VolumesActionsTest-775986377 tempest-VolumesActionsTest-775986377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f4d65ffaab942f29d449b64805c765a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2ef3b6384a4194a26ba51078c425af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120798) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:14:05.512199 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [None req-d45dfd70-58d2-463b-8f19-6c02a2e4b9d9 tempest-VolumesActionsTest-775986377 tempest-VolumesActionsTest-775986377-project] 10.222.0.17 "GET /compute/v2.1/servers/6e6b1d40-6b77-4b49-b468-e936f953f85a" status: 200 len: 1314 microversion: 2.1 time: 0.209779 Aug 23 07:14:05.512958 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 117/235] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:14:05 2022] GET /compute/v2.1/servers/6e6b1d40-6b77-4b49-b468-e936f953f85a => generated 1314 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:14:06.545465 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-1a1b79f0-7b0e-4eb3-b252-2d89aa6e3604 tempest-VolumesActionsTest-775986377 tempest-VolumesActionsTest-775986377-project] Calling method '>' {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:14:06.545465 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.compute.api [None req-1a1b79f0-7b0e-4eb3-b252-2d89aa6e3604 tempest-VolumesActionsTest-775986377 tempest-VolumesActionsTest-775986377-project] [instance: 6e6b1d40-6b77-4b49-b468-e936f953f85a] Fetching instance by UUID {{(pid=120799) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:14:06.549118 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG dbcounter [-] [120799] Writing DB stats nova_cell0:SELECT=2 {{(pid=120799) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:14:06.550343 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG dbcounter [-] [120799] Writing DB stats nova_cell0:SELECT=6 {{(pid=120799) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:14:06.553973 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-1a1b79f0-7b0e-4eb3-b252-2d89aa6e3604 tempest-VolumesActionsTest-775986377 tempest-VolumesActionsTest-775986377-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:14:06.554510 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-1a1b79f0-7b0e-4eb3-b252-2d89aa6e3604 tempest-VolumesActionsTest-775986377 tempest-VolumesActionsTest-775986377-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:14:06.555049 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-1a1b79f0-7b0e-4eb3-b252-2d89aa6e3604 tempest-VolumesActionsTest-775986377 tempest-VolumesActionsTest-775986377-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:14:06.555830 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-1a1b79f0-7b0e-4eb3-b252-2d89aa6e3604 tempest-VolumesActionsTest-775986377 tempest-VolumesActionsTest-775986377-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:14:06.556392 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-1a1b79f0-7b0e-4eb3-b252-2d89aa6e3604 tempest-VolumesActionsTest-775986377 tempest-VolumesActionsTest-775986377-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:14:06.557900 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-1a1b79f0-7b0e-4eb3-b252-2d89aa6e3604 tempest-VolumesActionsTest-775986377 tempest-VolumesActionsTest-775986377-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:14:06.731393 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.policy [None req-1a1b79f0-7b0e-4eb3-b252-2d89aa6e3604 tempest-VolumesActionsTest-775986377 tempest-VolumesActionsTest-775986377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f4d65ffaab942f29d449b64805c765a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2ef3b6384a4194a26ba51078c425af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120799) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:14:06.739573 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-1a1b79f0-7b0e-4eb3-b252-2d89aa6e3604 tempest-VolumesActionsTest-775986377 tempest-VolumesActionsTest-775986377-project] 10.222.0.17 "GET /compute/v2.1/servers/6e6b1d40-6b77-4b49-b468-e936f953f85a" status: 200 len: 1314 microversion: 2.1 time: 0.208647 Aug 23 07:14:06.740218 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 119/236] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:14:06 2022] GET /compute/v2.1/servers/6e6b1d40-6b77-4b49-b468-e936f953f85a => generated 1314 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:14:06.980326 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [req-f74d20f9-680d-4e92-ae9b-0375ae2ddf19 req-24f4e870-0f6a-4580-a167-9c7dfa058075 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6e6b1d40-6b77-4b49-b468-e936f953f85a", "name": "network-vif-plugged", "status": "completed", "tag": "08e76269-cdd0-400b-805a-c3bc0fe3bde0"}]} {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 07:14:06.990425 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG dbcounter [-] [120798] Writing DB stats nova_cell0:SELECT=2 {{(pid=120798) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:14:06.993663 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [req-f74d20f9-680d-4e92-ae9b-0375ae2ddf19 req-24f4e870-0f6a-4580-a167-9c7dfa058075 service nova] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:14:06.994322 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [req-f74d20f9-680d-4e92-ae9b-0375ae2ddf19 req-24f4e870-0f6a-4580-a167-9c7dfa058075 service nova] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:14:06.994825 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [req-f74d20f9-680d-4e92-ae9b-0375ae2ddf19 req-24f4e870-0f6a-4580-a167-9c7dfa058075 service nova] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:14:07.009056 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.compute.server_external_events [req-f74d20f9-680d-4e92-ae9b-0375ae2ddf19 req-24f4e870-0f6a-4580-a167-9c7dfa058075 service nova] Creating event network-vif-plugged:08e76269-cdd0-400b-805a-c3bc0fe3bde0 for instance 6e6b1d40-6b77-4b49-b468-e936f953f85a on hv-cinder-85409 Aug 23 07:14:07.014608 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [req-f74d20f9-680d-4e92-ae9b-0375ae2ddf19 req-24f4e870-0f6a-4580-a167-9c7dfa058075 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038819 Aug 23 07:14:07.015301 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 118/237] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Aug 23 07:14:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 07:14:07.763206 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-aeea8c2d-6f0f-4d21-8359-6791d0147a38 tempest-VolumesActionsTest-775986377 tempest-VolumesActionsTest-775986377-project] Calling method '>' {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:14:07.764060 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.compute.api [None req-aeea8c2d-6f0f-4d21-8359-6791d0147a38 tempest-VolumesActionsTest-775986377 tempest-VolumesActionsTest-775986377-project] [instance: 6e6b1d40-6b77-4b49-b468-e936f953f85a] Fetching instance by UUID {{(pid=120799) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:14:07.774224 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-aeea8c2d-6f0f-4d21-8359-6791d0147a38 tempest-VolumesActionsTest-775986377 tempest-VolumesActionsTest-775986377-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:14:07.774710 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-aeea8c2d-6f0f-4d21-8359-6791d0147a38 tempest-VolumesActionsTest-775986377 tempest-VolumesActionsTest-775986377-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:14:07.775139 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-aeea8c2d-6f0f-4d21-8359-6791d0147a38 tempest-VolumesActionsTest-775986377 tempest-VolumesActionsTest-775986377-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:14:07.780104 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-aeea8c2d-6f0f-4d21-8359-6791d0147a38 tempest-VolumesActionsTest-775986377 tempest-VolumesActionsTest-775986377-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:14:07.780734 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-aeea8c2d-6f0f-4d21-8359-6791d0147a38 tempest-VolumesActionsTest-775986377 tempest-VolumesActionsTest-775986377-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:14:07.781296 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-aeea8c2d-6f0f-4d21-8359-6791d0147a38 tempest-VolumesActionsTest-775986377 tempest-VolumesActionsTest-775986377-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:14:07.799138 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-54241276-0230-4722-a6a8-23ecc337178d tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 07:14:07.803663 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.compute.api [None req-54241276-0230-4722-a6a8-23ecc337178d tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] [instance: 6915ed26-7e2f-41b9-aada-adcb2c2015d3] Fetching instance by UUID {{(pid=120798) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:14:07.813202 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-54241276-0230-4722-a6a8-23ecc337178d tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:14:07.813688 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-54241276-0230-4722-a6a8-23ecc337178d tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:14:07.814112 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-54241276-0230-4722-a6a8-23ecc337178d tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:14:07.814804 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-54241276-0230-4722-a6a8-23ecc337178d tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:14:07.815242 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-54241276-0230-4722-a6a8-23ecc337178d tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:14:07.815888 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-54241276-0230-4722-a6a8-23ecc337178d tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:14:07.843000 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.objects.instance [None req-54241276-0230-4722-a6a8-23ecc337178d tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lazy-loading 'flavor' on Instance uuid 6915ed26-7e2f-41b9-aada-adcb2c2015d3 {{(pid=120798) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 07:14:07.965652 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [None req-54241276-0230-4722-a6a8-23ecc337178d tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] 10.222.0.17 "POST /compute/v2.1/servers/6915ed26-7e2f-41b9-aada-adcb2c2015d3/action" status: 200 len: 32 microversion: 2.1 time: 0.170704 Aug 23 07:14:07.967481 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 119/238] 10.222.0.17 () {60 vars in 1278 bytes} [Tue Aug 23 07:14:07 2022] POST /compute/v2.1/servers/6915ed26-7e2f-41b9-aada-adcb2c2015d3/action => generated 32 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 23 07:14:07.979005 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-8bb8849b-af7e-4202-a571-f64c7f26d8d5 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Calling method '>' {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:14:07.984265 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.compute.api [None req-8bb8849b-af7e-4202-a571-f64c7f26d8d5 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] [instance: 6915ed26-7e2f-41b9-aada-adcb2c2015d3] Fetching instance by UUID {{(pid=120798) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:14:07.992417 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-8bb8849b-af7e-4202-a571-f64c7f26d8d5 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:14:07.993162 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-8bb8849b-af7e-4202-a571-f64c7f26d8d5 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:14:07.993908 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-8bb8849b-af7e-4202-a571-f64c7f26d8d5 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:14:07.994806 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-8bb8849b-af7e-4202-a571-f64c7f26d8d5 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:14:07.995669 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-8bb8849b-af7e-4202-a571-f64c7f26d8d5 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:14:07.996238 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-8bb8849b-af7e-4202-a571-f64c7f26d8d5 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:14:08.004910 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.policy [None req-aeea8c2d-6f0f-4d21-8359-6791d0147a38 tempest-VolumesActionsTest-775986377 tempest-VolumesActionsTest-775986377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f4d65ffaab942f29d449b64805c765a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2ef3b6384a4194a26ba51078c425af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120799) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:14:08.015195 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-aeea8c2d-6f0f-4d21-8359-6791d0147a38 tempest-VolumesActionsTest-775986377 tempest-VolumesActionsTest-775986377-project] 10.222.0.17 "GET /compute/v2.1/servers/6e6b1d40-6b77-4b49-b468-e936f953f85a" status: 200 len: 1314 microversion: 2.1 time: 0.258587 Aug 23 07:14:08.016702 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 120/239] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:14:07 2022] GET /compute/v2.1/servers/6e6b1d40-6b77-4b49-b468-e936f953f85a => generated 1314 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:14:08.312079 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.policy [None req-8bb8849b-af7e-4202-a571-f64c7f26d8d5 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64d54cb95b264c18b45d90822507fae1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135367be6e3f4b3d965ee0d99fdca524', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120798) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:14:08.325900 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [None req-8bb8849b-af7e-4202-a571-f64c7f26d8d5 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] 10.222.0.17 "GET /compute/v2.1/servers/6915ed26-7e2f-41b9-aada-adcb2c2015d3" status: 200 len: 1522 microversion: 2.1 time: 0.350638 Aug 23 07:14:08.328808 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 120/240] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:14:07 2022] GET /compute/v2.1/servers/6915ed26-7e2f-41b9-aada-adcb2c2015d3 => generated 1522 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:14:09.040446 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-d2f627d7-128a-424b-aed0-4ec88393011e tempest-VolumesActionsTest-775986377 tempest-VolumesActionsTest-775986377-project] Calling method '>' {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:14:09.041105 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.compute.api [None req-d2f627d7-128a-424b-aed0-4ec88393011e tempest-VolumesActionsTest-775986377 tempest-VolumesActionsTest-775986377-project] [instance: 6e6b1d40-6b77-4b49-b468-e936f953f85a] Fetching instance by UUID {{(pid=120799) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:14:09.051750 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-d2f627d7-128a-424b-aed0-4ec88393011e tempest-VolumesActionsTest-775986377 tempest-VolumesActionsTest-775986377-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:14:09.053910 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-d2f627d7-128a-424b-aed0-4ec88393011e tempest-VolumesActionsTest-775986377 tempest-VolumesActionsTest-775986377-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:14:09.055960 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-d2f627d7-128a-424b-aed0-4ec88393011e tempest-VolumesActionsTest-775986377 tempest-VolumesActionsTest-775986377-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:14:09.058514 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-d2f627d7-128a-424b-aed0-4ec88393011e tempest-VolumesActionsTest-775986377 tempest-VolumesActionsTest-775986377-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:14:09.060236 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-d2f627d7-128a-424b-aed0-4ec88393011e tempest-VolumesActionsTest-775986377 tempest-VolumesActionsTest-775986377-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:14:09.061786 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-d2f627d7-128a-424b-aed0-4ec88393011e tempest-VolumesActionsTest-775986377 tempest-VolumesActionsTest-775986377-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:14:09.327651 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.policy [None req-d2f627d7-128a-424b-aed0-4ec88393011e tempest-VolumesActionsTest-775986377 tempest-VolumesActionsTest-775986377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f4d65ffaab942f29d449b64805c765a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2ef3b6384a4194a26ba51078c425af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120799) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:14:09.337721 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-d2f627d7-128a-424b-aed0-4ec88393011e tempest-VolumesActionsTest-775986377 tempest-VolumesActionsTest-775986377-project] 10.222.0.17 "GET /compute/v2.1/servers/6e6b1d40-6b77-4b49-b468-e936f953f85a" status: 200 len: 1497 microversion: 2.1 time: 0.303776 Aug 23 07:14:09.338446 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 121/241] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:14:09 2022] GET /compute/v2.1/servers/6e6b1d40-6b77-4b49-b468-e936f953f85a => generated 1497 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 07:14:09.353256 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-1ce599f9-c05f-4236-9180-b7a24b142708 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Calling method '>' {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:14:09.354674 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.compute.api [None req-1ce599f9-c05f-4236-9180-b7a24b142708 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] [instance: 6915ed26-7e2f-41b9-aada-adcb2c2015d3] Fetching instance by UUID {{(pid=120798) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:14:09.373434 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-1ce599f9-c05f-4236-9180-b7a24b142708 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:14:09.374073 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-1ce599f9-c05f-4236-9180-b7a24b142708 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:14:09.374420 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-1ce599f9-c05f-4236-9180-b7a24b142708 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:14:09.375181 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-1ce599f9-c05f-4236-9180-b7a24b142708 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:14:09.376454 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-1ce599f9-c05f-4236-9180-b7a24b142708 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:14:09.377050 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-1ce599f9-c05f-4236-9180-b7a24b142708 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:14:09.616261 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.policy [None req-1ce599f9-c05f-4236-9180-b7a24b142708 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64d54cb95b264c18b45d90822507fae1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135367be6e3f4b3d965ee0d99fdca524', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120798) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:14:09.641255 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [None req-1ce599f9-c05f-4236-9180-b7a24b142708 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] 10.222.0.17 "GET /compute/v2.1/servers/6915ed26-7e2f-41b9-aada-adcb2c2015d3" status: 200 len: 1522 microversion: 2.1 time: 0.294160 Aug 23 07:14:09.642240 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 121/242] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:14:09 2022] GET /compute/v2.1/servers/6915ed26-7e2f-41b9-aada-adcb2c2015d3 => generated 1522 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:14:09.963302 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-c16740aa-e9e6-4be4-b7c5-fa36cf16f4d5 tempest-VolumesActionsTest-775986377 tempest-VolumesActionsTest-775986377-project] Calling method '>' {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:14:09.963815 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.compute.api [None req-c16740aa-e9e6-4be4-b7c5-fa36cf16f4d5 tempest-VolumesActionsTest-775986377 tempest-VolumesActionsTest-775986377-project] [instance: 6e6b1d40-6b77-4b49-b468-e936f953f85a] Fetching instance by UUID {{(pid=120799) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:14:09.970140 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-c16740aa-e9e6-4be4-b7c5-fa36cf16f4d5 tempest-VolumesActionsTest-775986377 tempest-VolumesActionsTest-775986377-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:14:09.970612 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-c16740aa-e9e6-4be4-b7c5-fa36cf16f4d5 tempest-VolumesActionsTest-775986377 tempest-VolumesActionsTest-775986377-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:14:09.971032 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-c16740aa-e9e6-4be4-b7c5-fa36cf16f4d5 tempest-VolumesActionsTest-775986377 tempest-VolumesActionsTest-775986377-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:14:09.971762 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-c16740aa-e9e6-4be4-b7c5-fa36cf16f4d5 tempest-VolumesActionsTest-775986377 tempest-VolumesActionsTest-775986377-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:14:09.972188 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-c16740aa-e9e6-4be4-b7c5-fa36cf16f4d5 tempest-VolumesActionsTest-775986377 tempest-VolumesActionsTest-775986377-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:14:09.972627 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-c16740aa-e9e6-4be4-b7c5-fa36cf16f4d5 tempest-VolumesActionsTest-775986377 tempest-VolumesActionsTest-775986377-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:14:10.003994 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.compute.api [None req-c16740aa-e9e6-4be4-b7c5-fa36cf16f4d5 tempest-VolumesActionsTest-775986377 tempest-VolumesActionsTest-775986377-project] [instance: 6e6b1d40-6b77-4b49-b468-e936f953f85a] Going to try to terminate instance {{(pid=120799) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 07:14:10.011249 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG dbcounter [-] [120799] Writing DB stats nova_cell1:SELECT=100 {{(pid=120799) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:14:10.120711 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-c16740aa-e9e6-4be4-b7c5-fa36cf16f4d5 tempest-VolumesActionsTest-775986377 tempest-VolumesActionsTest-775986377-project] 10.222.0.17 "DELETE /compute/v2.1/servers/6e6b1d40-6b77-4b49-b468-e936f953f85a" status: 204 len: 0 microversion: 2.1 time: 0.161520 Aug 23 07:14:10.124703 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 122/243] 10.222.0.17 () {58 vars in 1239 bytes} [Tue Aug 23 07:14:09 2022] DELETE /compute/v2.1/servers/6e6b1d40-6b77-4b49-b468-e936f953f85a => generated 0 bytes in 163 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 23 07:14:10.138516 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-c967b0de-9e6b-4d0e-810f-3e6909103367 tempest-VolumesActionsTest-775986377 tempest-VolumesActionsTest-775986377-project] Calling method '>' {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:14:10.139701 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.compute.api [None req-c967b0de-9e6b-4d0e-810f-3e6909103367 tempest-VolumesActionsTest-775986377 tempest-VolumesActionsTest-775986377-project] [instance: 6e6b1d40-6b77-4b49-b468-e936f953f85a] Fetching instance by UUID {{(pid=120798) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:14:10.154646 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-c967b0de-9e6b-4d0e-810f-3e6909103367 tempest-VolumesActionsTest-775986377 tempest-VolumesActionsTest-775986377-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:14:10.155064 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-c967b0de-9e6b-4d0e-810f-3e6909103367 tempest-VolumesActionsTest-775986377 tempest-VolumesActionsTest-775986377-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:14:10.155864 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-c967b0de-9e6b-4d0e-810f-3e6909103367 tempest-VolumesActionsTest-775986377 tempest-VolumesActionsTest-775986377-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:14:10.156819 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-c967b0de-9e6b-4d0e-810f-3e6909103367 tempest-VolumesActionsTest-775986377 tempest-VolumesActionsTest-775986377-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:14:10.157321 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-c967b0de-9e6b-4d0e-810f-3e6909103367 tempest-VolumesActionsTest-775986377 tempest-VolumesActionsTest-775986377-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:14:10.157932 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-c967b0de-9e6b-4d0e-810f-3e6909103367 tempest-VolumesActionsTest-775986377 tempest-VolumesActionsTest-775986377-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:14:10.330729 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.policy [None req-c967b0de-9e6b-4d0e-810f-3e6909103367 tempest-VolumesActionsTest-775986377 tempest-VolumesActionsTest-775986377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f4d65ffaab942f29d449b64805c765a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2ef3b6384a4194a26ba51078c425af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120798) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:14:10.340405 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [None req-c967b0de-9e6b-4d0e-810f-3e6909103367 tempest-VolumesActionsTest-775986377 tempest-VolumesActionsTest-775986377-project] 10.222.0.17 "GET /compute/v2.1/servers/6e6b1d40-6b77-4b49-b468-e936f953f85a" status: 200 len: 1503 microversion: 2.1 time: 0.214407 Aug 23 07:14:10.341559 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 122/244] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:14:10 2022] GET /compute/v2.1/servers/6e6b1d40-6b77-4b49-b468-e936f953f85a => generated 1503 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 07:14:10.663149 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-71fc3e52-15f1-4c85-b687-fa9eee5f71a4 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Calling method '>' {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:14:10.663907 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.compute.api [None req-71fc3e52-15f1-4c85-b687-fa9eee5f71a4 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] [instance: 6915ed26-7e2f-41b9-aada-adcb2c2015d3] Fetching instance by UUID {{(pid=120799) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:14:10.673825 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-71fc3e52-15f1-4c85-b687-fa9eee5f71a4 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:14:10.674333 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-71fc3e52-15f1-4c85-b687-fa9eee5f71a4 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:14:10.674793 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-71fc3e52-15f1-4c85-b687-fa9eee5f71a4 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:14:10.675548 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-71fc3e52-15f1-4c85-b687-fa9eee5f71a4 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:14:10.676001 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-71fc3e52-15f1-4c85-b687-fa9eee5f71a4 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:14:10.676423 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-71fc3e52-15f1-4c85-b687-fa9eee5f71a4 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:14:10.815683 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.policy [None req-71fc3e52-15f1-4c85-b687-fa9eee5f71a4 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64d54cb95b264c18b45d90822507fae1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135367be6e3f4b3d965ee0d99fdca524', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120799) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:14:10.824104 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-71fc3e52-15f1-4c85-b687-fa9eee5f71a4 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] 10.222.0.17 "GET /compute/v2.1/servers/6915ed26-7e2f-41b9-aada-adcb2c2015d3" status: 200 len: 1522 microversion: 2.1 time: 0.165511 Aug 23 07:14:10.824693 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 123/245] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:14:10 2022] GET /compute/v2.1/servers/6915ed26-7e2f-41b9-aada-adcb2c2015d3 => generated 1522 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:14:11.325840 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-5cb035a0-b8e1-4215-92c6-f869834038bc tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Calling method '>' {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:14:11.326424 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.compute.api [None req-5cb035a0-b8e1-4215-92c6-f869834038bc tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] [instance: 057628ba-a74f-426e-ba25-a3b79c3b6339] Fetching instance by UUID {{(pid=120798) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:14:11.333781 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-5cb035a0-b8e1-4215-92c6-f869834038bc tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:14:11.334262 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-5cb035a0-b8e1-4215-92c6-f869834038bc tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:14:11.334689 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-5cb035a0-b8e1-4215-92c6-f869834038bc tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:14:11.335352 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-5cb035a0-b8e1-4215-92c6-f869834038bc tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:14:11.335827 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-5cb035a0-b8e1-4215-92c6-f869834038bc tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:14:11.336242 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-5cb035a0-b8e1-4215-92c6-f869834038bc tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:14:11.362953 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-8c19838c-37de-4515-bef3-a04da7236539 tempest-VolumesActionsTest-775986377 tempest-VolumesActionsTest-775986377-project] Calling method '>' {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:14:11.363671 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.compute.api [None req-8c19838c-37de-4515-bef3-a04da7236539 tempest-VolumesActionsTest-775986377 tempest-VolumesActionsTest-775986377-project] [instance: 6e6b1d40-6b77-4b49-b468-e936f953f85a] Fetching instance by UUID {{(pid=120799) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:14:11.364318 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [None req-5cb035a0-b8e1-4215-92c6-f869834038bc tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] 10.222.0.17 "GET /compute/v2.1/servers/057628ba-a74f-426e-ba25-a3b79c3b6339/ips" status: 200 len: 149 microversion: 2.1 time: 0.042646 Aug 23 07:14:11.370421 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-8c19838c-37de-4515-bef3-a04da7236539 tempest-VolumesActionsTest-775986377 tempest-VolumesActionsTest-775986377-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:14:11.371137 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-8c19838c-37de-4515-bef3-a04da7236539 tempest-VolumesActionsTest-775986377 tempest-VolumesActionsTest-775986377-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:14:11.371609 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-8c19838c-37de-4515-bef3-a04da7236539 tempest-VolumesActionsTest-775986377 tempest-VolumesActionsTest-775986377-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:14:11.372244 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 123/246] 10.222.0.17 () {58 vars in 1248 bytes} [Tue Aug 23 07:14:11 2022] GET /compute/v2.1/servers/057628ba-a74f-426e-ba25-a3b79c3b6339/ips => generated 149 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 07:14:11.375312 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-8c19838c-37de-4515-bef3-a04da7236539 tempest-VolumesActionsTest-775986377 tempest-VolumesActionsTest-775986377-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:14:11.375809 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-8c19838c-37de-4515-bef3-a04da7236539 tempest-VolumesActionsTest-775986377 tempest-VolumesActionsTest-775986377-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:14:11.376243 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-8c19838c-37de-4515-bef3-a04da7236539 tempest-VolumesActionsTest-775986377 tempest-VolumesActionsTest-775986377-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:14:11.532522 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.policy [None req-8c19838c-37de-4515-bef3-a04da7236539 tempest-VolumesActionsTest-775986377 tempest-VolumesActionsTest-775986377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f4d65ffaab942f29d449b64805c765a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2ef3b6384a4194a26ba51078c425af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120799) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:14:11.545469 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-8c19838c-37de-4515-bef3-a04da7236539 tempest-VolumesActionsTest-775986377 tempest-VolumesActionsTest-775986377-project] 10.222.0.17 "GET /compute/v2.1/servers/6e6b1d40-6b77-4b49-b468-e936f953f85a" status: 200 len: 1503 microversion: 2.1 time: 0.187029 Aug 23 07:14:11.546981 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 124/247] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:14:11 2022] GET /compute/v2.1/servers/6e6b1d40-6b77-4b49-b468-e936f953f85a => generated 1503 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:14:11.850257 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-a419dd6d-337e-4aa2-8be6-883239cdc1b5 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Calling method '>' {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:14:11.851012 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.compute.api [None req-a419dd6d-337e-4aa2-8be6-883239cdc1b5 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] [instance: 6915ed26-7e2f-41b9-aada-adcb2c2015d3] Fetching instance by UUID {{(pid=120798) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:14:11.873754 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-a419dd6d-337e-4aa2-8be6-883239cdc1b5 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:14:11.874284 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-a419dd6d-337e-4aa2-8be6-883239cdc1b5 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:14:11.874707 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-a419dd6d-337e-4aa2-8be6-883239cdc1b5 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:14:11.875623 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-a419dd6d-337e-4aa2-8be6-883239cdc1b5 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:14:11.876226 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-a419dd6d-337e-4aa2-8be6-883239cdc1b5 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:14:11.876790 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-a419dd6d-337e-4aa2-8be6-883239cdc1b5 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:14:12.141152 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.policy [None req-a419dd6d-337e-4aa2-8be6-883239cdc1b5 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64d54cb95b264c18b45d90822507fae1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135367be6e3f4b3d965ee0d99fdca524', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120798) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:14:12.152123 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [None req-a419dd6d-337e-4aa2-8be6-883239cdc1b5 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] 10.222.0.17 "GET /compute/v2.1/servers/6915ed26-7e2f-41b9-aada-adcb2c2015d3" status: 200 len: 1522 microversion: 2.1 time: 0.306375 Aug 23 07:14:12.153533 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 124/248] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:14:11 2022] GET /compute/v2.1/servers/6915ed26-7e2f-41b9-aada-adcb2c2015d3 => generated 1522 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:14:12.440456 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [req-c6f4b49e-4adf-48bb-aa5d-58eaeb824a7d req-b1514545-92c3-45ab-a588-881d13f93f7f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6e6b1d40-6b77-4b49-b468-e936f953f85a", "name": "network-vif-deleted", "tag": "08e76269-cdd0-400b-805a-c3bc0fe3bde0"}]} {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 07:14:12.445628 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG dbcounter [-] [120799] Writing DB stats nova_api:SELECT=62,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=120799) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:14:12.451427 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [req-c6f4b49e-4adf-48bb-aa5d-58eaeb824a7d req-b1514545-92c3-45ab-a588-881d13f93f7f service nova] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:14:12.451900 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [req-c6f4b49e-4adf-48bb-aa5d-58eaeb824a7d req-b1514545-92c3-45ab-a588-881d13f93f7f service nova] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:14:12.452512 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [req-c6f4b49e-4adf-48bb-aa5d-58eaeb824a7d req-b1514545-92c3-45ab-a588-881d13f93f7f service nova] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:14:12.467502 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.compute.server_external_events [req-c6f4b49e-4adf-48bb-aa5d-58eaeb824a7d req-b1514545-92c3-45ab-a588-881d13f93f7f service nova] Creating event network-vif-deleted:08e76269-cdd0-400b-805a-c3bc0fe3bde0 for instance 6e6b1d40-6b77-4b49-b468-e936f953f85a on hv-cinder-85409 Aug 23 07:14:12.473073 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [req-c6f4b49e-4adf-48bb-aa5d-58eaeb824a7d req-b1514545-92c3-45ab-a588-881d13f93f7f service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036160 Aug 23 07:14:12.473669 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 125/249] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Aug 23 07:14:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 07:14:12.567274 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-ed1b236e-3389-42cd-967d-045eda57d2dc tempest-VolumesActionsTest-775986377 tempest-VolumesActionsTest-775986377-project] Calling method '>' {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:14:12.568452 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.compute.api [None req-ed1b236e-3389-42cd-967d-045eda57d2dc tempest-VolumesActionsTest-775986377 tempest-VolumesActionsTest-775986377-project] [instance: 6e6b1d40-6b77-4b49-b468-e936f953f85a] Fetching instance by UUID {{(pid=120798) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:14:12.576726 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-ed1b236e-3389-42cd-967d-045eda57d2dc tempest-VolumesActionsTest-775986377 tempest-VolumesActionsTest-775986377-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:14:12.577094 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-ed1b236e-3389-42cd-967d-045eda57d2dc tempest-VolumesActionsTest-775986377 tempest-VolumesActionsTest-775986377-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:14:12.577602 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-ed1b236e-3389-42cd-967d-045eda57d2dc tempest-VolumesActionsTest-775986377 tempest-VolumesActionsTest-775986377-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:14:12.578500 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-ed1b236e-3389-42cd-967d-045eda57d2dc tempest-VolumesActionsTest-775986377 tempest-VolumesActionsTest-775986377-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:14:12.579275 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-ed1b236e-3389-42cd-967d-045eda57d2dc tempest-VolumesActionsTest-775986377 tempest-VolumesActionsTest-775986377-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:14:12.579955 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-ed1b236e-3389-42cd-967d-045eda57d2dc tempest-VolumesActionsTest-775986377 tempest-VolumesActionsTest-775986377-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:14:12.619515 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-ed1b236e-3389-42cd-967d-045eda57d2dc tempest-VolumesActionsTest-775986377 tempest-VolumesActionsTest-775986377-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:14:12.619884 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-ed1b236e-3389-42cd-967d-045eda57d2dc tempest-VolumesActionsTest-775986377 tempest-VolumesActionsTest-775986377-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:14:12.620300 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-ed1b236e-3389-42cd-967d-045eda57d2dc tempest-VolumesActionsTest-775986377 tempest-VolumesActionsTest-775986377-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:14:12.620737 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.objects.instance [None req-ed1b236e-3389-42cd-967d-045eda57d2dc tempest-VolumesActionsTest-775986377 tempest-VolumesActionsTest-775986377-project] Lazy-loading 'fault' on Instance uuid 6e6b1d40-6b77-4b49-b468-e936f953f85a {{(pid=120798) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 07:14:12.666605 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.policy [None req-ed1b236e-3389-42cd-967d-045eda57d2dc tempest-VolumesActionsTest-775986377 tempest-VolumesActionsTest-775986377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f4d65ffaab942f29d449b64805c765a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2ef3b6384a4194a26ba51078c425af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120798) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:14:12.675558 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [None req-ed1b236e-3389-42cd-967d-045eda57d2dc tempest-VolumesActionsTest-775986377 tempest-VolumesActionsTest-775986377-project] 10.222.0.17 "GET /compute/v2.1/servers/6e6b1d40-6b77-4b49-b468-e936f953f85a" status: 200 len: 1304 microversion: 2.1 time: 0.112670 Aug 23 07:14:12.676261 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 125/250] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:14:12 2022] GET /compute/v2.1/servers/6e6b1d40-6b77-4b49-b468-e936f953f85a => generated 1304 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:14:12.828733 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-67fde1d1-782c-4fc0-b1af-094309c7edd9 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f1522f2b-5404-4c16-a30d-7283a999033d"}} {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 07:14:12.831339 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.compute.api [None req-67fde1d1-782c-4fc0-b1af-094309c7edd9 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] [instance: 057628ba-a74f-426e-ba25-a3b79c3b6339] Fetching instance by UUID {{(pid=120799) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:14:12.838933 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-67fde1d1-782c-4fc0-b1af-094309c7edd9 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:14:12.839403 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-67fde1d1-782c-4fc0-b1af-094309c7edd9 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:14:12.839844 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-67fde1d1-782c-4fc0-b1af-094309c7edd9 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:14:12.840521 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-67fde1d1-782c-4fc0-b1af-094309c7edd9 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:14:12.840966 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-67fde1d1-782c-4fc0-b1af-094309c7edd9 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:14:12.841654 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-67fde1d1-782c-4fc0-b1af-094309c7edd9 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:14:13.175304 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-bd8e1cf2-0bee-45e1-b5cc-ab592bd8a49f tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Calling method '>' {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:14:13.176025 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.compute.api [None req-bd8e1cf2-0bee-45e1-b5cc-ab592bd8a49f tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] [instance: 6915ed26-7e2f-41b9-aada-adcb2c2015d3] Fetching instance by UUID {{(pid=120798) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:14:13.179164 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-67fde1d1-782c-4fc0-b1af-094309c7edd9 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] 10.222.0.17 "POST /compute/v2.1/servers/057628ba-a74f-426e-ba25-a3b79c3b6339/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.355057 Aug 23 07:14:13.183451 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 126/251] 10.222.0.17 () {60 vars in 1323 bytes} [Tue Aug 23 07:14:12 2022] POST /compute/v2.1/servers/057628ba-a74f-426e-ba25-a3b79c3b6339/os-volume_attachments => generated 194 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 07:14:13.188283 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-bd8e1cf2-0bee-45e1-b5cc-ab592bd8a49f tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:14:13.188925 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-bd8e1cf2-0bee-45e1-b5cc-ab592bd8a49f tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:14:13.189538 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-bd8e1cf2-0bee-45e1-b5cc-ab592bd8a49f tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:14:13.190709 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-bd8e1cf2-0bee-45e1-b5cc-ab592bd8a49f tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:14:13.193132 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-bd8e1cf2-0bee-45e1-b5cc-ab592bd8a49f tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:14:13.193823 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-bd8e1cf2-0bee-45e1-b5cc-ab592bd8a49f tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:14:13.515267 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.policy [None req-bd8e1cf2-0bee-45e1-b5cc-ab592bd8a49f tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64d54cb95b264c18b45d90822507fae1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135367be6e3f4b3d965ee0d99fdca524', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120798) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:14:13.523464 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [None req-bd8e1cf2-0bee-45e1-b5cc-ab592bd8a49f tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] 10.222.0.17 "GET /compute/v2.1/servers/6915ed26-7e2f-41b9-aada-adcb2c2015d3" status: 200 len: 1522 microversion: 2.1 time: 0.352917 Aug 23 07:14:13.524029 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 126/252] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:14:13 2022] GET /compute/v2.1/servers/6915ed26-7e2f-41b9-aada-adcb2c2015d3 => generated 1522 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:14:13.707524 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-4cd40583-d348-46ce-b538-ae055283ea15 tempest-VolumesActionsTest-775986377 tempest-VolumesActionsTest-775986377-project] Calling method '>' {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:14:13.709977 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.compute.api [None req-4cd40583-d348-46ce-b538-ae055283ea15 tempest-VolumesActionsTest-775986377 tempest-VolumesActionsTest-775986377-project] [instance: 6e6b1d40-6b77-4b49-b468-e936f953f85a] Fetching instance by UUID {{(pid=120799) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:14:13.721706 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-4cd40583-d348-46ce-b538-ae055283ea15 tempest-VolumesActionsTest-775986377 tempest-VolumesActionsTest-775986377-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:14:13.722577 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-4cd40583-d348-46ce-b538-ae055283ea15 tempest-VolumesActionsTest-775986377 tempest-VolumesActionsTest-775986377-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:14:13.723340 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-4cd40583-d348-46ce-b538-ae055283ea15 tempest-VolumesActionsTest-775986377 tempest-VolumesActionsTest-775986377-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:14:13.724592 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-4cd40583-d348-46ce-b538-ae055283ea15 tempest-VolumesActionsTest-775986377 tempest-VolumesActionsTest-775986377-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:14:13.726437 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-4cd40583-d348-46ce-b538-ae055283ea15 tempest-VolumesActionsTest-775986377 tempest-VolumesActionsTest-775986377-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:14:13.727643 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-4cd40583-d348-46ce-b538-ae055283ea15 tempest-VolumesActionsTest-775986377 tempest-VolumesActionsTest-775986377-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:14:13.758943 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.wsgi [None req-4cd40583-d348-46ce-b538-ae055283ea15 tempest-VolumesActionsTest-775986377 tempest-VolumesActionsTest-775986377-project] HTTP exception thrown: Instance 6e6b1d40-6b77-4b49-b468-e936f953f85a could not be found. Aug 23 07:14:13.767802 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-4cd40583-d348-46ce-b538-ae055283ea15 tempest-VolumesActionsTest-775986377 tempest-VolumesActionsTest-775986377-project] Request method failure captured: Aug 23 07:14:13.767802 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: request: GET /compute/v2.1/servers/6e6b1d40-6b77-4b49-b468-e936f953f85a HTTP/1.1 Aug 23 07:14:13.767802 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: Accept: application/json Aug 23 07:14:13.767802 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: Accept-Encoding: identity Aug 23 07:14:13.767802 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: Connection: close Aug 23 07:14:13.767802 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: Content-Length: 0 Aug 23 07:14:13.767802 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: Content-Type: application/json Aug 23 07:14:13.767802 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: Host: 10.222.0.17 Aug 23 07:14:13.767802 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: Openstack-System-Scope: None Aug 23 07:14:13.767802 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: User-Agent: python-urllib3/1.26.11 Aug 23 07:14:13.767802 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-Auth-Token: gAAAAABjBH4wLWXVolk5tOBY9srh-W8M15AgOm0wjYKM5cfFv7ON2wMUFp_fjguxFLAzsUglL3IPbuzM-OIUnoocHY3jI89mhKK1wNVFt4gJx0lAo4bo-fthx83f9GoaftqzXyjBaeGoL-do17fvGJLY1a_UQYyfYYsFb4vhJPRDpo_cQpie_4I Aug 23 07:14:13.767802 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-Domain-Id: None Aug 23 07:14:13.767802 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-Domain-Name: None Aug 23 07:14:13.767802 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-Identity-Status: Confirmed Aug 23 07:14:13.767802 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-Is-Admin-Project: True Aug 23 07:14:13.767802 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-Project-Domain-Id: default Aug 23 07:14:13.767802 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-Project-Domain-Name: Default Aug 23 07:14:13.767802 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-Project-Id: 0a2ef3b6384a4194a26ba51078c425af Aug 23 07:14:13.767802 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-Project-Name: tempest-VolumesActionsTest-775986377 Aug 23 07:14:13.767802 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-Role: reader,member Aug 23 07:14:13.767802 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-Roles: reader,member Aug 23 07:14:13.770022 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/0a2ef3b6384a4194a26ba51078c425af"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/0a2ef3b6384a4194a26ba51078c425af"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_0a2ef3b6384a4194a26ba51078c425af"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/0a2ef3b6384a4194a26ba51078c425af"}]}] Aug 23 07:14:13.770022 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-Tenant: tempest-VolumesActionsTest-775986377 Aug 23 07:14:13.770022 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-Tenant-Id: 0a2ef3b6384a4194a26ba51078c425af Aug 23 07:14:13.770022 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-Tenant-Name: tempest-VolumesActionsTest-775986377 Aug 23 07:14:13.770022 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-User: tempest-VolumesActionsTest-775986377-project Aug 23 07:14:13.770022 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-User-Domain-Id: default Aug 23 07:14:13.770022 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-User-Domain-Name: Default Aug 23 07:14:13.770022 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-User-Id: 9f4d65ffaab942f29d449b64805c765a Aug 23 07:14:13.770022 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-User-Name: tempest-VolumesActionsTest-775986377-project Aug 23 07:14:13.770022 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: method: > Aug 23 07:14:13.770022 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: exception: Instance 6e6b1d40-6b77-4b49-b468-e936f953f85a could not be found. Aug 23 07:14:13.770022 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: action_args: {'id': '6e6b1d40-6b77-4b49-b468-e936f953f85a'} Aug 23 07:14:13.771316 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 07:14:13.771316 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 07:14:13.771316 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 07:14:13.771316 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 07:14:13.771316 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 07:14:13.771316 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 07:14:13.771316 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 07:14:13.771316 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 07:14:13.771316 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 07:14:13.771316 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 07:14:13.771316 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6e6b1d40-6b77-4b49-b468-e936f953f85a could not be found. Aug 23 07:14:13.771316 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi Aug 23 07:14:13.771316 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 07:14:13.771316 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi Aug 23 07:14:13.771316 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 07:14:13.771316 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 07:14:13.771316 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 07:14:13.771316 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 07:14:13.771316 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 07:14:13.771316 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 07:14:13.773026 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 07:14:13.773026 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 07:14:13.773026 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 07:14:13.773026 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 07:14:13.773026 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 07:14:13.773026 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 07:14:13.773026 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 07:14:13.773026 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6e6b1d40-6b77-4b49-b468-e936f953f85a could not be found. Aug 23 07:14:13.773026 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi Aug 23 07:14:13.773026 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 07:14:13.773026 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi Aug 23 07:14:13.773026 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 07:14:13.773026 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 07:14:13.773026 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 07:14:13.773026 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 07:14:13.773026 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 07:14:13.773026 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6e6b1d40-6b77-4b49-b468-e936f953f85a could not be found. Aug 23 07:14:13.773026 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi Aug 23 07:14:13.774983 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-4cd40583-d348-46ce-b538-ae055283ea15 tempest-VolumesActionsTest-775986377 tempest-VolumesActionsTest-775986377-project] Returning 404 to user: Instance 6e6b1d40-6b77-4b49-b468-e936f953f85a could not be found. {{(pid=120799) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 07:14:13.774983 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-4cd40583-d348-46ce-b538-ae055283ea15 tempest-VolumesActionsTest-775986377 tempest-VolumesActionsTest-775986377-project] 10.222.0.17 "GET /compute/v2.1/servers/6e6b1d40-6b77-4b49-b468-e936f953f85a" status: 404 len: 111 microversion: 2.1 time: 0.074642 Aug 23 07:14:13.774983 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 127/253] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:14:13 2022] GET /compute/v2.1/servers/6e6b1d40-6b77-4b49-b468-e936f953f85a => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 07:14:13.924958 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-b5d0335f-a78e-4808-882c-7c9d8c247c52 tempest-VolumesActionsTest-775986377 tempest-VolumesActionsTest-775986377-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-90694298", "imageRef": "b899fd65-02ae-4b43-bac7-86f38fc3f224", "flavorRef": "452", "networks": [{"uuid": "65ebeea8-bec0-4130-be8f-fea4bfc58160"}]}} {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 07:14:14.545014 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-462ca898-9295-47d7-adb3-dc4a4a3bb693 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Calling method '>' {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:14:14.545646 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.compute.api [None req-462ca898-9295-47d7-adb3-dc4a4a3bb693 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] [instance: 6915ed26-7e2f-41b9-aada-adcb2c2015d3] Fetching instance by UUID {{(pid=120799) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:14:14.558138 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-462ca898-9295-47d7-adb3-dc4a4a3bb693 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:14:14.558623 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-462ca898-9295-47d7-adb3-dc4a4a3bb693 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:14:14.559790 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-462ca898-9295-47d7-adb3-dc4a4a3bb693 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:14:14.560722 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-462ca898-9295-47d7-adb3-dc4a4a3bb693 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:14:14.561130 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-462ca898-9295-47d7-adb3-dc4a4a3bb693 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:14:14.561734 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-462ca898-9295-47d7-adb3-dc4a4a3bb693 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:14:14.711976 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.policy [None req-462ca898-9295-47d7-adb3-dc4a4a3bb693 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64d54cb95b264c18b45d90822507fae1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135367be6e3f4b3d965ee0d99fdca524', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120799) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:14:14.722681 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-462ca898-9295-47d7-adb3-dc4a4a3bb693 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] 10.222.0.17 "GET /compute/v2.1/servers/6915ed26-7e2f-41b9-aada-adcb2c2015d3" status: 200 len: 1522 microversion: 2.1 time: 0.180931 Aug 23 07:14:14.723777 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 128/254] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:14:14 2022] GET /compute/v2.1/servers/6915ed26-7e2f-41b9-aada-adcb2c2015d3 => generated 1522 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:14:15.750733 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-1d9dbd40-dd7b-4979-ba24-9f52093bccb4 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Calling method '>' {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:14:15.751384 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.compute.api [None req-1d9dbd40-dd7b-4979-ba24-9f52093bccb4 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] [instance: 6915ed26-7e2f-41b9-aada-adcb2c2015d3] Fetching instance by UUID {{(pid=120799) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:14:15.761272 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-1d9dbd40-dd7b-4979-ba24-9f52093bccb4 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:14:15.761900 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-1d9dbd40-dd7b-4979-ba24-9f52093bccb4 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:14:15.762476 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-1d9dbd40-dd7b-4979-ba24-9f52093bccb4 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:14:15.763266 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-1d9dbd40-dd7b-4979-ba24-9f52093bccb4 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:14:15.763854 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-1d9dbd40-dd7b-4979-ba24-9f52093bccb4 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:14:15.764935 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-1d9dbd40-dd7b-4979-ba24-9f52093bccb4 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:14:15.918894 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.policy [None req-1d9dbd40-dd7b-4979-ba24-9f52093bccb4 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64d54cb95b264c18b45d90822507fae1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135367be6e3f4b3d965ee0d99fdca524', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120799) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:14:15.926925 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-1d9dbd40-dd7b-4979-ba24-9f52093bccb4 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] 10.222.0.17 "GET /compute/v2.1/servers/6915ed26-7e2f-41b9-aada-adcb2c2015d3" status: 200 len: 1522 microversion: 2.1 time: 0.184705 Aug 23 07:14:15.927500 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 129/255] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:14:15 2022] GET /compute/v2.1/servers/6915ed26-7e2f-41b9-aada-adcb2c2015d3 => generated 1522 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:14:16.924301 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-d1a949b6-6412-46c4-836c-d5ac9f0105c9 tempest-VolumesNegativeTest-2027890769 tempest-VolumesNegativeTest-2027890769-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-291743482", "imageRef": "b899fd65-02ae-4b43-bac7-86f38fc3f224", "flavorRef": "452"}} {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 07:14:23.520159 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG dbcounter [-] [120798] Writing DB stats nova_cell1:SELECT=77,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120798) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:14:23.936341 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG dbcounter [-] [120798] Writing DB stats nova_api:SELECT=47 {{(pid=120798) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:14:25.923337 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG dbcounter [-] [120799] Writing DB stats nova_cell1:SELECT=48,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120799) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:14:26.934090 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG dbcounter [-] [120799] Writing DB stats nova_api:SELECT=11 {{(pid=120799) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:14:27.676325 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.network.neutron [None req-b5d0335f-a78e-4808-882c-7c9d8c247c52 tempest-VolumesActionsTest-775986377 tempest-VolumesActionsTest-775986377-project] validate_networks() for [('65ebeea8-bec0-4130-be8f-fea4bfc58160', None, None, None, None, None)] {{(pid=120798) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 23 07:14:27.686184 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.network.neutron [None req-d1a949b6-6412-46c4-836c-d5ac9f0105c9 tempest-VolumesNegativeTest-2027890769 tempest-VolumesNegativeTest-2027890769-project] validate_networks() for None {{(pid=120799) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 23 07:14:28.090914 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.virt.hardware [None req-d1a949b6-6412-46c4-836c-d5ac9f0105c9 tempest-VolumesNegativeTest-2027890769 tempest-VolumesNegativeTest-2027890769-project] Flavor limits 0:0:0 {{(pid=120799) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 07:14:28.091544 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.virt.hardware [None req-d1a949b6-6412-46c4-836c-d5ac9f0105c9 tempest-VolumesNegativeTest-2027890769 tempest-VolumesNegativeTest-2027890769-project] Image limits 0:0:0 {{(pid=120799) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 07:14:28.091875 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.virt.hardware [None req-d1a949b6-6412-46c4-836c-d5ac9f0105c9 tempest-VolumesNegativeTest-2027890769 tempest-VolumesNegativeTest-2027890769-project] Flavor pref 0:0:0 {{(pid=120799) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 07:14:28.092228 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.virt.hardware [None req-d1a949b6-6412-46c4-836c-d5ac9f0105c9 tempest-VolumesNegativeTest-2027890769 tempest-VolumesNegativeTest-2027890769-project] Image pref 0:0:0 {{(pid=120799) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 07:14:28.092954 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.virt.hardware [None req-d1a949b6-6412-46c4-836c-d5ac9f0105c9 tempest-VolumesNegativeTest-2027890769 tempest-VolumesNegativeTest-2027890769-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120799) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 07:14:28.103081 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-d1a949b6-6412-46c4-836c-d5ac9f0105c9 tempest-VolumesNegativeTest-2027890769 tempest-VolumesNegativeTest-2027890769-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:14:28.103597 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-d1a949b6-6412-46c4-836c-d5ac9f0105c9 tempest-VolumesNegativeTest-2027890769 tempest-VolumesNegativeTest-2027890769-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:14:28.104030 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-d1a949b6-6412-46c4-836c-d5ac9f0105c9 tempest-VolumesNegativeTest-2027890769 tempest-VolumesNegativeTest-2027890769-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:14:28.104757 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-d1a949b6-6412-46c4-836c-d5ac9f0105c9 tempest-VolumesNegativeTest-2027890769 tempest-VolumesNegativeTest-2027890769-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:14:28.105203 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-d1a949b6-6412-46c4-836c-d5ac9f0105c9 tempest-VolumesNegativeTest-2027890769 tempest-VolumesNegativeTest-2027890769-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:14:28.105696 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-d1a949b6-6412-46c4-836c-d5ac9f0105c9 tempest-VolumesNegativeTest-2027890769 tempest-VolumesNegativeTest-2027890769-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:14:28.125222 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.quota [None req-d1a949b6-6412-46c4-836c-d5ac9f0105c9 tempest-VolumesNegativeTest-2027890769 tempest-VolumesNegativeTest-2027890769-project] Getting quotas for project 3d91979a6ce9468c990b9e08e267d329. Resources: {'ram', 'instances', 'cores'} {{(pid=120799) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 07:14:28.129893 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.quota [None req-d1a949b6-6412-46c4-836c-d5ac9f0105c9 tempest-VolumesNegativeTest-2027890769 tempest-VolumesNegativeTest-2027890769-project] Getting quotas for user 6ed299381d5b49fb8577287af4368fe1 and project 3d91979a6ce9468c990b9e08e267d329. Resources: {'ram', 'instances', 'cores'} {{(pid=120799) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 07:14:28.142691 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.compute.api [None req-d1a949b6-6412-46c4-836c-d5ac9f0105c9 tempest-VolumesNegativeTest-2027890769 tempest-VolumesNegativeTest-2027890769-project] Going to run 1 instances... {{(pid=120799) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 23 07:14:28.145238 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.compute.api [None req-d1a949b6-6412-46c4-836c-d5ac9f0105c9 tempest-VolumesNegativeTest-2027890769 tempest-VolumesNegativeTest-2027890769-project] [instance: 52dfbaaf-557f-478e-bee8-e4856641b102] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b899fd65-02ae-4b43-bac7-86f38fc3f224',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120799) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 07:14:28.199854 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-d1a949b6-6412-46c4-836c-d5ac9f0105c9 tempest-VolumesNegativeTest-2027890769 tempest-VolumesNegativeTest-2027890769-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 11.279233 Aug 23 07:14:28.200754 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 130/256] 10.222.0.17 () {60 vars in 1147 bytes} [Tue Aug 23 07:14:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 11281 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 23 07:14:28.209922 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-65d9cd2b-c142-4ece-ae71-ee100dc1f52e tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Calling method '>' {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:14:28.210589 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.compute.api [None req-65d9cd2b-c142-4ece-ae71-ee100dc1f52e tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] [instance: 6915ed26-7e2f-41b9-aada-adcb2c2015d3] Fetching instance by UUID {{(pid=120799) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:14:28.217852 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-65d9cd2b-c142-4ece-ae71-ee100dc1f52e tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:14:28.218245 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-65d9cd2b-c142-4ece-ae71-ee100dc1f52e tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:14:28.218672 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-65d9cd2b-c142-4ece-ae71-ee100dc1f52e tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:14:28.219348 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-65d9cd2b-c142-4ece-ae71-ee100dc1f52e tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:14:28.220768 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-65d9cd2b-c142-4ece-ae71-ee100dc1f52e tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:14:28.221008 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-65d9cd2b-c142-4ece-ae71-ee100dc1f52e tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:14:28.267174 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.virt.hardware [None req-b5d0335f-a78e-4808-882c-7c9d8c247c52 tempest-VolumesActionsTest-775986377 tempest-VolumesActionsTest-775986377-project] Flavor limits 0:0:0 {{(pid=120798) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 07:14:28.267617 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.virt.hardware [None req-b5d0335f-a78e-4808-882c-7c9d8c247c52 tempest-VolumesActionsTest-775986377 tempest-VolumesActionsTest-775986377-project] Image limits 0:0:0 {{(pid=120798) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 07:14:28.268108 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.virt.hardware [None req-b5d0335f-a78e-4808-882c-7c9d8c247c52 tempest-VolumesActionsTest-775986377 tempest-VolumesActionsTest-775986377-project] Flavor pref 0:0:0 {{(pid=120798) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 07:14:28.268497 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.virt.hardware [None req-b5d0335f-a78e-4808-882c-7c9d8c247c52 tempest-VolumesActionsTest-775986377 tempest-VolumesActionsTest-775986377-project] Image pref 0:0:0 {{(pid=120798) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 07:14:28.269083 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.virt.hardware [None req-b5d0335f-a78e-4808-882c-7c9d8c247c52 tempest-VolumesActionsTest-775986377 tempest-VolumesActionsTest-775986377-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120798) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 07:14:28.278612 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-b5d0335f-a78e-4808-882c-7c9d8c247c52 tempest-VolumesActionsTest-775986377 tempest-VolumesActionsTest-775986377-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:14:28.279045 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-b5d0335f-a78e-4808-882c-7c9d8c247c52 tempest-VolumesActionsTest-775986377 tempest-VolumesActionsTest-775986377-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:14:28.280764 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-b5d0335f-a78e-4808-882c-7c9d8c247c52 tempest-VolumesActionsTest-775986377 tempest-VolumesActionsTest-775986377-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:14:28.281602 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-b5d0335f-a78e-4808-882c-7c9d8c247c52 tempest-VolumesActionsTest-775986377 tempest-VolumesActionsTest-775986377-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:14:28.282054 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-b5d0335f-a78e-4808-882c-7c9d8c247c52 tempest-VolumesActionsTest-775986377 tempest-VolumesActionsTest-775986377-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:14:28.282473 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-b5d0335f-a78e-4808-882c-7c9d8c247c52 tempest-VolumesActionsTest-775986377 tempest-VolumesActionsTest-775986377-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:14:28.302175 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.quota [None req-b5d0335f-a78e-4808-882c-7c9d8c247c52 tempest-VolumesActionsTest-775986377 tempest-VolumesActionsTest-775986377-project] Getting quotas for project 0a2ef3b6384a4194a26ba51078c425af. Resources: {'ram', 'instances', 'cores'} {{(pid=120798) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 07:14:28.306412 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.quota [None req-b5d0335f-a78e-4808-882c-7c9d8c247c52 tempest-VolumesActionsTest-775986377 tempest-VolumesActionsTest-775986377-project] Getting quotas for user 9f4d65ffaab942f29d449b64805c765a and project 0a2ef3b6384a4194a26ba51078c425af. Resources: {'ram', 'instances', 'cores'} {{(pid=120798) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 07:14:28.318665 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.compute.api [None req-b5d0335f-a78e-4808-882c-7c9d8c247c52 tempest-VolumesActionsTest-775986377 tempest-VolumesActionsTest-775986377-project] Going to run 1 instances... {{(pid=120798) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 23 07:14:28.320880 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.compute.api [None req-b5d0335f-a78e-4808-882c-7c9d8c247c52 tempest-VolumesActionsTest-775986377 tempest-VolumesActionsTest-775986377-project] [instance: 118d56f5-a1b4-402d-9e43-b432c2b63b14] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b899fd65-02ae-4b43-bac7-86f38fc3f224',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120798) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 07:14:28.385058 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [None req-b5d0335f-a78e-4808-882c-7c9d8c247c52 tempest-VolumesActionsTest-775986377 tempest-VolumesActionsTest-775986377-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 14.463467 Aug 23 07:14:28.390155 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 127/257] 10.222.0.17 () {60 vars in 1147 bytes} [Tue Aug 23 07:14:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 14466 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 23 07:14:28.390625 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.policy [None req-65d9cd2b-c142-4ece-ae71-ee100dc1f52e tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64d54cb95b264c18b45d90822507fae1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135367be6e3f4b3d965ee0d99fdca524', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120799) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:14:28.398915 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-65d9cd2b-c142-4ece-ae71-ee100dc1f52e tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] 10.222.0.17 "GET /compute/v2.1/servers/6915ed26-7e2f-41b9-aada-adcb2c2015d3" status: 200 len: 1522 microversion: 2.1 time: 0.193626 Aug 23 07:14:28.399640 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 131/258] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:14:28 2022] GET /compute/v2.1/servers/6915ed26-7e2f-41b9-aada-adcb2c2015d3 => generated 1522 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:14:28.400202 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-6bf2a56f-f20a-4408-af75-9981e50be787 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Action: 'create', calling method: .version_select at 0x7fe3c624fa60>, body: {"keypair": {"name": "tempest-keypair-1754755496", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHUheLq5Jz88nQXBlPWtng/nlMxImp1a7Cw+zGk39zLy2yCus4fh069tXvLviU7edAS+xNSOJMBsOCKQD2W+1RehDGSnngl3KcW1dy1691UrHXREJuKANiujcK+ig/93Iw=="}} {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 07:14:28.411897 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-697df226-cf7f-41dc-8a35-11c82138e096 tempest-VolumesNegativeTest-2027890769 tempest-VolumesNegativeTest-2027890769-project] Calling method '>' {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:14:28.413134 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.compute.api [None req-697df226-cf7f-41dc-8a35-11c82138e096 tempest-VolumesNegativeTest-2027890769 tempest-VolumesNegativeTest-2027890769-project] [instance: 52dfbaaf-557f-478e-bee8-e4856641b102] Fetching instance by UUID {{(pid=120799) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:14:28.422712 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.quota [None req-6bf2a56f-f20a-4408-af75-9981e50be787 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Getting quotas for project eb44f62fa62e46528712f24479cbb19f. Resources: {'key_pairs'} {{(pid=120798) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 07:14:28.427456 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.quota [None req-6bf2a56f-f20a-4408-af75-9981e50be787 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Getting quotas for user 471dc5c1db64411ab1d80ad6c038e519 and project eb44f62fa62e46528712f24479cbb19f. Resources: {'key_pairs'} {{(pid=120798) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 07:14:28.476486 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.policy [None req-697df226-cf7f-41dc-8a35-11c82138e096 tempest-VolumesNegativeTest-2027890769 tempest-VolumesNegativeTest-2027890769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ed299381d5b49fb8577287af4368fe1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d91979a6ce9468c990b9e08e267d329', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120799) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:14:28.484505 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-697df226-cf7f-41dc-8a35-11c82138e096 tempest-VolumesNegativeTest-2027890769 tempest-VolumesNegativeTest-2027890769-project] 10.222.0.17 "GET /compute/v2.1/servers/52dfbaaf-557f-478e-bee8-e4856641b102" status: 200 len: 1214 microversion: 2.1 time: 0.083787 Aug 23 07:14:28.485077 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 132/259] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:14:28 2022] GET /compute/v2.1/servers/52dfbaaf-557f-478e-bee8-e4856641b102 => generated 1214 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:14:28.489827 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-9c66f074-2330-4673-a4ef-1dabdfee42e9 tempest-VolumesActionsTest-775986377 tempest-VolumesActionsTest-775986377-project] Calling method '>' {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:14:28.490432 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.compute.api [None req-9c66f074-2330-4673-a4ef-1dabdfee42e9 tempest-VolumesActionsTest-775986377 tempest-VolumesActionsTest-775986377-project] [instance: 118d56f5-a1b4-402d-9e43-b432c2b63b14] Fetching instance by UUID {{(pid=120799) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:14:28.492446 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [None req-6bf2a56f-f20a-4408-af75-9981e50be787 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.103797 Aug 23 07:14:28.493213 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 128/260] 10.222.0.17 () {60 vars in 1159 bytes} [Tue Aug 23 07:14:28 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 07:14:28.579960 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.policy [None req-9c66f074-2330-4673-a4ef-1dabdfee42e9 tempest-VolumesActionsTest-775986377 tempest-VolumesActionsTest-775986377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f4d65ffaab942f29d449b64805c765a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2ef3b6384a4194a26ba51078c425af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120799) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:14:28.587843 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-9c66f074-2330-4673-a4ef-1dabdfee42e9 tempest-VolumesActionsTest-775986377 tempest-VolumesActionsTest-775986377-project] 10.222.0.17 "GET /compute/v2.1/servers/118d56f5-a1b4-402d-9e43-b432c2b63b14" status: 200 len: 1212 microversion: 2.1 time: 0.101384 Aug 23 07:14:28.588607 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 133/261] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:14:28 2022] GET /compute/v2.1/servers/118d56f5-a1b4-402d-9e43-b432c2b63b14 => generated 1212 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:14:29.421596 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-a71ae294-bea7-431f-baab-37ba7a9886f8 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Calling method '>' {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:14:29.422846 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.compute.api [None req-a71ae294-bea7-431f-baab-37ba7a9886f8 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] [instance: 6915ed26-7e2f-41b9-aada-adcb2c2015d3] Fetching instance by UUID {{(pid=120798) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:14:29.430669 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-a71ae294-bea7-431f-baab-37ba7a9886f8 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:14:29.431282 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-a71ae294-bea7-431f-baab-37ba7a9886f8 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:14:29.431829 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-a71ae294-bea7-431f-baab-37ba7a9886f8 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:14:29.432597 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-a71ae294-bea7-431f-baab-37ba7a9886f8 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:14:29.433249 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-a71ae294-bea7-431f-baab-37ba7a9886f8 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:14:29.433796 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-a71ae294-bea7-431f-baab-37ba7a9886f8 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:14:29.504488 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-2ca4d7c4-5c46-4356-bf9a-38405a9fb095 tempest-VolumesNegativeTest-2027890769 tempest-VolumesNegativeTest-2027890769-project] Calling method '>' {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:14:29.505103 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.compute.api [None req-2ca4d7c4-5c46-4356-bf9a-38405a9fb095 tempest-VolumesNegativeTest-2027890769 tempest-VolumesNegativeTest-2027890769-project] [instance: 52dfbaaf-557f-478e-bee8-e4856641b102] Fetching instance by UUID {{(pid=120799) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:14:29.511696 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-2ca4d7c4-5c46-4356-bf9a-38405a9fb095 tempest-VolumesNegativeTest-2027890769 tempest-VolumesNegativeTest-2027890769-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:14:29.512423 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-2ca4d7c4-5c46-4356-bf9a-38405a9fb095 tempest-VolumesNegativeTest-2027890769 tempest-VolumesNegativeTest-2027890769-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:14:29.512889 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-2ca4d7c4-5c46-4356-bf9a-38405a9fb095 tempest-VolumesNegativeTest-2027890769 tempest-VolumesNegativeTest-2027890769-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:14:29.513580 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-2ca4d7c4-5c46-4356-bf9a-38405a9fb095 tempest-VolumesNegativeTest-2027890769 tempest-VolumesNegativeTest-2027890769-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:14:29.514190 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-2ca4d7c4-5c46-4356-bf9a-38405a9fb095 tempest-VolumesNegativeTest-2027890769 tempest-VolumesNegativeTest-2027890769-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:14:29.514614 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-2ca4d7c4-5c46-4356-bf9a-38405a9fb095 tempest-VolumesNegativeTest-2027890769 tempest-VolumesNegativeTest-2027890769-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:14:29.673071 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.policy [None req-2ca4d7c4-5c46-4356-bf9a-38405a9fb095 tempest-VolumesNegativeTest-2027890769 tempest-VolumesNegativeTest-2027890769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ed299381d5b49fb8577287af4368fe1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d91979a6ce9468c990b9e08e267d329', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120799) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:14:29.683704 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-2ca4d7c4-5c46-4356-bf9a-38405a9fb095 tempest-VolumesNegativeTest-2027890769 tempest-VolumesNegativeTest-2027890769-project] 10.222.0.17 "GET /compute/v2.1/servers/52dfbaaf-557f-478e-bee8-e4856641b102" status: 200 len: 1284 microversion: 2.1 time: 0.180648 Aug 23 07:14:29.683704 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 134/262] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:14:29 2022] GET /compute/v2.1/servers/52dfbaaf-557f-478e-bee8-e4856641b102 => generated 1284 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:14:29.698922 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-653e03dd-d22c-4eb7-90ca-f645d0c516bb tempest-VolumesActionsTest-775986377 tempest-VolumesActionsTest-775986377-project] Calling method '>' {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:14:29.699907 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.compute.api [None req-653e03dd-d22c-4eb7-90ca-f645d0c516bb tempest-VolumesActionsTest-775986377 tempest-VolumesActionsTest-775986377-project] [instance: 118d56f5-a1b4-402d-9e43-b432c2b63b14] Fetching instance by UUID {{(pid=120799) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:14:29.708474 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-653e03dd-d22c-4eb7-90ca-f645d0c516bb tempest-VolumesActionsTest-775986377 tempest-VolumesActionsTest-775986377-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:14:29.708952 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-653e03dd-d22c-4eb7-90ca-f645d0c516bb tempest-VolumesActionsTest-775986377 tempest-VolumesActionsTest-775986377-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:14:29.709590 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-653e03dd-d22c-4eb7-90ca-f645d0c516bb tempest-VolumesActionsTest-775986377 tempest-VolumesActionsTest-775986377-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:14:29.710601 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-653e03dd-d22c-4eb7-90ca-f645d0c516bb tempest-VolumesActionsTest-775986377 tempest-VolumesActionsTest-775986377-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:14:29.710822 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-653e03dd-d22c-4eb7-90ca-f645d0c516bb tempest-VolumesActionsTest-775986377 tempest-VolumesActionsTest-775986377-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:14:29.711207 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-653e03dd-d22c-4eb7-90ca-f645d0c516bb tempest-VolumesActionsTest-775986377 tempest-VolumesActionsTest-775986377-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:14:29.811861 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.policy [None req-653e03dd-d22c-4eb7-90ca-f645d0c516bb tempest-VolumesActionsTest-775986377 tempest-VolumesActionsTest-775986377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f4d65ffaab942f29d449b64805c765a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2ef3b6384a4194a26ba51078c425af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120799) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:14:29.820779 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-653e03dd-d22c-4eb7-90ca-f645d0c516bb tempest-VolumesActionsTest-775986377 tempest-VolumesActionsTest-775986377-project] 10.222.0.17 "GET /compute/v2.1/servers/118d56f5-a1b4-402d-9e43-b432c2b63b14" status: 200 len: 1264 microversion: 2.1 time: 0.136890 Aug 23 07:14:29.821893 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 135/263] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:14:29 2022] GET /compute/v2.1/servers/118d56f5-a1b4-402d-9e43-b432c2b63b14 => generated 1264 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:14:29.865221 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.policy [None req-a71ae294-bea7-431f-baab-37ba7a9886f8 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64d54cb95b264c18b45d90822507fae1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135367be6e3f4b3d965ee0d99fdca524', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120798) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:14:29.876722 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [None req-a71ae294-bea7-431f-baab-37ba7a9886f8 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] 10.222.0.17 "GET /compute/v2.1/servers/6915ed26-7e2f-41b9-aada-adcb2c2015d3" status: 200 len: 1522 microversion: 2.1 time: 0.459806 Aug 23 07:14:29.881035 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 129/264] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:14:29 2022] GET /compute/v2.1/servers/6915ed26-7e2f-41b9-aada-adcb2c2015d3 => generated 1522 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:14:30.702578 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-a2cf5fb7-11c6-4419-bc6d-2f845f213be0 tempest-VolumesNegativeTest-2027890769 tempest-VolumesNegativeTest-2027890769-project] Calling method '>' {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:14:30.703319 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.compute.api [None req-a2cf5fb7-11c6-4419-bc6d-2f845f213be0 tempest-VolumesNegativeTest-2027890769 tempest-VolumesNegativeTest-2027890769-project] [instance: 52dfbaaf-557f-478e-bee8-e4856641b102] Fetching instance by UUID {{(pid=120799) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:14:30.711046 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-a2cf5fb7-11c6-4419-bc6d-2f845f213be0 tempest-VolumesNegativeTest-2027890769 tempest-VolumesNegativeTest-2027890769-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:14:30.711663 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-a2cf5fb7-11c6-4419-bc6d-2f845f213be0 tempest-VolumesNegativeTest-2027890769 tempest-VolumesNegativeTest-2027890769-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:14:30.712339 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-a2cf5fb7-11c6-4419-bc6d-2f845f213be0 tempest-VolumesNegativeTest-2027890769 tempest-VolumesNegativeTest-2027890769-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:14:30.713049 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-a2cf5fb7-11c6-4419-bc6d-2f845f213be0 tempest-VolumesNegativeTest-2027890769 tempest-VolumesNegativeTest-2027890769-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:14:30.713510 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-a2cf5fb7-11c6-4419-bc6d-2f845f213be0 tempest-VolumesNegativeTest-2027890769 tempest-VolumesNegativeTest-2027890769-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:14:30.713919 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-a2cf5fb7-11c6-4419-bc6d-2f845f213be0 tempest-VolumesNegativeTest-2027890769 tempest-VolumesNegativeTest-2027890769-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:14:30.802406 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.policy [None req-a2cf5fb7-11c6-4419-bc6d-2f845f213be0 tempest-VolumesNegativeTest-2027890769 tempest-VolumesNegativeTest-2027890769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ed299381d5b49fb8577287af4368fe1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d91979a6ce9468c990b9e08e267d329', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120799) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:14:30.810765 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-a2cf5fb7-11c6-4419-bc6d-2f845f213be0 tempest-VolumesNegativeTest-2027890769 tempest-VolumesNegativeTest-2027890769-project] 10.222.0.17 "GET /compute/v2.1/servers/52dfbaaf-557f-478e-bee8-e4856641b102" status: 200 len: 1272 microversion: 2.1 time: 0.112242 Aug 23 07:14:30.811352 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 136/265] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:14:30 2022] GET /compute/v2.1/servers/52dfbaaf-557f-478e-bee8-e4856641b102 => generated 1272 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:14:30.853544 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-f7a41959-c237-46ef-a268-caa014dc643f tempest-VolumesActionsTest-775986377 tempest-VolumesActionsTest-775986377-project] Calling method '>' {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:14:30.854149 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.compute.api [None req-f7a41959-c237-46ef-a268-caa014dc643f tempest-VolumesActionsTest-775986377 tempest-VolumesActionsTest-775986377-project] [instance: 118d56f5-a1b4-402d-9e43-b432c2b63b14] Fetching instance by UUID {{(pid=120798) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:14:30.861926 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-f7a41959-c237-46ef-a268-caa014dc643f tempest-VolumesActionsTest-775986377 tempest-VolumesActionsTest-775986377-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:14:30.862442 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-f7a41959-c237-46ef-a268-caa014dc643f tempest-VolumesActionsTest-775986377 tempest-VolumesActionsTest-775986377-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:14:30.863076 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-f7a41959-c237-46ef-a268-caa014dc643f tempest-VolumesActionsTest-775986377 tempest-VolumesActionsTest-775986377-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:14:30.863825 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-f7a41959-c237-46ef-a268-caa014dc643f tempest-VolumesActionsTest-775986377 tempest-VolumesActionsTest-775986377-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:14:30.864271 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-f7a41959-c237-46ef-a268-caa014dc643f tempest-VolumesActionsTest-775986377 tempest-VolumesActionsTest-775986377-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:14:30.864877 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-f7a41959-c237-46ef-a268-caa014dc643f tempest-VolumesActionsTest-775986377 tempest-VolumesActionsTest-775986377-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:14:30.903626 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-a4741b7e-72bf-43eb-b356-f1302cb9d376 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Calling method '>' {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:14:30.904140 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.compute.api [None req-a4741b7e-72bf-43eb-b356-f1302cb9d376 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] [instance: 6915ed26-7e2f-41b9-aada-adcb2c2015d3] Fetching instance by UUID {{(pid=120799) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:14:30.910846 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-a4741b7e-72bf-43eb-b356-f1302cb9d376 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:14:30.911716 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-a4741b7e-72bf-43eb-b356-f1302cb9d376 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:14:30.912255 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-a4741b7e-72bf-43eb-b356-f1302cb9d376 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:14:30.913051 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-a4741b7e-72bf-43eb-b356-f1302cb9d376 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:14:30.913510 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-a4741b7e-72bf-43eb-b356-f1302cb9d376 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:14:30.913936 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-a4741b7e-72bf-43eb-b356-f1302cb9d376 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:14:31.186657 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.policy [None req-f7a41959-c237-46ef-a268-caa014dc643f tempest-VolumesActionsTest-775986377 tempest-VolumesActionsTest-775986377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f4d65ffaab942f29d449b64805c765a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2ef3b6384a4194a26ba51078c425af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120798) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:14:31.195809 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [None req-f7a41959-c237-46ef-a268-caa014dc643f tempest-VolumesActionsTest-775986377 tempest-VolumesActionsTest-775986377-project] 10.222.0.17 "GET /compute/v2.1/servers/118d56f5-a1b4-402d-9e43-b432c2b63b14" status: 200 len: 1312 microversion: 2.1 time: 0.345721 Aug 23 07:14:31.201866 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 130/266] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:14:30 2022] GET /compute/v2.1/servers/118d56f5-a1b4-402d-9e43-b432c2b63b14 => generated 1312 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:14:31.201866 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-8c8536a8-f475-4c50-b40c-e4d8ff7a3bfc tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-139890881", "imageRef": "b899fd65-02ae-4b43-bac7-86f38fc3f224", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "5ee97029-6237-4f87-a16d-878d9597a1a6"}], "security_groups": [{"name": "tempest-securitygroup--280310632"}], "key_name": "tempest-keypair-1754755496", "user_data": "}} {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 07:14:31.218737 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.policy [None req-a4741b7e-72bf-43eb-b356-f1302cb9d376 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64d54cb95b264c18b45d90822507fae1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135367be6e3f4b3d965ee0d99fdca524', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120799) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:14:31.228036 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-a4741b7e-72bf-43eb-b356-f1302cb9d376 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] 10.222.0.17 "GET /compute/v2.1/servers/6915ed26-7e2f-41b9-aada-adcb2c2015d3" status: 200 len: 1522 microversion: 2.1 time: 0.328666 Aug 23 07:14:31.228689 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 137/267] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:14:30 2022] GET /compute/v2.1/servers/6915ed26-7e2f-41b9-aada-adcb2c2015d3 => generated 1522 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:14:31.317365 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.network.neutron [None req-8c8536a8-f475-4c50-b40c-e4d8ff7a3bfc tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] validate_networks() for [('5ee97029-6237-4f87-a16d-878d9597a1a6', None, None, None, None, None)] {{(pid=120798) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 23 07:14:31.704574 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.virt.hardware [None req-8c8536a8-f475-4c50-b40c-e4d8ff7a3bfc tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Flavor limits 0:0:0 {{(pid=120798) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 07:14:31.704995 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.virt.hardware [None req-8c8536a8-f475-4c50-b40c-e4d8ff7a3bfc tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Image limits 0:0:0 {{(pid=120798) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 07:14:31.705640 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.virt.hardware [None req-8c8536a8-f475-4c50-b40c-e4d8ff7a3bfc tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Flavor pref 0:0:0 {{(pid=120798) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 07:14:31.707045 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.virt.hardware [None req-8c8536a8-f475-4c50-b40c-e4d8ff7a3bfc tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Image pref 0:0:0 {{(pid=120798) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 07:14:31.707045 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.virt.hardware [None req-8c8536a8-f475-4c50-b40c-e4d8ff7a3bfc tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120798) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 07:14:31.716327 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-8c8536a8-f475-4c50-b40c-e4d8ff7a3bfc tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:14:31.716814 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-8c8536a8-f475-4c50-b40c-e4d8ff7a3bfc tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:14:31.717250 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-8c8536a8-f475-4c50-b40c-e4d8ff7a3bfc tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:14:31.717997 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-8c8536a8-f475-4c50-b40c-e4d8ff7a3bfc tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:14:31.718447 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-8c8536a8-f475-4c50-b40c-e4d8ff7a3bfc tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:14:31.718868 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-8c8536a8-f475-4c50-b40c-e4d8ff7a3bfc tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:14:31.735443 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.quota [None req-8c8536a8-f475-4c50-b40c-e4d8ff7a3bfc tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Getting quotas for project eb44f62fa62e46528712f24479cbb19f. Resources: {'ram', 'instances', 'cores'} {{(pid=120798) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 07:14:31.739190 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.quota [None req-8c8536a8-f475-4c50-b40c-e4d8ff7a3bfc tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Getting quotas for user 471dc5c1db64411ab1d80ad6c038e519 and project eb44f62fa62e46528712f24479cbb19f. Resources: {'ram', 'instances', 'cores'} {{(pid=120798) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 07:14:31.751257 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.compute.api [None req-8c8536a8-f475-4c50-b40c-e4d8ff7a3bfc tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Going to run 1 instances... {{(pid=120798) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 23 07:14:31.753446 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.compute.api [None req-8c8536a8-f475-4c50-b40c-e4d8ff7a3bfc tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] [instance: ce9a9c42-b9ed-40b1-b72c-390b85578204] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b899fd65-02ae-4b43-bac7-86f38fc3f224',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120798) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 07:14:31.801379 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [None req-8c8536a8-f475-4c50-b40c-e4d8ff7a3bfc tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.603985 Aug 23 07:14:31.802144 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 131/268] 10.222.0.17 () {60 vars in 1147 bytes} [Tue Aug 23 07:14:31 2022] POST /compute/v2.1/servers => generated 401 bytes in 605 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 23 07:14:31.813681 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-1fe806ab-2c24-45b9-8897-d5182e458039 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Calling method '>' {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:14:31.814276 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.compute.api [None req-1fe806ab-2c24-45b9-8897-d5182e458039 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] [instance: ce9a9c42-b9ed-40b1-b72c-390b85578204] Fetching instance by UUID {{(pid=120799) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:14:31.832873 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-fe9cb495-35ad-4cee-84dc-e05d07f4cb47 tempest-VolumesNegativeTest-2027890769 tempest-VolumesNegativeTest-2027890769-project] Calling method '>' {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:14:31.833584 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.compute.api [None req-fe9cb495-35ad-4cee-84dc-e05d07f4cb47 tempest-VolumesNegativeTest-2027890769 tempest-VolumesNegativeTest-2027890769-project] [instance: 52dfbaaf-557f-478e-bee8-e4856641b102] Fetching instance by UUID {{(pid=120798) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:14:31.842989 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-fe9cb495-35ad-4cee-84dc-e05d07f4cb47 tempest-VolumesNegativeTest-2027890769 tempest-VolumesNegativeTest-2027890769-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:14:31.843593 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-fe9cb495-35ad-4cee-84dc-e05d07f4cb47 tempest-VolumesNegativeTest-2027890769 tempest-VolumesNegativeTest-2027890769-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:14:31.844090 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-fe9cb495-35ad-4cee-84dc-e05d07f4cb47 tempest-VolumesNegativeTest-2027890769 tempest-VolumesNegativeTest-2027890769-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:14:31.844824 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-fe9cb495-35ad-4cee-84dc-e05d07f4cb47 tempest-VolumesNegativeTest-2027890769 tempest-VolumesNegativeTest-2027890769-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:14:31.845351 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-fe9cb495-35ad-4cee-84dc-e05d07f4cb47 tempest-VolumesNegativeTest-2027890769 tempest-VolumesNegativeTest-2027890769-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:14:31.845888 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-fe9cb495-35ad-4cee-84dc-e05d07f4cb47 tempest-VolumesNegativeTest-2027890769 tempest-VolumesNegativeTest-2027890769-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:14:31.872673 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.policy [None req-1fe806ab-2c24-45b9-8897-d5182e458039 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '471dc5c1db64411ab1d80ad6c038e519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb44f62fa62e46528712f24479cbb19f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120799) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:14:31.880122 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-1fe806ab-2c24-45b9-8897-d5182e458039 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] 10.222.0.17 "GET /compute/v2.1/servers/ce9a9c42-b9ed-40b1-b72c-390b85578204" status: 200 len: 1241 microversion: 2.1 time: 0.070286 Aug 23 07:14:31.881063 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 138/269] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:14:31 2022] GET /compute/v2.1/servers/ce9a9c42-b9ed-40b1-b72c-390b85578204 => generated 1241 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:14:31.987717 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.policy [None req-fe9cb495-35ad-4cee-84dc-e05d07f4cb47 tempest-VolumesNegativeTest-2027890769 tempest-VolumesNegativeTest-2027890769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ed299381d5b49fb8577287af4368fe1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d91979a6ce9468c990b9e08e267d329', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120798) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:14:31.995578 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [None req-fe9cb495-35ad-4cee-84dc-e05d07f4cb47 tempest-VolumesNegativeTest-2027890769 tempest-VolumesNegativeTest-2027890769-project] 10.222.0.17 "GET /compute/v2.1/servers/52dfbaaf-557f-478e-bee8-e4856641b102" status: 200 len: 1314 microversion: 2.1 time: 0.167858 Aug 23 07:14:31.996146 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 132/270] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:14:31 2022] GET /compute/v2.1/servers/52dfbaaf-557f-478e-bee8-e4856641b102 => generated 1314 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:14:32.217696 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-05399131-db47-4c3d-96b1-102e5d9b53d1 tempest-VolumesActionsTest-775986377 tempest-VolumesActionsTest-775986377-project] Calling method '>' {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:14:32.218296 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.compute.api [None req-05399131-db47-4c3d-96b1-102e5d9b53d1 tempest-VolumesActionsTest-775986377 tempest-VolumesActionsTest-775986377-project] [instance: 118d56f5-a1b4-402d-9e43-b432c2b63b14] Fetching instance by UUID {{(pid=120799) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:14:32.225044 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-05399131-db47-4c3d-96b1-102e5d9b53d1 tempest-VolumesActionsTest-775986377 tempest-VolumesActionsTest-775986377-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:14:32.225518 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-05399131-db47-4c3d-96b1-102e5d9b53d1 tempest-VolumesActionsTest-775986377 tempest-VolumesActionsTest-775986377-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:14:32.225951 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-05399131-db47-4c3d-96b1-102e5d9b53d1 tempest-VolumesActionsTest-775986377 tempest-VolumesActionsTest-775986377-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:14:32.226643 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-05399131-db47-4c3d-96b1-102e5d9b53d1 tempest-VolumesActionsTest-775986377 tempest-VolumesActionsTest-775986377-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:14:32.227088 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-05399131-db47-4c3d-96b1-102e5d9b53d1 tempest-VolumesActionsTest-775986377 tempest-VolumesActionsTest-775986377-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:14:32.227534 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-05399131-db47-4c3d-96b1-102e5d9b53d1 tempest-VolumesActionsTest-775986377 tempest-VolumesActionsTest-775986377-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:14:32.249738 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-d2934196-fd17-4cc7-b377-06e9477add1e tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Calling method '>' {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:14:32.250383 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.compute.api [None req-d2934196-fd17-4cc7-b377-06e9477add1e tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] [instance: 6915ed26-7e2f-41b9-aada-adcb2c2015d3] Fetching instance by UUID {{(pid=120798) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:14:32.256567 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-d2934196-fd17-4cc7-b377-06e9477add1e tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:14:32.257050 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-d2934196-fd17-4cc7-b377-06e9477add1e tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:14:32.257480 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-d2934196-fd17-4cc7-b377-06e9477add1e tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:14:32.258168 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-d2934196-fd17-4cc7-b377-06e9477add1e tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:14:32.258608 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-d2934196-fd17-4cc7-b377-06e9477add1e tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:14:32.259042 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-d2934196-fd17-4cc7-b377-06e9477add1e tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:14:32.406256 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.policy [None req-05399131-db47-4c3d-96b1-102e5d9b53d1 tempest-VolumesActionsTest-775986377 tempest-VolumesActionsTest-775986377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f4d65ffaab942f29d449b64805c765a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2ef3b6384a4194a26ba51078c425af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120799) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:14:32.414755 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-05399131-db47-4c3d-96b1-102e5d9b53d1 tempest-VolumesActionsTest-775986377 tempest-VolumesActionsTest-775986377-project] 10.222.0.17 "GET /compute/v2.1/servers/118d56f5-a1b4-402d-9e43-b432c2b63b14" status: 200 len: 1312 microversion: 2.1 time: 0.201448 Aug 23 07:14:32.415246 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 139/271] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:14:32 2022] GET /compute/v2.1/servers/118d56f5-a1b4-402d-9e43-b432c2b63b14 => generated 1312 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:14:32.434332 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.policy [None req-d2934196-fd17-4cc7-b377-06e9477add1e tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64d54cb95b264c18b45d90822507fae1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135367be6e3f4b3d965ee0d99fdca524', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120798) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:14:32.442382 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [None req-d2934196-fd17-4cc7-b377-06e9477add1e tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] 10.222.0.17 "GET /compute/v2.1/servers/6915ed26-7e2f-41b9-aada-adcb2c2015d3" status: 200 len: 1522 microversion: 2.1 time: 0.196707 Aug 23 07:14:32.442949 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 133/272] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:14:32 2022] GET /compute/v2.1/servers/6915ed26-7e2f-41b9-aada-adcb2c2015d3 => generated 1522 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:14:32.901988 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-673502e5-3236-40cb-9410-c95875976766 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Calling method '>' {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:14:32.902624 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.compute.api [None req-673502e5-3236-40cb-9410-c95875976766 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] [instance: ce9a9c42-b9ed-40b1-b72c-390b85578204] Fetching instance by UUID {{(pid=120799) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:14:32.910813 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-673502e5-3236-40cb-9410-c95875976766 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:14:32.911441 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-673502e5-3236-40cb-9410-c95875976766 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:14:32.912048 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-673502e5-3236-40cb-9410-c95875976766 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:14:32.912897 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-673502e5-3236-40cb-9410-c95875976766 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:14:32.913167 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-673502e5-3236-40cb-9410-c95875976766 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:14:32.913575 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-673502e5-3236-40cb-9410-c95875976766 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:14:33.004026 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.policy [None req-673502e5-3236-40cb-9410-c95875976766 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '471dc5c1db64411ab1d80ad6c038e519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb44f62fa62e46528712f24479cbb19f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120799) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:14:33.013298 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-673502e5-3236-40cb-9410-c95875976766 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] 10.222.0.17 "GET /compute/v2.1/servers/ce9a9c42-b9ed-40b1-b72c-390b85578204" status: 200 len: 1293 microversion: 2.1 time: 0.116100 Aug 23 07:14:33.014381 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 140/273] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:14:32 2022] GET /compute/v2.1/servers/ce9a9c42-b9ed-40b1-b72c-390b85578204 => generated 1293 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:14:33.018496 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-94721502-e3e0-4df6-b4a1-15ffa36537f1 tempest-VolumesNegativeTest-2027890769 tempest-VolumesNegativeTest-2027890769-project] Calling method '>' {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:14:33.019774 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.compute.api [None req-94721502-e3e0-4df6-b4a1-15ffa36537f1 tempest-VolumesNegativeTest-2027890769 tempest-VolumesNegativeTest-2027890769-project] [instance: 52dfbaaf-557f-478e-bee8-e4856641b102] Fetching instance by UUID {{(pid=120798) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:14:33.026435 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-94721502-e3e0-4df6-b4a1-15ffa36537f1 tempest-VolumesNegativeTest-2027890769 tempest-VolumesNegativeTest-2027890769-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:14:33.027340 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-94721502-e3e0-4df6-b4a1-15ffa36537f1 tempest-VolumesNegativeTest-2027890769 tempest-VolumesNegativeTest-2027890769-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:14:33.028538 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-94721502-e3e0-4df6-b4a1-15ffa36537f1 tempest-VolumesNegativeTest-2027890769 tempest-VolumesNegativeTest-2027890769-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:14:33.029375 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-94721502-e3e0-4df6-b4a1-15ffa36537f1 tempest-VolumesNegativeTest-2027890769 tempest-VolumesNegativeTest-2027890769-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:14:33.029884 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-94721502-e3e0-4df6-b4a1-15ffa36537f1 tempest-VolumesNegativeTest-2027890769 tempest-VolumesNegativeTest-2027890769-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:14:33.030478 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-94721502-e3e0-4df6-b4a1-15ffa36537f1 tempest-VolumesNegativeTest-2027890769 tempest-VolumesNegativeTest-2027890769-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:14:33.255606 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [req-a8686949-9369-4d68-b161-e3e2ddb08161 req-c9d0b4ec-3ec0-4465-aec7-af31a1f8e459 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "118d56f5-a1b4-402d-9e43-b432c2b63b14", "tag": "f9d34eea-2f38-4bee-b52d-66dae9718e50"}]} {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 07:14:33.270921 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [req-a8686949-9369-4d68-b161-e3e2ddb08161 req-c9d0b4ec-3ec0-4465-aec7-af31a1f8e459 service nova] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:14:33.271766 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [req-a8686949-9369-4d68-b161-e3e2ddb08161 req-c9d0b4ec-3ec0-4465-aec7-af31a1f8e459 service nova] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:14:33.272331 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [req-a8686949-9369-4d68-b161-e3e2ddb08161 req-c9d0b4ec-3ec0-4465-aec7-af31a1f8e459 service nova] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:14:33.301763 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.policy [None req-94721502-e3e0-4df6-b4a1-15ffa36537f1 tempest-VolumesNegativeTest-2027890769 tempest-VolumesNegativeTest-2027890769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ed299381d5b49fb8577287af4368fe1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d91979a6ce9468c990b9e08e267d329', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120798) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:14:33.304751 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.compute.server_external_events [req-a8686949-9369-4d68-b161-e3e2ddb08161 req-c9d0b4ec-3ec0-4465-aec7-af31a1f8e459 service nova] Creating event network-changed:f9d34eea-2f38-4bee-b52d-66dae9718e50 for instance 118d56f5-a1b4-402d-9e43-b432c2b63b14 on hv-cinder-85409 Aug 23 07:14:33.310723 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [req-a8686949-9369-4d68-b161-e3e2ddb08161 req-c9d0b4ec-3ec0-4465-aec7-af31a1f8e459 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060291 Aug 23 07:14:33.312102 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 141/274] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Aug 23 07:14:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 07:14:33.323512 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [None req-94721502-e3e0-4df6-b4a1-15ffa36537f1 tempest-VolumesNegativeTest-2027890769 tempest-VolumesNegativeTest-2027890769-project] 10.222.0.17 "GET /compute/v2.1/servers/52dfbaaf-557f-478e-bee8-e4856641b102" status: 200 len: 1314 microversion: 2.1 time: 0.309775 Aug 23 07:14:33.324461 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 134/275] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:14:33 2022] GET /compute/v2.1/servers/52dfbaaf-557f-478e-bee8-e4856641b102 => generated 1314 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:14:33.436357 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-afc0a8bd-a0e5-47f0-9d47-ff49973a4ffe tempest-VolumesActionsTest-775986377 tempest-VolumesActionsTest-775986377-project] Calling method '>' {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:14:33.437035 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.compute.api [None req-afc0a8bd-a0e5-47f0-9d47-ff49973a4ffe tempest-VolumesActionsTest-775986377 tempest-VolumesActionsTest-775986377-project] [instance: 118d56f5-a1b4-402d-9e43-b432c2b63b14] Fetching instance by UUID {{(pid=120799) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:14:33.443975 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-afc0a8bd-a0e5-47f0-9d47-ff49973a4ffe tempest-VolumesActionsTest-775986377 tempest-VolumesActionsTest-775986377-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:14:33.444453 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-afc0a8bd-a0e5-47f0-9d47-ff49973a4ffe tempest-VolumesActionsTest-775986377 tempest-VolumesActionsTest-775986377-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:14:33.444961 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-afc0a8bd-a0e5-47f0-9d47-ff49973a4ffe tempest-VolumesActionsTest-775986377 tempest-VolumesActionsTest-775986377-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:14:33.445994 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-afc0a8bd-a0e5-47f0-9d47-ff49973a4ffe tempest-VolumesActionsTest-775986377 tempest-VolumesActionsTest-775986377-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:14:33.446432 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-afc0a8bd-a0e5-47f0-9d47-ff49973a4ffe tempest-VolumesActionsTest-775986377 tempest-VolumesActionsTest-775986377-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:14:33.447061 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-afc0a8bd-a0e5-47f0-9d47-ff49973a4ffe tempest-VolumesActionsTest-775986377 tempest-VolumesActionsTest-775986377-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:14:33.464421 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-6ff4efab-6358-418b-a758-780b1fdd0dfe tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Calling method '>' {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:14:33.464904 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.compute.api [None req-6ff4efab-6358-418b-a758-780b1fdd0dfe tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] [instance: 6915ed26-7e2f-41b9-aada-adcb2c2015d3] Fetching instance by UUID {{(pid=120798) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:14:33.472311 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-6ff4efab-6358-418b-a758-780b1fdd0dfe tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:14:33.472801 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-6ff4efab-6358-418b-a758-780b1fdd0dfe tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:14:33.473226 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-6ff4efab-6358-418b-a758-780b1fdd0dfe tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:14:33.473919 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-6ff4efab-6358-418b-a758-780b1fdd0dfe tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:14:33.474368 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-6ff4efab-6358-418b-a758-780b1fdd0dfe tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:14:33.474787 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-6ff4efab-6358-418b-a758-780b1fdd0dfe tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:14:33.968311 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.policy [None req-afc0a8bd-a0e5-47f0-9d47-ff49973a4ffe tempest-VolumesActionsTest-775986377 tempest-VolumesActionsTest-775986377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f4d65ffaab942f29d449b64805c765a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2ef3b6384a4194a26ba51078c425af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120799) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:14:33.975344 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.policy [None req-6ff4efab-6358-418b-a758-780b1fdd0dfe tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64d54cb95b264c18b45d90822507fae1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135367be6e3f4b3d965ee0d99fdca524', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120798) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:14:33.976583 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-afc0a8bd-a0e5-47f0-9d47-ff49973a4ffe tempest-VolumesActionsTest-775986377 tempest-VolumesActionsTest-775986377-project] 10.222.0.17 "GET /compute/v2.1/servers/118d56f5-a1b4-402d-9e43-b432c2b63b14" status: 200 len: 1312 microversion: 2.1 time: 0.544650 Aug 23 07:14:33.981647 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 142/276] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:14:33 2022] GET /compute/v2.1/servers/118d56f5-a1b4-402d-9e43-b432c2b63b14 => generated 1312 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:14:33.982043 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [req-99dc3237-efb9-48c7-8344-976eb6178583 req-4a66555a-4669-4ae6-a3d2-19ea1f4eabad service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "52dfbaaf-557f-478e-bee8-e4856641b102", "tag": "7a88af17-4e94-444a-bfe6-7115e2a6bf50"}]} {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 07:14:33.984561 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [None req-6ff4efab-6358-418b-a758-780b1fdd0dfe tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] 10.222.0.17 "GET /compute/v2.1/servers/6915ed26-7e2f-41b9-aada-adcb2c2015d3" status: 200 len: 1522 microversion: 2.1 time: 0.524230 Aug 23 07:14:33.985599 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 135/277] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:14:33 2022] GET /compute/v2.1/servers/6915ed26-7e2f-41b9-aada-adcb2c2015d3 => generated 1522 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:14:33.998811 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [req-99dc3237-efb9-48c7-8344-976eb6178583 req-4a66555a-4669-4ae6-a3d2-19ea1f4eabad service nova] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:14:33.999351 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [req-99dc3237-efb9-48c7-8344-976eb6178583 req-4a66555a-4669-4ae6-a3d2-19ea1f4eabad service nova] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:14:33.999805 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [req-99dc3237-efb9-48c7-8344-976eb6178583 req-4a66555a-4669-4ae6-a3d2-19ea1f4eabad service nova] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:14:34.010735 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.compute.server_external_events [req-99dc3237-efb9-48c7-8344-976eb6178583 req-4a66555a-4669-4ae6-a3d2-19ea1f4eabad service nova] Creating event network-changed:7a88af17-4e94-444a-bfe6-7115e2a6bf50 for instance 52dfbaaf-557f-478e-bee8-e4856641b102 on hv-cinder-85409 Aug 23 07:14:34.016683 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [req-99dc3237-efb9-48c7-8344-976eb6178583 req-4a66555a-4669-4ae6-a3d2-19ea1f4eabad service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038228 Aug 23 07:14:34.017265 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 143/278] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Aug 23 07:14:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 07:14:34.038044 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-49747685-50d2-4f49-9775-cedd6c76daed tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Calling method '>' {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:14:34.039896 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.compute.api [None req-49747685-50d2-4f49-9775-cedd6c76daed tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] [instance: ce9a9c42-b9ed-40b1-b72c-390b85578204] Fetching instance by UUID {{(pid=120798) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:14:34.048573 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-49747685-50d2-4f49-9775-cedd6c76daed tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:14:34.049533 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-49747685-50d2-4f49-9775-cedd6c76daed tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:14:34.050116 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-49747685-50d2-4f49-9775-cedd6c76daed tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:14:34.050981 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-49747685-50d2-4f49-9775-cedd6c76daed tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:14:34.051612 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-49747685-50d2-4f49-9775-cedd6c76daed tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:14:34.052173 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-49747685-50d2-4f49-9775-cedd6c76daed tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:14:34.189555 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.policy [None req-49747685-50d2-4f49-9775-cedd6c76daed tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '471dc5c1db64411ab1d80ad6c038e519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb44f62fa62e46528712f24479cbb19f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120798) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:14:34.199259 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [None req-49747685-50d2-4f49-9775-cedd6c76daed tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] 10.222.0.17 "GET /compute/v2.1/servers/ce9a9c42-b9ed-40b1-b72c-390b85578204" status: 200 len: 1299 microversion: 2.1 time: 0.166625 Aug 23 07:14:34.200141 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 136/279] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:14:34 2022] GET /compute/v2.1/servers/ce9a9c42-b9ed-40b1-b72c-390b85578204 => generated 1299 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:14:34.348424 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-dfff6db8-c076-4892-9cb8-a6efbaab5777 tempest-VolumesNegativeTest-2027890769 tempest-VolumesNegativeTest-2027890769-project] Calling method '>' {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:14:34.349143 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.compute.api [None req-dfff6db8-c076-4892-9cb8-a6efbaab5777 tempest-VolumesNegativeTest-2027890769 tempest-VolumesNegativeTest-2027890769-project] [instance: 52dfbaaf-557f-478e-bee8-e4856641b102] Fetching instance by UUID {{(pid=120799) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:14:34.355718 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-dfff6db8-c076-4892-9cb8-a6efbaab5777 tempest-VolumesNegativeTest-2027890769 tempest-VolumesNegativeTest-2027890769-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:14:34.356271 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-dfff6db8-c076-4892-9cb8-a6efbaab5777 tempest-VolumesNegativeTest-2027890769 tempest-VolumesNegativeTest-2027890769-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:14:34.356721 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-dfff6db8-c076-4892-9cb8-a6efbaab5777 tempest-VolumesNegativeTest-2027890769 tempest-VolumesNegativeTest-2027890769-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:14:34.357407 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-dfff6db8-c076-4892-9cb8-a6efbaab5777 tempest-VolumesNegativeTest-2027890769 tempest-VolumesNegativeTest-2027890769-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:14:34.357856 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-dfff6db8-c076-4892-9cb8-a6efbaab5777 tempest-VolumesNegativeTest-2027890769 tempest-VolumesNegativeTest-2027890769-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:14:34.358273 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-dfff6db8-c076-4892-9cb8-a6efbaab5777 tempest-VolumesNegativeTest-2027890769 tempest-VolumesNegativeTest-2027890769-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:14:34.625061 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.policy [None req-dfff6db8-c076-4892-9cb8-a6efbaab5777 tempest-VolumesNegativeTest-2027890769 tempest-VolumesNegativeTest-2027890769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ed299381d5b49fb8577287af4368fe1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d91979a6ce9468c990b9e08e267d329', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120799) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:14:34.633065 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-dfff6db8-c076-4892-9cb8-a6efbaab5777 tempest-VolumesNegativeTest-2027890769 tempest-VolumesNegativeTest-2027890769-project] 10.222.0.17 "GET /compute/v2.1/servers/52dfbaaf-557f-478e-bee8-e4856641b102" status: 200 len: 1314 microversion: 2.1 time: 0.291279 Aug 23 07:14:34.633902 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 144/280] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:14:34 2022] GET /compute/v2.1/servers/52dfbaaf-557f-478e-bee8-e4856641b102 => generated 1314 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:14:35.005987 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-95245d38-67cb-4f31-8b0b-5d19b6033171 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Calling method '>' {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:14:35.008295 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-176a6e37-d556-431c-9aea-fb165050ef68 tempest-VolumesActionsTest-775986377 tempest-VolumesActionsTest-775986377-project] Calling method '>' {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:14:35.009128 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.compute.api [None req-95245d38-67cb-4f31-8b0b-5d19b6033171 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] [instance: 6915ed26-7e2f-41b9-aada-adcb2c2015d3] Fetching instance by UUID {{(pid=120799) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:14:35.009873 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.compute.api [None req-176a6e37-d556-431c-9aea-fb165050ef68 tempest-VolumesActionsTest-775986377 tempest-VolumesActionsTest-775986377-project] [instance: 118d56f5-a1b4-402d-9e43-b432c2b63b14] Fetching instance by UUID {{(pid=120798) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:14:35.022763 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-95245d38-67cb-4f31-8b0b-5d19b6033171 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:14:35.023915 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-95245d38-67cb-4f31-8b0b-5d19b6033171 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:14:35.025365 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-176a6e37-d556-431c-9aea-fb165050ef68 tempest-VolumesActionsTest-775986377 tempest-VolumesActionsTest-775986377-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:14:35.025876 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-176a6e37-d556-431c-9aea-fb165050ef68 tempest-VolumesActionsTest-775986377 tempest-VolumesActionsTest-775986377-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:14:35.026279 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-176a6e37-d556-431c-9aea-fb165050ef68 tempest-VolumesActionsTest-775986377 tempest-VolumesActionsTest-775986377-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:14:35.026963 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-176a6e37-d556-431c-9aea-fb165050ef68 tempest-VolumesActionsTest-775986377 tempest-VolumesActionsTest-775986377-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:14:35.027913 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-95245d38-67cb-4f31-8b0b-5d19b6033171 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:14:35.028857 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-95245d38-67cb-4f31-8b0b-5d19b6033171 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:14:35.029381 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-95245d38-67cb-4f31-8b0b-5d19b6033171 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:14:35.029930 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-176a6e37-d556-431c-9aea-fb165050ef68 tempest-VolumesActionsTest-775986377 tempest-VolumesActionsTest-775986377-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:14:35.030527 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-95245d38-67cb-4f31-8b0b-5d19b6033171 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:14:35.031827 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-176a6e37-d556-431c-9aea-fb165050ef68 tempest-VolumesActionsTest-775986377 tempest-VolumesActionsTest-775986377-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:14:35.247260 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.policy [None req-95245d38-67cb-4f31-8b0b-5d19b6033171 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64d54cb95b264c18b45d90822507fae1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135367be6e3f4b3d965ee0d99fdca524', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120799) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:14:35.251541 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.policy [None req-176a6e37-d556-431c-9aea-fb165050ef68 tempest-VolumesActionsTest-775986377 tempest-VolumesActionsTest-775986377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f4d65ffaab942f29d449b64805c765a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2ef3b6384a4194a26ba51078c425af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120798) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:14:35.255875 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-95245d38-67cb-4f31-8b0b-5d19b6033171 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] 10.222.0.17 "GET /compute/v2.1/servers/6915ed26-7e2f-41b9-aada-adcb2c2015d3" status: 200 len: 1522 microversion: 2.1 time: 0.253828 Aug 23 07:14:35.256781 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 145/281] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:14:35 2022] GET /compute/v2.1/servers/6915ed26-7e2f-41b9-aada-adcb2c2015d3 => generated 1522 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 07:14:35.261571 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-31b063fa-858c-4190-9a6e-095568ce8483 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Calling method '>' {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:14:35.262201 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [None req-176a6e37-d556-431c-9aea-fb165050ef68 tempest-VolumesActionsTest-775986377 tempest-VolumesActionsTest-775986377-project] 10.222.0.17 "GET /compute/v2.1/servers/118d56f5-a1b4-402d-9e43-b432c2b63b14" status: 200 len: 1312 microversion: 2.1 time: 0.264011 Aug 23 07:14:35.262715 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.compute.api [None req-31b063fa-858c-4190-9a6e-095568ce8483 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] [instance: ce9a9c42-b9ed-40b1-b72c-390b85578204] Fetching instance by UUID {{(pid=120799) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:14:35.272389 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-31b063fa-858c-4190-9a6e-095568ce8483 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:14:35.272920 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-31b063fa-858c-4190-9a6e-095568ce8483 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:14:35.273348 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-31b063fa-858c-4190-9a6e-095568ce8483 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:14:35.274035 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-31b063fa-858c-4190-9a6e-095568ce8483 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:14:35.274568 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-31b063fa-858c-4190-9a6e-095568ce8483 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:14:35.274985 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-31b063fa-858c-4190-9a6e-095568ce8483 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:14:35.275372 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 137/282] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:14:34 2022] GET /compute/v2.1/servers/118d56f5-a1b4-402d-9e43-b432c2b63b14 => generated 1312 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:14:35.410448 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.policy [None req-31b063fa-858c-4190-9a6e-095568ce8483 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '471dc5c1db64411ab1d80ad6c038e519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb44f62fa62e46528712f24479cbb19f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120799) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:14:35.421976 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-31b063fa-858c-4190-9a6e-095568ce8483 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] 10.222.0.17 "GET /compute/v2.1/servers/ce9a9c42-b9ed-40b1-b72c-390b85578204" status: 200 len: 1366 microversion: 2.1 time: 0.163972 Aug 23 07:14:35.422564 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 146/283] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:14:35 2022] GET /compute/v2.1/servers/ce9a9c42-b9ed-40b1-b72c-390b85578204 => generated 1366 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:14:35.654058 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-f59d4780-8703-43e6-b571-67c263ca1c8f tempest-VolumesNegativeTest-2027890769 tempest-VolumesNegativeTest-2027890769-project] Calling method '>' {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:14:35.654984 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.compute.api [None req-f59d4780-8703-43e6-b571-67c263ca1c8f tempest-VolumesNegativeTest-2027890769 tempest-VolumesNegativeTest-2027890769-project] [instance: 52dfbaaf-557f-478e-bee8-e4856641b102] Fetching instance by UUID {{(pid=120798) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:14:35.662952 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-f59d4780-8703-43e6-b571-67c263ca1c8f tempest-VolumesNegativeTest-2027890769 tempest-VolumesNegativeTest-2027890769-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:14:35.663445 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-f59d4780-8703-43e6-b571-67c263ca1c8f tempest-VolumesNegativeTest-2027890769 tempest-VolumesNegativeTest-2027890769-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:14:35.664131 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-f59d4780-8703-43e6-b571-67c263ca1c8f tempest-VolumesNegativeTest-2027890769 tempest-VolumesNegativeTest-2027890769-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:14:35.664899 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-f59d4780-8703-43e6-b571-67c263ca1c8f tempest-VolumesNegativeTest-2027890769 tempest-VolumesNegativeTest-2027890769-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:14:35.665289 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-f59d4780-8703-43e6-b571-67c263ca1c8f tempest-VolumesNegativeTest-2027890769 tempest-VolumesNegativeTest-2027890769-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:14:35.665706 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-f59d4780-8703-43e6-b571-67c263ca1c8f tempest-VolumesNegativeTest-2027890769 tempest-VolumesNegativeTest-2027890769-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:14:35.897354 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.policy [None req-f59d4780-8703-43e6-b571-67c263ca1c8f tempest-VolumesNegativeTest-2027890769 tempest-VolumesNegativeTest-2027890769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ed299381d5b49fb8577287af4368fe1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d91979a6ce9468c990b9e08e267d329', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120798) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:14:35.930904 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [None req-f59d4780-8703-43e6-b571-67c263ca1c8f tempest-VolumesNegativeTest-2027890769 tempest-VolumesNegativeTest-2027890769-project] 10.222.0.17 "GET /compute/v2.1/servers/52dfbaaf-557f-478e-bee8-e4856641b102" status: 200 len: 1314 microversion: 2.1 time: 0.278678 Aug 23 07:14:35.932376 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 138/284] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:14:35 2022] GET /compute/v2.1/servers/52dfbaaf-557f-478e-bee8-e4856641b102 => generated 1314 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:14:36.277644 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-d10f4c77-439b-4e25-a84a-281c3740d8be tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Calling method '>' {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:14:36.278403 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.compute.api [None req-d10f4c77-439b-4e25-a84a-281c3740d8be tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] [instance: 6915ed26-7e2f-41b9-aada-adcb2c2015d3] Fetching instance by UUID {{(pid=120799) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:14:36.286264 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-d10f4c77-439b-4e25-a84a-281c3740d8be tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:14:36.287029 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-d10f4c77-439b-4e25-a84a-281c3740d8be tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:14:36.287735 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-80d1b519-cc0c-4d68-b935-b104e6218245 tempest-VolumesActionsTest-775986377 tempest-VolumesActionsTest-775986377-project] Calling method '>' {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:14:36.288419 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-d10f4c77-439b-4e25-a84a-281c3740d8be tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:14:36.289141 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.compute.api [None req-80d1b519-cc0c-4d68-b935-b104e6218245 tempest-VolumesActionsTest-775986377 tempest-VolumesActionsTest-775986377-project] [instance: 118d56f5-a1b4-402d-9e43-b432c2b63b14] Fetching instance by UUID {{(pid=120798) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:14:36.289422 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-d10f4c77-439b-4e25-a84a-281c3740d8be tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:14:36.290010 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-d10f4c77-439b-4e25-a84a-281c3740d8be tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:14:36.290821 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-d10f4c77-439b-4e25-a84a-281c3740d8be tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:14:36.301945 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-80d1b519-cc0c-4d68-b935-b104e6218245 tempest-VolumesActionsTest-775986377 tempest-VolumesActionsTest-775986377-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:14:36.302589 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-80d1b519-cc0c-4d68-b935-b104e6218245 tempest-VolumesActionsTest-775986377 tempest-VolumesActionsTest-775986377-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:14:36.303114 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-80d1b519-cc0c-4d68-b935-b104e6218245 tempest-VolumesActionsTest-775986377 tempest-VolumesActionsTest-775986377-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:14:36.303935 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-80d1b519-cc0c-4d68-b935-b104e6218245 tempest-VolumesActionsTest-775986377 tempest-VolumesActionsTest-775986377-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:14:36.304656 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-80d1b519-cc0c-4d68-b935-b104e6218245 tempest-VolumesActionsTest-775986377 tempest-VolumesActionsTest-775986377-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:14:36.305298 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-80d1b519-cc0c-4d68-b935-b104e6218245 tempest-VolumesActionsTest-775986377 tempest-VolumesActionsTest-775986377-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:14:36.867931 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.policy [None req-80d1b519-cc0c-4d68-b935-b104e6218245 tempest-VolumesActionsTest-775986377 tempest-VolumesActionsTest-775986377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f4d65ffaab942f29d449b64805c765a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2ef3b6384a4194a26ba51078c425af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120798) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:14:36.872753 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.policy [None req-d10f4c77-439b-4e25-a84a-281c3740d8be tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64d54cb95b264c18b45d90822507fae1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135367be6e3f4b3d965ee0d99fdca524', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120799) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:14:36.879003 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [None req-80d1b519-cc0c-4d68-b935-b104e6218245 tempest-VolumesActionsTest-775986377 tempest-VolumesActionsTest-775986377-project] 10.222.0.17 "GET /compute/v2.1/servers/118d56f5-a1b4-402d-9e43-b432c2b63b14" status: 200 len: 1312 microversion: 2.1 time: 0.598100 Aug 23 07:14:36.879815 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 139/285] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:14:36 2022] GET /compute/v2.1/servers/118d56f5-a1b4-402d-9e43-b432c2b63b14 => generated 1312 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:14:36.881249 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-d10f4c77-439b-4e25-a84a-281c3740d8be tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] 10.222.0.17 "GET /compute/v2.1/servers/6915ed26-7e2f-41b9-aada-adcb2c2015d3" status: 200 len: 1502 microversion: 2.1 time: 0.607835 Aug 23 07:14:36.885234 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-3417a62a-9dfc-48f9-8154-e67b6ce38751 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Calling method '>' {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:14:36.886025 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.compute.api [None req-3417a62a-9dfc-48f9-8154-e67b6ce38751 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] [instance: ce9a9c42-b9ed-40b1-b72c-390b85578204] Fetching instance by UUID {{(pid=120798) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:14:36.894450 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-3417a62a-9dfc-48f9-8154-e67b6ce38751 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:14:36.894927 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-3417a62a-9dfc-48f9-8154-e67b6ce38751 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:14:36.895668 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-3417a62a-9dfc-48f9-8154-e67b6ce38751 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:14:36.896040 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 147/286] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:14:36 2022] GET /compute/v2.1/servers/6915ed26-7e2f-41b9-aada-adcb2c2015d3 => generated 1502 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:14:36.896361 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-3417a62a-9dfc-48f9-8154-e67b6ce38751 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:14:36.896806 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-3417a62a-9dfc-48f9-8154-e67b6ce38751 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:14:36.897226 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-3417a62a-9dfc-48f9-8154-e67b6ce38751 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:14:36.902150 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [req-35de2b81-1162-4ede-b834-f69de7944c40 req-ba57b714-c100-4463-b840-ccc37a410eaa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ce9a9c42-b9ed-40b1-b72c-390b85578204", "tag": "934b5d8d-aefe-4c06-83af-f3bb1ed3c80c"}]} {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 07:14:36.912055 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [req-35de2b81-1162-4ede-b834-f69de7944c40 req-ba57b714-c100-4463-b840-ccc37a410eaa service nova] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:14:36.912757 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [req-35de2b81-1162-4ede-b834-f69de7944c40 req-ba57b714-c100-4463-b840-ccc37a410eaa service nova] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:14:36.913440 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [req-35de2b81-1162-4ede-b834-f69de7944c40 req-ba57b714-c100-4463-b840-ccc37a410eaa service nova] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:14:36.926836 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.compute.server_external_events [req-35de2b81-1162-4ede-b834-f69de7944c40 req-ba57b714-c100-4463-b840-ccc37a410eaa service nova] Creating event network-changed:934b5d8d-aefe-4c06-83af-f3bb1ed3c80c for instance ce9a9c42-b9ed-40b1-b72c-390b85578204 on hv-cinder-85409 Aug 23 07:14:36.932389 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [req-35de2b81-1162-4ede-b834-f69de7944c40 req-ba57b714-c100-4463-b840-ccc37a410eaa service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034916 Aug 23 07:14:36.932975 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 148/287] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Aug 23 07:14:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 07:14:36.938532 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-6dd029c7-9ddc-49bb-be14-3d496e21f637 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5310d272-a202-4023-9061-e2908851a35f"}} {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 07:14:36.941256 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.compute.api [None req-6dd029c7-9ddc-49bb-be14-3d496e21f637 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] [instance: 6915ed26-7e2f-41b9-aada-adcb2c2015d3] Fetching instance by UUID {{(pid=120799) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:14:36.948792 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-6dd029c7-9ddc-49bb-be14-3d496e21f637 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:14:36.949312 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-6dd029c7-9ddc-49bb-be14-3d496e21f637 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:14:36.949745 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-6dd029c7-9ddc-49bb-be14-3d496e21f637 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:14:36.950435 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-6dd029c7-9ddc-49bb-be14-3d496e21f637 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:14:36.950877 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-6dd029c7-9ddc-49bb-be14-3d496e21f637 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:14:36.951294 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-6dd029c7-9ddc-49bb-be14-3d496e21f637 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:14:36.976987 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.wsgi [None req-6dd029c7-9ddc-49bb-be14-3d496e21f637 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] HTTP exception thrown: Cannot 'attach_volume' instance 6915ed26-7e2f-41b9-aada-adcb2c2015d3 while it is in vm_state rescued Aug 23 07:14:36.978685 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-6dd029c7-9ddc-49bb-be14-3d496e21f637 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Request method failure captured: Aug 23 07:14:36.978685 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: request: POST /compute/v2.1/servers/6915ed26-7e2f-41b9-aada-adcb2c2015d3/os-volume_attachments HTTP/1.1 Aug 23 07:14:36.978685 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: Accept: application/json Aug 23 07:14:36.978685 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: Accept-Encoding: identity Aug 23 07:14:36.978685 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: Connection: close Aug 23 07:14:36.978685 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: Content-Length: 74 Aug 23 07:14:36.978685 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: Content-Type: application/json Aug 23 07:14:36.978685 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: Host: 10.222.0.17 Aug 23 07:14:36.978685 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: Openstack-System-Scope: None Aug 23 07:14:36.978685 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: User-Agent: python-urllib3/1.26.11 Aug 23 07:14:36.978685 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-Auth-Token: gAAAAABjBH3RTnj580A9ihENlvyGo9Owk2endPDkKW0IbgiaI59nvL65tV9bcHDATbv_TF-j5yNJo86nqcfzcR4EFG9DSwxV6zk_8rKGHN_TbC5GCjcEeyjsLvDIF_O9EwwjUk3-u0A9pdTbyVuUJI9H9X2YTFvkkjoRacmsfuB_sypDT5kcQO8 Aug 23 07:14:36.978685 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-Domain-Id: None Aug 23 07:14:36.978685 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-Domain-Name: None Aug 23 07:14:36.978685 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-Identity-Status: Confirmed Aug 23 07:14:36.978685 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-Is-Admin-Project: True Aug 23 07:14:36.978685 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-Project-Domain-Id: default Aug 23 07:14:36.978685 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-Project-Domain-Name: Default Aug 23 07:14:36.978685 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-Project-Id: 135367be6e3f4b3d965ee0d99fdca524 Aug 23 07:14:36.978685 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-260324431 Aug 23 07:14:36.978685 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-Role: reader,member Aug 23 07:14:36.978685 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-Roles: reader,member Aug 23 07:14:36.980262 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/135367be6e3f4b3d965ee0d99fdca524"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/135367be6e3f4b3d965ee0d99fdca524"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_135367be6e3f4b3d965ee0d99fdca524"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/135367be6e3f4b3d965ee0d99fdca524"}]}] Aug 23 07:14:36.980262 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-Tenant: tempest-ServerRescueNegativeTestJSON-260324431 Aug 23 07:14:36.980262 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-Tenant-Id: 135367be6e3f4b3d965ee0d99fdca524 Aug 23 07:14:36.980262 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-260324431 Aug 23 07:14:36.980262 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-User: tempest-ServerRescueNegativeTestJSON-260324431-project Aug 23 07:14:36.980262 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-User-Domain-Id: default Aug 23 07:14:36.980262 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-User-Domain-Name: Default Aug 23 07:14:36.980262 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-User-Id: 64d54cb95b264c18b45d90822507fae1 Aug 23 07:14:36.980262 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-User-Name: tempest-ServerRescueNegativeTestJSON-260324431-project Aug 23 07:14:36.980262 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: Aug 23 07:14:36.980262 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: {"volumeAttachment": {"volumeId": "5310d272-a202-4023-9061-e2908851a35f"}} Aug 23 07:14:36.980262 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: method: > Aug 23 07:14:36.981273 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: exception: Cannot 'attach_volume' instance 6915ed26-7e2f-41b9-aada-adcb2c2015d3 while it is in vm_state rescued Aug 23 07:14:36.981273 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: action_args: {'server_id': '6915ed26-7e2f-41b9-aada-adcb2c2015d3', 'body': {'volumeAttachment': {'volumeId': '5310d272-a202-4023-9061-e2908851a35f'}}} Aug 23 07:14:36.981273 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 07:14:36.981273 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 07:14:36.981273 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 23 07:14:36.981273 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 23 07:14:36.981273 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 23 07:14:36.981273 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 23 07:14:36.981273 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 23 07:14:36.981273 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 23 07:14:36.981273 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 6915ed26-7e2f-41b9-aada-adcb2c2015d3 in vm_state rescued. Cannot attach_volume while the instance is in this state. Aug 23 07:14:36.981273 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi Aug 23 07:14:36.981273 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 07:14:36.981273 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi Aug 23 07:14:36.981273 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 07:14:36.981273 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 07:14:36.981273 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 07:14:36.981273 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 07:14:36.981273 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 07:14:36.982552 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 07:14:36.982552 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 07:14:36.982552 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 23 07:14:36.982552 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 23 07:14:36.982552 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 23 07:14:36.982552 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 23 07:14:36.982552 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 23 07:14:36.982552 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 23 07:14:36.982552 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Aug 23 07:14:36.982552 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 23 07:14:36.982552 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 23 07:14:36.982552 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 23 07:14:36.982552 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 6915ed26-7e2f-41b9-aada-adcb2c2015d3 while it is in vm_state rescued Aug 23 07:14:36.982552 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi Aug 23 07:14:36.982552 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 07:14:36.982552 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi Aug 23 07:14:36.982552 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 07:14:36.982552 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 07:14:36.982552 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 07:14:36.983871 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 07:14:36.983871 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 07:14:36.983871 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 6915ed26-7e2f-41b9-aada-adcb2c2015d3 while it is in vm_state rescued Aug 23 07:14:36.983871 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi Aug 23 07:14:36.983871 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-6dd029c7-9ddc-49bb-be14-3d496e21f637 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Returning 409 to user: Cannot 'attach_volume' instance 6915ed26-7e2f-41b9-aada-adcb2c2015d3 while it is in vm_state rescued {{(pid=120799) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 07:14:36.983871 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-6dd029c7-9ddc-49bb-be14-3d496e21f637 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] 10.222.0.17 "POST /compute/v2.1/servers/6915ed26-7e2f-41b9-aada-adcb2c2015d3/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.045792 Aug 23 07:14:36.983871 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 149/288] 10.222.0.17 () {60 vars in 1323 bytes} [Tue Aug 23 07:14:36 2022] POST /compute/v2.1/servers/6915ed26-7e2f-41b9-aada-adcb2c2015d3/os-volume_attachments => generated 152 bytes in 47 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 23 07:14:36.985903 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-c1afc3d4-03b5-4aad-a050-8ac83eb9c3f8 tempest-VolumesNegativeTest-2027890769 tempest-VolumesNegativeTest-2027890769-project] Calling method '>' {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:14:36.986505 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.compute.api [None req-c1afc3d4-03b5-4aad-a050-8ac83eb9c3f8 tempest-VolumesNegativeTest-2027890769 tempest-VolumesNegativeTest-2027890769-project] [instance: 52dfbaaf-557f-478e-bee8-e4856641b102] Fetching instance by UUID {{(pid=120799) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:14:36.993230 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-c1afc3d4-03b5-4aad-a050-8ac83eb9c3f8 tempest-VolumesNegativeTest-2027890769 tempest-VolumesNegativeTest-2027890769-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:14:36.994105 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-c1afc3d4-03b5-4aad-a050-8ac83eb9c3f8 tempest-VolumesNegativeTest-2027890769 tempest-VolumesNegativeTest-2027890769-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:14:36.994730 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-c1afc3d4-03b5-4aad-a050-8ac83eb9c3f8 tempest-VolumesNegativeTest-2027890769 tempest-VolumesNegativeTest-2027890769-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:14:36.995643 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-c1afc3d4-03b5-4aad-a050-8ac83eb9c3f8 tempest-VolumesNegativeTest-2027890769 tempest-VolumesNegativeTest-2027890769-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:14:36.996405 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-c1afc3d4-03b5-4aad-a050-8ac83eb9c3f8 tempest-VolumesNegativeTest-2027890769 tempest-VolumesNegativeTest-2027890769-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:14:36.997447 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-c1afc3d4-03b5-4aad-a050-8ac83eb9c3f8 tempest-VolumesNegativeTest-2027890769 tempest-VolumesNegativeTest-2027890769-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:14:37.091747 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.policy [None req-3417a62a-9dfc-48f9-8154-e67b6ce38751 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '471dc5c1db64411ab1d80ad6c038e519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb44f62fa62e46528712f24479cbb19f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120798) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:14:37.103044 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [None req-3417a62a-9dfc-48f9-8154-e67b6ce38751 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] 10.222.0.17 "GET /compute/v2.1/servers/ce9a9c42-b9ed-40b1-b72c-390b85578204" status: 200 len: 1366 microversion: 2.1 time: 0.221948 Aug 23 07:14:37.104088 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 140/289] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:14:36 2022] GET /compute/v2.1/servers/ce9a9c42-b9ed-40b1-b72c-390b85578204 => generated 1366 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:14:37.109225 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-ed683729-2955-4142-99dc-d859ceabaebc tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 07:14:37.110096 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.compute.api [None req-ed683729-2955-4142-99dc-d859ceabaebc tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] [instance: 6915ed26-7e2f-41b9-aada-adcb2c2015d3] Fetching instance by UUID {{(pid=120798) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:14:37.123310 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-ed683729-2955-4142-99dc-d859ceabaebc tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:14:37.123836 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-ed683729-2955-4142-99dc-d859ceabaebc tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:14:37.124264 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-ed683729-2955-4142-99dc-d859ceabaebc tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:14:37.124951 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-ed683729-2955-4142-99dc-d859ceabaebc tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:14:37.125500 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-ed683729-2955-4142-99dc-d859ceabaebc tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:14:37.125920 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-ed683729-2955-4142-99dc-d859ceabaebc tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:14:37.168699 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.policy [None req-c1afc3d4-03b5-4aad-a050-8ac83eb9c3f8 tempest-VolumesNegativeTest-2027890769 tempest-VolumesNegativeTest-2027890769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ed299381d5b49fb8577287af4368fe1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d91979a6ce9468c990b9e08e267d329', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120799) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:14:37.176708 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-c1afc3d4-03b5-4aad-a050-8ac83eb9c3f8 tempest-VolumesNegativeTest-2027890769 tempest-VolumesNegativeTest-2027890769-project] 10.222.0.17 "GET /compute/v2.1/servers/52dfbaaf-557f-478e-bee8-e4856641b102" status: 200 len: 1314 microversion: 2.1 time: 0.194454 Aug 23 07:14:37.177261 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 150/290] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:14:36 2022] GET /compute/v2.1/servers/52dfbaaf-557f-478e-bee8-e4856641b102 => generated 1314 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:14:37.204373 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [None req-ed683729-2955-4142-99dc-d859ceabaebc tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] 10.222.0.17 "POST /compute/v2.1/servers/6915ed26-7e2f-41b9-aada-adcb2c2015d3/action" status: 202 len: 0 microversion: 2.1 time: 0.098869 Aug 23 07:14:37.205245 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 141/291] 10.222.0.17 () {60 vars in 1278 bytes} [Tue Aug 23 07:14:37 2022] POST /compute/v2.1/servers/6915ed26-7e2f-41b9-aada-adcb2c2015d3/action => generated 0 bytes in 100 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 07:14:37.217043 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-c00a81d3-e76b-4952-8af1-180c3995d12f tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Calling method '>' {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:14:37.217654 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.compute.api [None req-c00a81d3-e76b-4952-8af1-180c3995d12f tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] [instance: 6915ed26-7e2f-41b9-aada-adcb2c2015d3] Fetching instance by UUID {{(pid=120799) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:14:37.223791 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-c00a81d3-e76b-4952-8af1-180c3995d12f tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:14:37.224268 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-c00a81d3-e76b-4952-8af1-180c3995d12f tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:14:37.224697 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-c00a81d3-e76b-4952-8af1-180c3995d12f tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:14:37.225380 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-c00a81d3-e76b-4952-8af1-180c3995d12f tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:14:37.225838 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-c00a81d3-e76b-4952-8af1-180c3995d12f tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:14:37.226251 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-c00a81d3-e76b-4952-8af1-180c3995d12f tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:14:37.365198 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.policy [None req-c00a81d3-e76b-4952-8af1-180c3995d12f tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64d54cb95b264c18b45d90822507fae1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135367be6e3f4b3d965ee0d99fdca524', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120799) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:14:37.374168 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-c00a81d3-e76b-4952-8af1-180c3995d12f tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] 10.222.0.17 "GET /compute/v2.1/servers/6915ed26-7e2f-41b9-aada-adcb2c2015d3" status: 200 len: 1510 microversion: 2.1 time: 0.164447 Aug 23 07:14:37.374740 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 151/292] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:14:37 2022] GET /compute/v2.1/servers/6915ed26-7e2f-41b9-aada-adcb2c2015d3 => generated 1510 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:14:37.901739 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-69264e85-52dd-4309-b916-d7ffeeb7f8df tempest-VolumesActionsTest-775986377 tempest-VolumesActionsTest-775986377-project] Calling method '>' {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:14:37.903369 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.compute.api [None req-69264e85-52dd-4309-b916-d7ffeeb7f8df tempest-VolumesActionsTest-775986377 tempest-VolumesActionsTest-775986377-project] [instance: 118d56f5-a1b4-402d-9e43-b432c2b63b14] Fetching instance by UUID {{(pid=120798) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:14:37.909748 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-69264e85-52dd-4309-b916-d7ffeeb7f8df tempest-VolumesActionsTest-775986377 tempest-VolumesActionsTest-775986377-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:14:37.910443 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-69264e85-52dd-4309-b916-d7ffeeb7f8df tempest-VolumesActionsTest-775986377 tempest-VolumesActionsTest-775986377-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:14:37.911032 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-69264e85-52dd-4309-b916-d7ffeeb7f8df tempest-VolumesActionsTest-775986377 tempest-VolumesActionsTest-775986377-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:14:37.911763 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-69264e85-52dd-4309-b916-d7ffeeb7f8df tempest-VolumesActionsTest-775986377 tempest-VolumesActionsTest-775986377-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:14:37.912353 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-69264e85-52dd-4309-b916-d7ffeeb7f8df tempest-VolumesActionsTest-775986377 tempest-VolumesActionsTest-775986377-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:14:37.912922 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-69264e85-52dd-4309-b916-d7ffeeb7f8df tempest-VolumesActionsTest-775986377 tempest-VolumesActionsTest-775986377-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:14:38.121568 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG dbcounter [-] [120799] Writing DB stats nova_cell0:SELECT=2 {{(pid=120799) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:14:38.127638 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-e62115d8-8ac7-48dd-abce-5a7c113e085b tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Calling method '>' {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:14:38.128736 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.compute.api [None req-e62115d8-8ac7-48dd-abce-5a7c113e085b tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] [instance: ce9a9c42-b9ed-40b1-b72c-390b85578204] Fetching instance by UUID {{(pid=120799) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:14:38.141945 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-e62115d8-8ac7-48dd-abce-5a7c113e085b tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:14:38.147207 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-e62115d8-8ac7-48dd-abce-5a7c113e085b tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:14:38.147998 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-e62115d8-8ac7-48dd-abce-5a7c113e085b tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:14:38.150488 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-e62115d8-8ac7-48dd-abce-5a7c113e085b tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:14:38.154010 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-e62115d8-8ac7-48dd-abce-5a7c113e085b tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:14:38.154750 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-e62115d8-8ac7-48dd-abce-5a7c113e085b tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:14:38.167872 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.policy [None req-69264e85-52dd-4309-b916-d7ffeeb7f8df tempest-VolumesActionsTest-775986377 tempest-VolumesActionsTest-775986377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f4d65ffaab942f29d449b64805c765a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2ef3b6384a4194a26ba51078c425af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120798) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:14:38.185911 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [None req-69264e85-52dd-4309-b916-d7ffeeb7f8df tempest-VolumesActionsTest-775986377 tempest-VolumesActionsTest-775986377-project] 10.222.0.17 "GET /compute/v2.1/servers/118d56f5-a1b4-402d-9e43-b432c2b63b14" status: 200 len: 1312 microversion: 2.1 time: 0.288740 Aug 23 07:14:38.197039 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG dbcounter [-] [120799] Writing DB stats nova_cell1:SELECT=100 {{(pid=120799) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:14:38.198917 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 142/293] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:14:37 2022] GET /compute/v2.1/servers/118d56f5-a1b4-402d-9e43-b432c2b63b14 => generated 1312 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:14:38.215134 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-bd2116e9-7f83-402b-9e54-19623cda6aca tempest-VolumesNegativeTest-2027890769 tempest-VolumesNegativeTest-2027890769-project] Calling method '>' {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:14:38.215740 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.compute.api [None req-bd2116e9-7f83-402b-9e54-19623cda6aca tempest-VolumesNegativeTest-2027890769 tempest-VolumesNegativeTest-2027890769-project] [instance: 52dfbaaf-557f-478e-bee8-e4856641b102] Fetching instance by UUID {{(pid=120798) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:14:38.237282 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-bd2116e9-7f83-402b-9e54-19623cda6aca tempest-VolumesNegativeTest-2027890769 tempest-VolumesNegativeTest-2027890769-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:14:38.237774 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-bd2116e9-7f83-402b-9e54-19623cda6aca tempest-VolumesNegativeTest-2027890769 tempest-VolumesNegativeTest-2027890769-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:14:38.238201 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-bd2116e9-7f83-402b-9e54-19623cda6aca tempest-VolumesNegativeTest-2027890769 tempest-VolumesNegativeTest-2027890769-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:14:38.238902 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-bd2116e9-7f83-402b-9e54-19623cda6aca tempest-VolumesNegativeTest-2027890769 tempest-VolumesNegativeTest-2027890769-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:14:38.239344 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-bd2116e9-7f83-402b-9e54-19623cda6aca tempest-VolumesNegativeTest-2027890769 tempest-VolumesNegativeTest-2027890769-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:14:38.239779 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-bd2116e9-7f83-402b-9e54-19623cda6aca tempest-VolumesNegativeTest-2027890769 tempest-VolumesNegativeTest-2027890769-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:14:38.458416 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.policy [None req-e62115d8-8ac7-48dd-abce-5a7c113e085b tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '471dc5c1db64411ab1d80ad6c038e519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb44f62fa62e46528712f24479cbb19f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120799) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:14:38.467451 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-e62115d8-8ac7-48dd-abce-5a7c113e085b tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] 10.222.0.17 "GET /compute/v2.1/servers/ce9a9c42-b9ed-40b1-b72c-390b85578204" status: 200 len: 1366 microversion: 2.1 time: 0.346961 Aug 23 07:14:38.472660 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 152/294] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:14:38 2022] GET /compute/v2.1/servers/ce9a9c42-b9ed-40b1-b72c-390b85578204 => generated 1366 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:14:38.477541 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-41b44941-73dc-4b9d-a30f-6307beea69f5 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Calling method '>' {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:14:38.478918 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.compute.api [None req-41b44941-73dc-4b9d-a30f-6307beea69f5 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] [instance: 6915ed26-7e2f-41b9-aada-adcb2c2015d3] Fetching instance by UUID {{(pid=120799) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:14:38.485640 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-41b44941-73dc-4b9d-a30f-6307beea69f5 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:14:38.486308 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-41b44941-73dc-4b9d-a30f-6307beea69f5 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:14:38.486881 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-41b44941-73dc-4b9d-a30f-6307beea69f5 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:14:38.487766 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-41b44941-73dc-4b9d-a30f-6307beea69f5 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:14:38.488346 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-41b44941-73dc-4b9d-a30f-6307beea69f5 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:14:38.488899 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-41b44941-73dc-4b9d-a30f-6307beea69f5 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:14:38.511102 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.policy [None req-bd2116e9-7f83-402b-9e54-19623cda6aca tempest-VolumesNegativeTest-2027890769 tempest-VolumesNegativeTest-2027890769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ed299381d5b49fb8577287af4368fe1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d91979a6ce9468c990b9e08e267d329', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120798) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:14:38.521607 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [None req-bd2116e9-7f83-402b-9e54-19623cda6aca tempest-VolumesNegativeTest-2027890769 tempest-VolumesNegativeTest-2027890769-project] 10.222.0.17 "GET /compute/v2.1/servers/52dfbaaf-557f-478e-bee8-e4856641b102" status: 200 len: 1314 microversion: 2.1 time: 0.316437 Aug 23 07:14:38.522608 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 143/295] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:14:38 2022] GET /compute/v2.1/servers/52dfbaaf-557f-478e-bee8-e4856641b102 => generated 1314 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:14:38.637377 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.policy [None req-41b44941-73dc-4b9d-a30f-6307beea69f5 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64d54cb95b264c18b45d90822507fae1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135367be6e3f4b3d965ee0d99fdca524', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120799) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:14:38.645712 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-41b44941-73dc-4b9d-a30f-6307beea69f5 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] 10.222.0.17 "GET /compute/v2.1/servers/6915ed26-7e2f-41b9-aada-adcb2c2015d3" status: 200 len: 1510 microversion: 2.1 time: 0.171785 Aug 23 07:14:38.646533 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 153/296] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:14:38 2022] GET /compute/v2.1/servers/6915ed26-7e2f-41b9-aada-adcb2c2015d3 => generated 1510 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:14:39.215968 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-9bb32da4-32a9-4034-84f0-30e64c9021e6 tempest-VolumesActionsTest-775986377 tempest-VolumesActionsTest-775986377-project] Calling method '>' {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:14:39.216578 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.compute.api [None req-9bb32da4-32a9-4034-84f0-30e64c9021e6 tempest-VolumesActionsTest-775986377 tempest-VolumesActionsTest-775986377-project] [instance: 118d56f5-a1b4-402d-9e43-b432c2b63b14] Fetching instance by UUID {{(pid=120798) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:14:39.223101 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-9bb32da4-32a9-4034-84f0-30e64c9021e6 tempest-VolumesActionsTest-775986377 tempest-VolumesActionsTest-775986377-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:14:39.223669 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-9bb32da4-32a9-4034-84f0-30e64c9021e6 tempest-VolumesActionsTest-775986377 tempest-VolumesActionsTest-775986377-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:14:39.224094 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-9bb32da4-32a9-4034-84f0-30e64c9021e6 tempest-VolumesActionsTest-775986377 tempest-VolumesActionsTest-775986377-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:14:39.224785 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-9bb32da4-32a9-4034-84f0-30e64c9021e6 tempest-VolumesActionsTest-775986377 tempest-VolumesActionsTest-775986377-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:14:39.225232 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-9bb32da4-32a9-4034-84f0-30e64c9021e6 tempest-VolumesActionsTest-775986377 tempest-VolumesActionsTest-775986377-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:14:39.225649 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-9bb32da4-32a9-4034-84f0-30e64c9021e6 tempest-VolumesActionsTest-775986377 tempest-VolumesActionsTest-775986377-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:14:39.360716 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.policy [None req-9bb32da4-32a9-4034-84f0-30e64c9021e6 tempest-VolumesActionsTest-775986377 tempest-VolumesActionsTest-775986377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f4d65ffaab942f29d449b64805c765a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2ef3b6384a4194a26ba51078c425af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120798) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:14:39.366619 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG dbcounter [-] [120798] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120798) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:14:39.375046 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [None req-9bb32da4-32a9-4034-84f0-30e64c9021e6 tempest-VolumesActionsTest-775986377 tempest-VolumesActionsTest-775986377-project] 10.222.0.17 "GET /compute/v2.1/servers/118d56f5-a1b4-402d-9e43-b432c2b63b14" status: 200 len: 1312 microversion: 2.1 time: 0.162855 Aug 23 07:14:39.375996 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 144/297] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:14:39 2022] GET /compute/v2.1/servers/118d56f5-a1b4-402d-9e43-b432c2b63b14 => generated 1312 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:14:39.492409 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-3c199c5a-9b14-4e34-927d-5204dd8f60bc tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Calling method '>' {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:14:39.493317 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.compute.api [None req-3c199c5a-9b14-4e34-927d-5204dd8f60bc tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] [instance: ce9a9c42-b9ed-40b1-b72c-390b85578204] Fetching instance by UUID {{(pid=120799) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:14:39.504424 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-3c199c5a-9b14-4e34-927d-5204dd8f60bc tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:14:39.505188 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-3c199c5a-9b14-4e34-927d-5204dd8f60bc tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:14:39.505908 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-3c199c5a-9b14-4e34-927d-5204dd8f60bc tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:14:39.507263 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-3c199c5a-9b14-4e34-927d-5204dd8f60bc tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:14:39.508070 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-3c199c5a-9b14-4e34-927d-5204dd8f60bc tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:14:39.508776 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-3c199c5a-9b14-4e34-927d-5204dd8f60bc tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:14:39.542085 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-c6a5ecce-2332-471b-a514-a2d55b79a5fd tempest-VolumesNegativeTest-2027890769 tempest-VolumesNegativeTest-2027890769-project] Calling method '>' {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:14:39.542688 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.compute.api [None req-c6a5ecce-2332-471b-a514-a2d55b79a5fd tempest-VolumesNegativeTest-2027890769 tempest-VolumesNegativeTest-2027890769-project] [instance: 52dfbaaf-557f-478e-bee8-e4856641b102] Fetching instance by UUID {{(pid=120798) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:14:39.549406 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-c6a5ecce-2332-471b-a514-a2d55b79a5fd tempest-VolumesNegativeTest-2027890769 tempest-VolumesNegativeTest-2027890769-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:14:39.549891 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-c6a5ecce-2332-471b-a514-a2d55b79a5fd tempest-VolumesNegativeTest-2027890769 tempest-VolumesNegativeTest-2027890769-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:14:39.550318 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-c6a5ecce-2332-471b-a514-a2d55b79a5fd tempest-VolumesNegativeTest-2027890769 tempest-VolumesNegativeTest-2027890769-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:14:39.551015 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-c6a5ecce-2332-471b-a514-a2d55b79a5fd tempest-VolumesNegativeTest-2027890769 tempest-VolumesNegativeTest-2027890769-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:14:39.551566 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-c6a5ecce-2332-471b-a514-a2d55b79a5fd tempest-VolumesNegativeTest-2027890769 tempest-VolumesNegativeTest-2027890769-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:14:39.551975 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-c6a5ecce-2332-471b-a514-a2d55b79a5fd tempest-VolumesNegativeTest-2027890769 tempest-VolumesNegativeTest-2027890769-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:14:39.704929 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.policy [None req-3c199c5a-9b14-4e34-927d-5204dd8f60bc tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '471dc5c1db64411ab1d80ad6c038e519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb44f62fa62e46528712f24479cbb19f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120799) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:14:39.717767 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-3c199c5a-9b14-4e34-927d-5204dd8f60bc tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] 10.222.0.17 "GET /compute/v2.1/servers/ce9a9c42-b9ed-40b1-b72c-390b85578204" status: 200 len: 1366 microversion: 2.1 time: 0.232036 Aug 23 07:14:39.731685 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 154/298] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:14:39 2022] GET /compute/v2.1/servers/ce9a9c42-b9ed-40b1-b72c-390b85578204 => generated 1366 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:14:39.733335 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-c65c80c9-29f9-41d4-96a2-ea2c46a65901 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Calling method '>' {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:14:39.735594 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.compute.api [None req-c65c80c9-29f9-41d4-96a2-ea2c46a65901 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] [instance: 6915ed26-7e2f-41b9-aada-adcb2c2015d3] Fetching instance by UUID {{(pid=120799) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:14:39.736405 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.policy [None req-c6a5ecce-2332-471b-a514-a2d55b79a5fd tempest-VolumesNegativeTest-2027890769 tempest-VolumesNegativeTest-2027890769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ed299381d5b49fb8577287af4368fe1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d91979a6ce9468c990b9e08e267d329', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120798) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:14:39.741911 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-c65c80c9-29f9-41d4-96a2-ea2c46a65901 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:14:39.742485 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-c65c80c9-29f9-41d4-96a2-ea2c46a65901 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:14:39.743167 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-c65c80c9-29f9-41d4-96a2-ea2c46a65901 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:14:39.743904 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-c65c80c9-29f9-41d4-96a2-ea2c46a65901 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:14:39.744352 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-c65c80c9-29f9-41d4-96a2-ea2c46a65901 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:14:39.744770 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-c65c80c9-29f9-41d4-96a2-ea2c46a65901 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:14:39.745301 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [None req-c6a5ecce-2332-471b-a514-a2d55b79a5fd tempest-VolumesNegativeTest-2027890769 tempest-VolumesNegativeTest-2027890769-project] 10.222.0.17 "GET /compute/v2.1/servers/52dfbaaf-557f-478e-bee8-e4856641b102" status: 200 len: 1314 microversion: 2.1 time: 0.207124 Aug 23 07:14:39.748993 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 145/299] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:14:39 2022] GET /compute/v2.1/servers/52dfbaaf-557f-478e-bee8-e4856641b102 => generated 1314 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:14:39.887493 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.policy [None req-c65c80c9-29f9-41d4-96a2-ea2c46a65901 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64d54cb95b264c18b45d90822507fae1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135367be6e3f4b3d965ee0d99fdca524', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120799) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:14:39.895347 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-c65c80c9-29f9-41d4-96a2-ea2c46a65901 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] 10.222.0.17 "GET /compute/v2.1/servers/6915ed26-7e2f-41b9-aada-adcb2c2015d3" status: 200 len: 1510 microversion: 2.1 time: 0.168076 Aug 23 07:14:39.895888 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 155/300] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:14:39 2022] GET /compute/v2.1/servers/6915ed26-7e2f-41b9-aada-adcb2c2015d3 => generated 1510 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:14:40.410098 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-b58f709d-eb1a-4575-8037-23d7aaa96dbb tempest-VolumesActionsTest-775986377 tempest-VolumesActionsTest-775986377-project] Calling method '>' {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:14:40.411011 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.compute.api [None req-b58f709d-eb1a-4575-8037-23d7aaa96dbb tempest-VolumesActionsTest-775986377 tempest-VolumesActionsTest-775986377-project] [instance: 118d56f5-a1b4-402d-9e43-b432c2b63b14] Fetching instance by UUID {{(pid=120798) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:14:40.420899 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-b58f709d-eb1a-4575-8037-23d7aaa96dbb tempest-VolumesActionsTest-775986377 tempest-VolumesActionsTest-775986377-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:14:40.421380 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-b58f709d-eb1a-4575-8037-23d7aaa96dbb tempest-VolumesActionsTest-775986377 tempest-VolumesActionsTest-775986377-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:14:40.421805 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-b58f709d-eb1a-4575-8037-23d7aaa96dbb tempest-VolumesActionsTest-775986377 tempest-VolumesActionsTest-775986377-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:14:40.422492 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-b58f709d-eb1a-4575-8037-23d7aaa96dbb tempest-VolumesActionsTest-775986377 tempest-VolumesActionsTest-775986377-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:14:40.422936 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-b58f709d-eb1a-4575-8037-23d7aaa96dbb tempest-VolumesActionsTest-775986377 tempest-VolumesActionsTest-775986377-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:14:40.423356 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-b58f709d-eb1a-4575-8037-23d7aaa96dbb tempest-VolumesActionsTest-775986377 tempest-VolumesActionsTest-775986377-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:14:40.564691 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.policy [None req-b58f709d-eb1a-4575-8037-23d7aaa96dbb tempest-VolumesActionsTest-775986377 tempest-VolumesActionsTest-775986377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f4d65ffaab942f29d449b64805c765a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2ef3b6384a4194a26ba51078c425af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120798) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:14:40.573637 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [None req-b58f709d-eb1a-4575-8037-23d7aaa96dbb tempest-VolumesActionsTest-775986377 tempest-VolumesActionsTest-775986377-project] 10.222.0.17 "GET /compute/v2.1/servers/118d56f5-a1b4-402d-9e43-b432c2b63b14" status: 200 len: 1312 microversion: 2.1 time: 0.170829 Aug 23 07:14:40.583627 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 146/301] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:14:40 2022] GET /compute/v2.1/servers/118d56f5-a1b4-402d-9e43-b432c2b63b14 => generated 1312 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:14:40.739688 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-066f65d0-ea67-437a-8d62-286677fe99b5 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Calling method '>' {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:14:40.740292 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.compute.api [None req-066f65d0-ea67-437a-8d62-286677fe99b5 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] [instance: ce9a9c42-b9ed-40b1-b72c-390b85578204] Fetching instance by UUID {{(pid=120799) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:14:40.747462 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-066f65d0-ea67-437a-8d62-286677fe99b5 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:14:40.748318 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-066f65d0-ea67-437a-8d62-286677fe99b5 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:14:40.748805 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-066f65d0-ea67-437a-8d62-286677fe99b5 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:14:40.749584 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-066f65d0-ea67-437a-8d62-286677fe99b5 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:14:40.750091 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-066f65d0-ea67-437a-8d62-286677fe99b5 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:14:40.750722 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-066f65d0-ea67-437a-8d62-286677fe99b5 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:14:40.765152 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-16187d55-b965-4db2-9a0d-304802bd71f1 tempest-VolumesNegativeTest-2027890769 tempest-VolumesNegativeTest-2027890769-project] Calling method '>' {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:14:40.765762 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.compute.api [None req-16187d55-b965-4db2-9a0d-304802bd71f1 tempest-VolumesNegativeTest-2027890769 tempest-VolumesNegativeTest-2027890769-project] [instance: 52dfbaaf-557f-478e-bee8-e4856641b102] Fetching instance by UUID {{(pid=120798) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:14:40.772372 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-16187d55-b965-4db2-9a0d-304802bd71f1 tempest-VolumesNegativeTest-2027890769 tempest-VolumesNegativeTest-2027890769-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:14:40.772863 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-16187d55-b965-4db2-9a0d-304802bd71f1 tempest-VolumesNegativeTest-2027890769 tempest-VolumesNegativeTest-2027890769-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:14:40.773286 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-16187d55-b965-4db2-9a0d-304802bd71f1 tempest-VolumesNegativeTest-2027890769 tempest-VolumesNegativeTest-2027890769-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:14:40.773972 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-16187d55-b965-4db2-9a0d-304802bd71f1 tempest-VolumesNegativeTest-2027890769 tempest-VolumesNegativeTest-2027890769-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:14:40.774469 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-16187d55-b965-4db2-9a0d-304802bd71f1 tempest-VolumesNegativeTest-2027890769 tempest-VolumesNegativeTest-2027890769-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:14:40.774990 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-16187d55-b965-4db2-9a0d-304802bd71f1 tempest-VolumesNegativeTest-2027890769 tempest-VolumesNegativeTest-2027890769-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:14:41.031448 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.policy [None req-16187d55-b965-4db2-9a0d-304802bd71f1 tempest-VolumesNegativeTest-2027890769 tempest-VolumesNegativeTest-2027890769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ed299381d5b49fb8577287af4368fe1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d91979a6ce9468c990b9e08e267d329', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120798) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:14:41.036496 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.policy [None req-066f65d0-ea67-437a-8d62-286677fe99b5 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '471dc5c1db64411ab1d80ad6c038e519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb44f62fa62e46528712f24479cbb19f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120799) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:14:41.039708 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [None req-16187d55-b965-4db2-9a0d-304802bd71f1 tempest-VolumesNegativeTest-2027890769 tempest-VolumesNegativeTest-2027890769-project] 10.222.0.17 "GET /compute/v2.1/servers/52dfbaaf-557f-478e-bee8-e4856641b102" status: 200 len: 1314 microversion: 2.1 time: 0.278572 Aug 23 07:14:41.048076 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 147/302] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:14:40 2022] GET /compute/v2.1/servers/52dfbaaf-557f-478e-bee8-e4856641b102 => generated 1314 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 07:14:41.050393 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-066f65d0-ea67-437a-8d62-286677fe99b5 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] 10.222.0.17 "GET /compute/v2.1/servers/ce9a9c42-b9ed-40b1-b72c-390b85578204" status: 200 len: 1366 microversion: 2.1 time: 0.314675 Aug 23 07:14:41.051668 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 156/303] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:14:40 2022] GET /compute/v2.1/servers/ce9a9c42-b9ed-40b1-b72c-390b85578204 => generated 1366 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:14:41.053346 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-eafbe008-94d5-45bd-b2e2-044fe1a9161a tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Calling method '>' {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:14:41.054021 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.compute.api [None req-eafbe008-94d5-45bd-b2e2-044fe1a9161a tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] [instance: 6915ed26-7e2f-41b9-aada-adcb2c2015d3] Fetching instance by UUID {{(pid=120798) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:14:41.060307 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-eafbe008-94d5-45bd-b2e2-044fe1a9161a tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:14:41.060860 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-eafbe008-94d5-45bd-b2e2-044fe1a9161a tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:14:41.061357 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-eafbe008-94d5-45bd-b2e2-044fe1a9161a tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:14:41.062172 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-eafbe008-94d5-45bd-b2e2-044fe1a9161a tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:14:41.062636 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-eafbe008-94d5-45bd-b2e2-044fe1a9161a tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:14:41.063116 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-eafbe008-94d5-45bd-b2e2-044fe1a9161a tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:14:41.198526 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.policy [None req-eafbe008-94d5-45bd-b2e2-044fe1a9161a tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64d54cb95b264c18b45d90822507fae1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135367be6e3f4b3d965ee0d99fdca524', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120798) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:14:41.207321 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [None req-eafbe008-94d5-45bd-b2e2-044fe1a9161a tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] 10.222.0.17 "GET /compute/v2.1/servers/6915ed26-7e2f-41b9-aada-adcb2c2015d3" status: 200 len: 1510 microversion: 2.1 time: 0.157895 Aug 23 07:14:41.208274 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 148/304] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:14:41 2022] GET /compute/v2.1/servers/6915ed26-7e2f-41b9-aada-adcb2c2015d3 => generated 1510 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:14:41.599345 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-f3e5cd49-1099-466f-94f4-88fee1bb03cd tempest-VolumesActionsTest-775986377 tempest-VolumesActionsTest-775986377-project] Calling method '>' {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:14:41.600250 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.compute.api [None req-f3e5cd49-1099-466f-94f4-88fee1bb03cd tempest-VolumesActionsTest-775986377 tempest-VolumesActionsTest-775986377-project] [instance: 118d56f5-a1b4-402d-9e43-b432c2b63b14] Fetching instance by UUID {{(pid=120799) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:14:41.609338 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-f3e5cd49-1099-466f-94f4-88fee1bb03cd tempest-VolumesActionsTest-775986377 tempest-VolumesActionsTest-775986377-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:14:41.609817 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-f3e5cd49-1099-466f-94f4-88fee1bb03cd tempest-VolumesActionsTest-775986377 tempest-VolumesActionsTest-775986377-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:14:41.610242 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-f3e5cd49-1099-466f-94f4-88fee1bb03cd tempest-VolumesActionsTest-775986377 tempest-VolumesActionsTest-775986377-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:14:41.610922 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-f3e5cd49-1099-466f-94f4-88fee1bb03cd tempest-VolumesActionsTest-775986377 tempest-VolumesActionsTest-775986377-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:14:41.611374 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-f3e5cd49-1099-466f-94f4-88fee1bb03cd tempest-VolumesActionsTest-775986377 tempest-VolumesActionsTest-775986377-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:14:41.611827 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-f3e5cd49-1099-466f-94f4-88fee1bb03cd tempest-VolumesActionsTest-775986377 tempest-VolumesActionsTest-775986377-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:14:41.759773 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.policy [None req-f3e5cd49-1099-466f-94f4-88fee1bb03cd tempest-VolumesActionsTest-775986377 tempest-VolumesActionsTest-775986377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f4d65ffaab942f29d449b64805c765a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2ef3b6384a4194a26ba51078c425af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120799) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:14:41.768659 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-f3e5cd49-1099-466f-94f4-88fee1bb03cd tempest-VolumesActionsTest-775986377 tempest-VolumesActionsTest-775986377-project] 10.222.0.17 "GET /compute/v2.1/servers/118d56f5-a1b4-402d-9e43-b432c2b63b14" status: 200 len: 1312 microversion: 2.1 time: 0.175857 Aug 23 07:14:41.769216 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 157/305] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:14:41 2022] GET /compute/v2.1/servers/118d56f5-a1b4-402d-9e43-b432c2b63b14 => generated 1312 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:14:42.063353 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-9f541af9-2f47-4674-be1d-f2f566c6026e tempest-VolumesNegativeTest-2027890769 tempest-VolumesNegativeTest-2027890769-project] Calling method '>' {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:14:42.064031 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.compute.api [None req-9f541af9-2f47-4674-be1d-f2f566c6026e tempest-VolumesNegativeTest-2027890769 tempest-VolumesNegativeTest-2027890769-project] [instance: 52dfbaaf-557f-478e-bee8-e4856641b102] Fetching instance by UUID {{(pid=120798) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:14:42.068987 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG dbcounter [-] [120799] Writing DB stats nova_cell0:SELECT=12 {{(pid=120799) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:14:42.069955 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG dbcounter [-] [120798] Writing DB stats nova_cell0:SELECT=4 {{(pid=120798) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:14:42.070661 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG dbcounter [-] [120798] Writing DB stats nova_cell0:SELECT=16 {{(pid=120798) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:14:42.072291 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-9f541af9-2f47-4674-be1d-f2f566c6026e tempest-VolumesNegativeTest-2027890769 tempest-VolumesNegativeTest-2027890769-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:14:42.072771 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-9f541af9-2f47-4674-be1d-f2f566c6026e tempest-VolumesNegativeTest-2027890769 tempest-VolumesNegativeTest-2027890769-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:14:42.073230 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-9f541af9-2f47-4674-be1d-f2f566c6026e tempest-VolumesNegativeTest-2027890769 tempest-VolumesNegativeTest-2027890769-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:14:42.074340 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-9f541af9-2f47-4674-be1d-f2f566c6026e tempest-VolumesNegativeTest-2027890769 tempest-VolumesNegativeTest-2027890769-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:14:42.075778 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-9f541af9-2f47-4674-be1d-f2f566c6026e tempest-VolumesNegativeTest-2027890769 tempest-VolumesNegativeTest-2027890769-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:14:42.076378 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-9f541af9-2f47-4674-be1d-f2f566c6026e tempest-VolumesNegativeTest-2027890769 tempest-VolumesNegativeTest-2027890769-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:14:42.077334 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-939deb20-eaa0-4bfd-8e93-e64598e05d48 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Calling method '>' {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:14:42.078044 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.compute.api [None req-939deb20-eaa0-4bfd-8e93-e64598e05d48 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] [instance: ce9a9c42-b9ed-40b1-b72c-390b85578204] Fetching instance by UUID {{(pid=120799) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:14:42.085092 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-939deb20-eaa0-4bfd-8e93-e64598e05d48 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:14:42.085575 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-939deb20-eaa0-4bfd-8e93-e64598e05d48 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:14:42.086002 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-939deb20-eaa0-4bfd-8e93-e64598e05d48 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:14:42.086696 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-939deb20-eaa0-4bfd-8e93-e64598e05d48 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:14:42.087328 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-939deb20-eaa0-4bfd-8e93-e64598e05d48 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:14:42.087747 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-939deb20-eaa0-4bfd-8e93-e64598e05d48 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:14:42.266430 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.policy [None req-9f541af9-2f47-4674-be1d-f2f566c6026e tempest-VolumesNegativeTest-2027890769 tempest-VolumesNegativeTest-2027890769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ed299381d5b49fb8577287af4368fe1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d91979a6ce9468c990b9e08e267d329', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120798) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:14:42.274577 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [None req-9f541af9-2f47-4674-be1d-f2f566c6026e tempest-VolumesNegativeTest-2027890769 tempest-VolumesNegativeTest-2027890769-project] 10.222.0.17 "GET /compute/v2.1/servers/52dfbaaf-557f-478e-bee8-e4856641b102" status: 200 len: 1314 microversion: 2.1 time: 0.216173 Aug 23 07:14:42.275142 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 149/306] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:14:42 2022] GET /compute/v2.1/servers/52dfbaaf-557f-478e-bee8-e4856641b102 => generated 1314 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:14:42.280610 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-29959ad5-06b0-4879-b38a-e4f239a05d95 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Calling method '>' {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:14:42.281212 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.compute.api [None req-29959ad5-06b0-4879-b38a-e4f239a05d95 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] [instance: 6915ed26-7e2f-41b9-aada-adcb2c2015d3] Fetching instance by UUID {{(pid=120798) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:14:42.287158 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-29959ad5-06b0-4879-b38a-e4f239a05d95 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:14:42.287660 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-29959ad5-06b0-4879-b38a-e4f239a05d95 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:14:42.288091 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-29959ad5-06b0-4879-b38a-e4f239a05d95 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:14:42.288804 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-29959ad5-06b0-4879-b38a-e4f239a05d95 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:14:42.289249 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-29959ad5-06b0-4879-b38a-e4f239a05d95 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:14:42.289664 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-29959ad5-06b0-4879-b38a-e4f239a05d95 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:14:42.414479 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.policy [None req-939deb20-eaa0-4bfd-8e93-e64598e05d48 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '471dc5c1db64411ab1d80ad6c038e519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb44f62fa62e46528712f24479cbb19f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120799) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:14:42.423756 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-939deb20-eaa0-4bfd-8e93-e64598e05d48 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] 10.222.0.17 "GET /compute/v2.1/servers/ce9a9c42-b9ed-40b1-b72c-390b85578204" status: 200 len: 1366 microversion: 2.1 time: 0.355346 Aug 23 07:14:42.424478 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 158/307] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:14:42 2022] GET /compute/v2.1/servers/ce9a9c42-b9ed-40b1-b72c-390b85578204 => generated 1366 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:14:42.452227 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.policy [None req-29959ad5-06b0-4879-b38a-e4f239a05d95 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64d54cb95b264c18b45d90822507fae1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135367be6e3f4b3d965ee0d99fdca524', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120798) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:14:42.460480 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [None req-29959ad5-06b0-4879-b38a-e4f239a05d95 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] 10.222.0.17 "GET /compute/v2.1/servers/6915ed26-7e2f-41b9-aada-adcb2c2015d3" status: 200 len: 1510 microversion: 2.1 time: 0.184369 Aug 23 07:14:42.461038 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 150/308] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:14:42 2022] GET /compute/v2.1/servers/6915ed26-7e2f-41b9-aada-adcb2c2015d3 => generated 1510 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:14:42.789814 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-82a4633a-8f7d-46b8-8f77-f3f972863a14 tempest-VolumesActionsTest-775986377 tempest-VolumesActionsTest-775986377-project] Calling method '>' {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:14:42.790427 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.compute.api [None req-82a4633a-8f7d-46b8-8f77-f3f972863a14 tempest-VolumesActionsTest-775986377 tempest-VolumesActionsTest-775986377-project] [instance: 118d56f5-a1b4-402d-9e43-b432c2b63b14] Fetching instance by UUID {{(pid=120799) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:14:42.797315 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-82a4633a-8f7d-46b8-8f77-f3f972863a14 tempest-VolumesActionsTest-775986377 tempest-VolumesActionsTest-775986377-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:14:42.797863 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-82a4633a-8f7d-46b8-8f77-f3f972863a14 tempest-VolumesActionsTest-775986377 tempest-VolumesActionsTest-775986377-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:14:42.798292 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-82a4633a-8f7d-46b8-8f77-f3f972863a14 tempest-VolumesActionsTest-775986377 tempest-VolumesActionsTest-775986377-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:14:42.798966 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-82a4633a-8f7d-46b8-8f77-f3f972863a14 tempest-VolumesActionsTest-775986377 tempest-VolumesActionsTest-775986377-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:14:42.799445 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-82a4633a-8f7d-46b8-8f77-f3f972863a14 tempest-VolumesActionsTest-775986377 tempest-VolumesActionsTest-775986377-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:14:42.799876 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-82a4633a-8f7d-46b8-8f77-f3f972863a14 tempest-VolumesActionsTest-775986377 tempest-VolumesActionsTest-775986377-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:14:42.937238 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.policy [None req-82a4633a-8f7d-46b8-8f77-f3f972863a14 tempest-VolumesActionsTest-775986377 tempest-VolumesActionsTest-775986377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f4d65ffaab942f29d449b64805c765a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2ef3b6384a4194a26ba51078c425af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120799) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:14:42.945051 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-82a4633a-8f7d-46b8-8f77-f3f972863a14 tempest-VolumesActionsTest-775986377 tempest-VolumesActionsTest-775986377-project] 10.222.0.17 "GET /compute/v2.1/servers/118d56f5-a1b4-402d-9e43-b432c2b63b14" status: 200 len: 1312 microversion: 2.1 time: 0.159347 Aug 23 07:14:42.945845 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 159/309] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:14:42 2022] GET /compute/v2.1/servers/118d56f5-a1b4-402d-9e43-b432c2b63b14 => generated 1312 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:14:43.202532 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [req-a6b2b0d6-3c31-4b73-94cb-1876cb36f24a req-fc1c03ea-faa0-4858-a8ef-629baa6aaf80 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "52dfbaaf-557f-478e-bee8-e4856641b102", "name": "network-vif-plugged", "status": "completed", "tag": "7a88af17-4e94-444a-bfe6-7115e2a6bf50"}]} {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 07:14:43.217181 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [req-a6b2b0d6-3c31-4b73-94cb-1876cb36f24a req-fc1c03ea-faa0-4858-a8ef-629baa6aaf80 service nova] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:14:43.218049 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [req-a6b2b0d6-3c31-4b73-94cb-1876cb36f24a req-fc1c03ea-faa0-4858-a8ef-629baa6aaf80 service nova] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:14:43.218740 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [req-a6b2b0d6-3c31-4b73-94cb-1876cb36f24a req-fc1c03ea-faa0-4858-a8ef-629baa6aaf80 service nova] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:14:43.234514 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.compute.server_external_events [req-a6b2b0d6-3c31-4b73-94cb-1876cb36f24a req-fc1c03ea-faa0-4858-a8ef-629baa6aaf80 service nova] Creating event network-vif-plugged:7a88af17-4e94-444a-bfe6-7115e2a6bf50 for instance 52dfbaaf-557f-478e-bee8-e4856641b102 on hv-cinder-85409 Aug 23 07:14:43.241374 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [req-a6b2b0d6-3c31-4b73-94cb-1876cb36f24a req-fc1c03ea-faa0-4858-a8ef-629baa6aaf80 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043643 Aug 23 07:14:43.242687 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 151/310] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Aug 23 07:14:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 07:14:43.301217 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-6a40c510-a4b4-425d-976b-ceba85c36d9a tempest-VolumesNegativeTest-2027890769 tempest-VolumesNegativeTest-2027890769-project] Calling method '>' {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:14:43.302358 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.compute.api [None req-6a40c510-a4b4-425d-976b-ceba85c36d9a tempest-VolumesNegativeTest-2027890769 tempest-VolumesNegativeTest-2027890769-project] [instance: 52dfbaaf-557f-478e-bee8-e4856641b102] Fetching instance by UUID {{(pid=120799) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:14:43.315464 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-6a40c510-a4b4-425d-976b-ceba85c36d9a tempest-VolumesNegativeTest-2027890769 tempest-VolumesNegativeTest-2027890769-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:14:43.316359 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-6a40c510-a4b4-425d-976b-ceba85c36d9a tempest-VolumesNegativeTest-2027890769 tempest-VolumesNegativeTest-2027890769-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:14:43.317304 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-6a40c510-a4b4-425d-976b-ceba85c36d9a tempest-VolumesNegativeTest-2027890769 tempest-VolumesNegativeTest-2027890769-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:14:43.318623 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-6a40c510-a4b4-425d-976b-ceba85c36d9a tempest-VolumesNegativeTest-2027890769 tempest-VolumesNegativeTest-2027890769-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:14:43.319300 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-6a40c510-a4b4-425d-976b-ceba85c36d9a tempest-VolumesNegativeTest-2027890769 tempest-VolumesNegativeTest-2027890769-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:14:43.324122 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-6a40c510-a4b4-425d-976b-ceba85c36d9a tempest-VolumesNegativeTest-2027890769 tempest-VolumesNegativeTest-2027890769-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:14:43.446247 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-68504a46-5c35-4338-9fa3-98022f52561a tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Calling method '>' {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:14:43.446938 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.compute.api [None req-68504a46-5c35-4338-9fa3-98022f52561a tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] [instance: ce9a9c42-b9ed-40b1-b72c-390b85578204] Fetching instance by UUID {{(pid=120798) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:14:43.459452 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-68504a46-5c35-4338-9fa3-98022f52561a tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:14:43.463285 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-68504a46-5c35-4338-9fa3-98022f52561a tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:14:43.467643 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-68504a46-5c35-4338-9fa3-98022f52561a tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:14:43.469397 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-68504a46-5c35-4338-9fa3-98022f52561a tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:14:43.470116 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-68504a46-5c35-4338-9fa3-98022f52561a tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:14:43.470967 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-68504a46-5c35-4338-9fa3-98022f52561a tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:14:43.603401 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.policy [None req-6a40c510-a4b4-425d-976b-ceba85c36d9a tempest-VolumesNegativeTest-2027890769 tempest-VolumesNegativeTest-2027890769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ed299381d5b49fb8577287af4368fe1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d91979a6ce9468c990b9e08e267d329', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120799) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:14:43.612925 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-6a40c510-a4b4-425d-976b-ceba85c36d9a tempest-VolumesNegativeTest-2027890769 tempest-VolumesNegativeTest-2027890769-project] 10.222.0.17 "GET /compute/v2.1/servers/52dfbaaf-557f-478e-bee8-e4856641b102" status: 200 len: 1314 microversion: 2.1 time: 0.320961 Aug 23 07:14:43.613493 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 160/311] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:14:43 2022] GET /compute/v2.1/servers/52dfbaaf-557f-478e-bee8-e4856641b102 => generated 1314 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:14:43.618767 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-490dd061-e98b-42b3-b139-9c1fe866881b tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Calling method '>' {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:14:43.619932 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.compute.api [None req-490dd061-e98b-42b3-b139-9c1fe866881b tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] [instance: 6915ed26-7e2f-41b9-aada-adcb2c2015d3] Fetching instance by UUID {{(pid=120799) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:14:43.626867 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-490dd061-e98b-42b3-b139-9c1fe866881b tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:14:43.627656 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-490dd061-e98b-42b3-b139-9c1fe866881b tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:14:43.628085 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-490dd061-e98b-42b3-b139-9c1fe866881b tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:14:43.628997 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-490dd061-e98b-42b3-b139-9c1fe866881b tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:14:43.629571 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-490dd061-e98b-42b3-b139-9c1fe866881b tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:14:43.630151 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-490dd061-e98b-42b3-b139-9c1fe866881b tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:14:43.679800 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.policy [None req-68504a46-5c35-4338-9fa3-98022f52561a tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '471dc5c1db64411ab1d80ad6c038e519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb44f62fa62e46528712f24479cbb19f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120798) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:14:43.688146 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [None req-68504a46-5c35-4338-9fa3-98022f52561a tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] 10.222.0.17 "GET /compute/v2.1/servers/ce9a9c42-b9ed-40b1-b72c-390b85578204" status: 200 len: 1366 microversion: 2.1 time: 0.246157 Aug 23 07:14:43.688843 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 152/312] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:14:43 2022] GET /compute/v2.1/servers/ce9a9c42-b9ed-40b1-b72c-390b85578204 => generated 1366 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 07:14:43.779864 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.policy [None req-490dd061-e98b-42b3-b139-9c1fe866881b tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64d54cb95b264c18b45d90822507fae1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135367be6e3f4b3d965ee0d99fdca524', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120799) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:14:43.787835 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-490dd061-e98b-42b3-b139-9c1fe866881b tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] 10.222.0.17 "GET /compute/v2.1/servers/6915ed26-7e2f-41b9-aada-adcb2c2015d3" status: 200 len: 1516 microversion: 2.1 time: 0.173036 Aug 23 07:14:43.788383 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 161/313] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:14:43 2022] GET /compute/v2.1/servers/6915ed26-7e2f-41b9-aada-adcb2c2015d3 => generated 1516 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:14:43.968703 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-603558ff-5dc2-4018-946e-232e4155c672 tempest-VolumesActionsTest-775986377 tempest-VolumesActionsTest-775986377-project] Calling method '>' {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:14:43.969303 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.compute.api [None req-603558ff-5dc2-4018-946e-232e4155c672 tempest-VolumesActionsTest-775986377 tempest-VolumesActionsTest-775986377-project] [instance: 118d56f5-a1b4-402d-9e43-b432c2b63b14] Fetching instance by UUID {{(pid=120798) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:14:43.975381 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-603558ff-5dc2-4018-946e-232e4155c672 tempest-VolumesActionsTest-775986377 tempest-VolumesActionsTest-775986377-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:14:43.975887 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-603558ff-5dc2-4018-946e-232e4155c672 tempest-VolumesActionsTest-775986377 tempest-VolumesActionsTest-775986377-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:14:43.976641 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-603558ff-5dc2-4018-946e-232e4155c672 tempest-VolumesActionsTest-775986377 tempest-VolumesActionsTest-775986377-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:14:43.977373 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-603558ff-5dc2-4018-946e-232e4155c672 tempest-VolumesActionsTest-775986377 tempest-VolumesActionsTest-775986377-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:14:43.977813 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-603558ff-5dc2-4018-946e-232e4155c672 tempest-VolumesActionsTest-775986377 tempest-VolumesActionsTest-775986377-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:14:43.978206 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-603558ff-5dc2-4018-946e-232e4155c672 tempest-VolumesActionsTest-775986377 tempest-VolumesActionsTest-775986377-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:14:44.174481 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.policy [None req-603558ff-5dc2-4018-946e-232e4155c672 tempest-VolumesActionsTest-775986377 tempest-VolumesActionsTest-775986377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f4d65ffaab942f29d449b64805c765a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2ef3b6384a4194a26ba51078c425af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120798) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:14:44.182205 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [None req-603558ff-5dc2-4018-946e-232e4155c672 tempest-VolumesActionsTest-775986377 tempest-VolumesActionsTest-775986377-project] 10.222.0.17 "GET /compute/v2.1/servers/118d56f5-a1b4-402d-9e43-b432c2b63b14" status: 200 len: 1312 microversion: 2.1 time: 0.217549 Aug 23 07:14:44.182758 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 153/314] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:14:43 2022] GET /compute/v2.1/servers/118d56f5-a1b4-402d-9e43-b432c2b63b14 => generated 1312 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:14:44.634272 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-451b451f-b935-4d30-95e7-fdceb4440536 tempest-VolumesNegativeTest-2027890769 tempest-VolumesNegativeTest-2027890769-project] Calling method '>' {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:14:44.636284 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.compute.api [None req-451b451f-b935-4d30-95e7-fdceb4440536 tempest-VolumesNegativeTest-2027890769 tempest-VolumesNegativeTest-2027890769-project] [instance: 52dfbaaf-557f-478e-bee8-e4856641b102] Fetching instance by UUID {{(pid=120799) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:14:44.646345 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-451b451f-b935-4d30-95e7-fdceb4440536 tempest-VolumesNegativeTest-2027890769 tempest-VolumesNegativeTest-2027890769-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:14:44.646870 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-451b451f-b935-4d30-95e7-fdceb4440536 tempest-VolumesNegativeTest-2027890769 tempest-VolumesNegativeTest-2027890769-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:14:44.647361 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-451b451f-b935-4d30-95e7-fdceb4440536 tempest-VolumesNegativeTest-2027890769 tempest-VolumesNegativeTest-2027890769-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:14:44.648244 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-451b451f-b935-4d30-95e7-fdceb4440536 tempest-VolumesNegativeTest-2027890769 tempest-VolumesNegativeTest-2027890769-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:14:44.648690 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-451b451f-b935-4d30-95e7-fdceb4440536 tempest-VolumesNegativeTest-2027890769 tempest-VolumesNegativeTest-2027890769-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:14:44.649330 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-451b451f-b935-4d30-95e7-fdceb4440536 tempest-VolumesNegativeTest-2027890769 tempest-VolumesNegativeTest-2027890769-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:14:44.717882 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-fc5c0419-9268-4d25-bdbb-9729487fe78d tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Calling method '>' {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:14:44.718711 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.compute.api [None req-fc5c0419-9268-4d25-bdbb-9729487fe78d tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] [instance: ce9a9c42-b9ed-40b1-b72c-390b85578204] Fetching instance by UUID {{(pid=120798) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:14:44.731159 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-fc5c0419-9268-4d25-bdbb-9729487fe78d tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:14:44.731690 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-fc5c0419-9268-4d25-bdbb-9729487fe78d tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:14:44.732127 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-fc5c0419-9268-4d25-bdbb-9729487fe78d tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:14:44.732829 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-fc5c0419-9268-4d25-bdbb-9729487fe78d tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:14:44.733273 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-fc5c0419-9268-4d25-bdbb-9729487fe78d tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:14:44.733699 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-fc5c0419-9268-4d25-bdbb-9729487fe78d tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:14:44.878123 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.policy [None req-451b451f-b935-4d30-95e7-fdceb4440536 tempest-VolumesNegativeTest-2027890769 tempest-VolumesNegativeTest-2027890769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ed299381d5b49fb8577287af4368fe1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d91979a6ce9468c990b9e08e267d329', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120799) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:14:44.886907 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-451b451f-b935-4d30-95e7-fdceb4440536 tempest-VolumesNegativeTest-2027890769 tempest-VolumesNegativeTest-2027890769-project] 10.222.0.17 "GET /compute/v2.1/servers/52dfbaaf-557f-478e-bee8-e4856641b102" status: 200 len: 1314 microversion: 2.1 time: 0.257082 Aug 23 07:14:44.900524 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 162/315] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:14:44 2022] GET /compute/v2.1/servers/52dfbaaf-557f-478e-bee8-e4856641b102 => generated 1314 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:14:44.930608 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.policy [None req-fc5c0419-9268-4d25-bdbb-9729487fe78d tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '471dc5c1db64411ab1d80ad6c038e519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb44f62fa62e46528712f24479cbb19f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120798) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:14:44.938917 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [None req-fc5c0419-9268-4d25-bdbb-9729487fe78d tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] 10.222.0.17 "GET /compute/v2.1/servers/ce9a9c42-b9ed-40b1-b72c-390b85578204" status: 200 len: 1366 microversion: 2.1 time: 0.225958 Aug 23 07:14:44.939859 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 154/316] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:14:44 2022] GET /compute/v2.1/servers/ce9a9c42-b9ed-40b1-b72c-390b85578204 => generated 1366 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:14:45.169726 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-b313e610-e899-4935-a137-0f47c4146c8e tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Action: 'create', calling method: .version_select at 0x7fe3c5986dc0>, body: {"keypair": {"name": "tempest-keypair-735719574", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCIspiuh5rXQbsf8R+QDTrKK9fHypbFa17Lm4asyD1QFk2Pl+/S42kkOP7dTvWj+80nye9/lT6770eWC0Z39zG8fWD4hY9zsn7koInwjzaDNKht2QX7vXqhZGEzI/aN13A=="}} {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 07:14:45.186735 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.quota [None req-b313e610-e899-4935-a137-0f47c4146c8e tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Getting quotas for project 135367be6e3f4b3d965ee0d99fdca524. Resources: {'key_pairs'} {{(pid=120799) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 07:14:45.191618 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.quota [None req-b313e610-e899-4935-a137-0f47c4146c8e tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Getting quotas for user 64d54cb95b264c18b45d90822507fae1 and project 135367be6e3f4b3d965ee0d99fdca524. Resources: {'key_pairs'} {{(pid=120799) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 07:14:45.203284 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-32a855a6-66b9-400f-91f5-3194b926bf07 tempest-VolumesActionsTest-775986377 tempest-VolumesActionsTest-775986377-project] Calling method '>' {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:14:45.204043 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.compute.api [None req-32a855a6-66b9-400f-91f5-3194b926bf07 tempest-VolumesActionsTest-775986377 tempest-VolumesActionsTest-775986377-project] [instance: 118d56f5-a1b4-402d-9e43-b432c2b63b14] Fetching instance by UUID {{(pid=120798) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:14:45.210534 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-32a855a6-66b9-400f-91f5-3194b926bf07 tempest-VolumesActionsTest-775986377 tempest-VolumesActionsTest-775986377-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:14:45.211059 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-32a855a6-66b9-400f-91f5-3194b926bf07 tempest-VolumesActionsTest-775986377 tempest-VolumesActionsTest-775986377-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:14:45.211559 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-32a855a6-66b9-400f-91f5-3194b926bf07 tempest-VolumesActionsTest-775986377 tempest-VolumesActionsTest-775986377-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:14:45.212307 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-32a855a6-66b9-400f-91f5-3194b926bf07 tempest-VolumesActionsTest-775986377 tempest-VolumesActionsTest-775986377-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:14:45.212788 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-32a855a6-66b9-400f-91f5-3194b926bf07 tempest-VolumesActionsTest-775986377 tempest-VolumesActionsTest-775986377-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:14:45.213392 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-32a855a6-66b9-400f-91f5-3194b926bf07 tempest-VolumesActionsTest-775986377 tempest-VolumesActionsTest-775986377-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:14:45.219371 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-b313e610-e899-4935-a137-0f47c4146c8e tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.053573 Aug 23 07:14:45.220011 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 163/317] 10.222.0.17 () {60 vars in 1159 bytes} [Tue Aug 23 07:14:45 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 07:14:45.276908 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [req-45c0ca6b-5b67-4b2a-8ceb-6198622e9be9 req-3054ffea-4fcd-4780-8128-2726f2230249 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "118d56f5-a1b4-402d-9e43-b432c2b63b14", "name": "network-vif-plugged", "status": "completed", "tag": "f9d34eea-2f38-4bee-b52d-66dae9718e50"}]} {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 07:14:45.288312 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [req-45c0ca6b-5b67-4b2a-8ceb-6198622e9be9 req-3054ffea-4fcd-4780-8128-2726f2230249 service nova] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:14:45.288785 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [req-45c0ca6b-5b67-4b2a-8ceb-6198622e9be9 req-3054ffea-4fcd-4780-8128-2726f2230249 service nova] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:14:45.289208 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [req-45c0ca6b-5b67-4b2a-8ceb-6198622e9be9 req-3054ffea-4fcd-4780-8128-2726f2230249 service nova] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:14:45.300755 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.compute.server_external_events [req-45c0ca6b-5b67-4b2a-8ceb-6198622e9be9 req-3054ffea-4fcd-4780-8128-2726f2230249 service nova] Creating event network-vif-plugged:f9d34eea-2f38-4bee-b52d-66dae9718e50 for instance 118d56f5-a1b4-402d-9e43-b432c2b63b14 on hv-cinder-85409 Aug 23 07:14:45.305923 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [req-45c0ca6b-5b67-4b2a-8ceb-6198622e9be9 req-3054ffea-4fcd-4780-8128-2726f2230249 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032786 Aug 23 07:14:45.306532 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 164/318] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Aug 23 07:14:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 07:14:45.383016 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.policy [None req-32a855a6-66b9-400f-91f5-3194b926bf07 tempest-VolumesActionsTest-775986377 tempest-VolumesActionsTest-775986377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f4d65ffaab942f29d449b64805c765a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2ef3b6384a4194a26ba51078c425af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120798) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:14:45.391565 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [None req-32a855a6-66b9-400f-91f5-3194b926bf07 tempest-VolumesActionsTest-775986377 tempest-VolumesActionsTest-775986377-project] 10.222.0.17 "GET /compute/v2.1/servers/118d56f5-a1b4-402d-9e43-b432c2b63b14" status: 200 len: 1312 microversion: 2.1 time: 0.192469 Aug 23 07:14:45.392388 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 155/319] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:14:45 2022] GET /compute/v2.1/servers/118d56f5-a1b4-402d-9e43-b432c2b63b14 => generated 1312 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:14:45.910064 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-742725ce-75cf-4e80-8867-cc4c68362af1 tempest-VolumesNegativeTest-2027890769 tempest-VolumesNegativeTest-2027890769-project] Calling method '>' {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:14:45.910882 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.compute.api [None req-742725ce-75cf-4e80-8867-cc4c68362af1 tempest-VolumesNegativeTest-2027890769 tempest-VolumesNegativeTest-2027890769-project] [instance: 52dfbaaf-557f-478e-bee8-e4856641b102] Fetching instance by UUID {{(pid=120799) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:14:45.914192 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG dbcounter [-] [120799] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=120799) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:14:45.918525 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-742725ce-75cf-4e80-8867-cc4c68362af1 tempest-VolumesNegativeTest-2027890769 tempest-VolumesNegativeTest-2027890769-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:14:45.919038 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-742725ce-75cf-4e80-8867-cc4c68362af1 tempest-VolumesNegativeTest-2027890769 tempest-VolumesNegativeTest-2027890769-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:14:45.919576 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-742725ce-75cf-4e80-8867-cc4c68362af1 tempest-VolumesNegativeTest-2027890769 tempest-VolumesNegativeTest-2027890769-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:14:45.920213 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-742725ce-75cf-4e80-8867-cc4c68362af1 tempest-VolumesNegativeTest-2027890769 tempest-VolumesNegativeTest-2027890769-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:14:45.920669 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-742725ce-75cf-4e80-8867-cc4c68362af1 tempest-VolumesNegativeTest-2027890769 tempest-VolumesNegativeTest-2027890769-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:14:45.921071 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-742725ce-75cf-4e80-8867-cc4c68362af1 tempest-VolumesNegativeTest-2027890769 tempest-VolumesNegativeTest-2027890769-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:14:45.960529 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-b49b099b-9b6e-4949-be48-32a0771c129c tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Calling method '>' {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:14:45.961400 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.compute.api [None req-b49b099b-9b6e-4949-be48-32a0771c129c tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] [instance: ce9a9c42-b9ed-40b1-b72c-390b85578204] Fetching instance by UUID {{(pid=120798) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:14:45.969953 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-b49b099b-9b6e-4949-be48-32a0771c129c tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:14:45.971207 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-b49b099b-9b6e-4949-be48-32a0771c129c tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:14:45.972127 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-b49b099b-9b6e-4949-be48-32a0771c129c tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:14:45.973172 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-b49b099b-9b6e-4949-be48-32a0771c129c tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:14:45.973834 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-b49b099b-9b6e-4949-be48-32a0771c129c tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:14:45.974623 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-b49b099b-9b6e-4949-be48-32a0771c129c tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:14:46.119869 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.policy [None req-742725ce-75cf-4e80-8867-cc4c68362af1 tempest-VolumesNegativeTest-2027890769 tempest-VolumesNegativeTest-2027890769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ed299381d5b49fb8577287af4368fe1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d91979a6ce9468c990b9e08e267d329', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120799) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:14:46.128298 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-742725ce-75cf-4e80-8867-cc4c68362af1 tempest-VolumesNegativeTest-2027890769 tempest-VolumesNegativeTest-2027890769-project] 10.222.0.17 "GET /compute/v2.1/servers/52dfbaaf-557f-478e-bee8-e4856641b102" status: 200 len: 1314 microversion: 2.1 time: 0.223634 Aug 23 07:14:46.129300 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 165/320] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:14:45 2022] GET /compute/v2.1/servers/52dfbaaf-557f-478e-bee8-e4856641b102 => generated 1314 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:14:46.148376 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.policy [None req-b49b099b-9b6e-4949-be48-32a0771c129c tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '471dc5c1db64411ab1d80ad6c038e519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb44f62fa62e46528712f24479cbb19f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120798) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:14:46.157312 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [None req-b49b099b-9b6e-4949-be48-32a0771c129c tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] 10.222.0.17 "GET /compute/v2.1/servers/ce9a9c42-b9ed-40b1-b72c-390b85578204" status: 200 len: 1366 microversion: 2.1 time: 0.200979 Aug 23 07:14:46.157892 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 156/321] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:14:45 2022] GET /compute/v2.1/servers/ce9a9c42-b9ed-40b1-b72c-390b85578204 => generated 1366 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:14:46.413435 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-fd5bec34-8dac-46f7-a2b8-db4945934467 tempest-VolumesActionsTest-775986377 tempest-VolumesActionsTest-775986377-project] Calling method '>' {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:14:46.414040 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.compute.api [None req-fd5bec34-8dac-46f7-a2b8-db4945934467 tempest-VolumesActionsTest-775986377 tempest-VolumesActionsTest-775986377-project] [instance: 118d56f5-a1b4-402d-9e43-b432c2b63b14] Fetching instance by UUID {{(pid=120799) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:14:46.420802 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-fd5bec34-8dac-46f7-a2b8-db4945934467 tempest-VolumesActionsTest-775986377 tempest-VolumesActionsTest-775986377-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:14:46.421279 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-fd5bec34-8dac-46f7-a2b8-db4945934467 tempest-VolumesActionsTest-775986377 tempest-VolumesActionsTest-775986377-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:14:46.421703 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-fd5bec34-8dac-46f7-a2b8-db4945934467 tempest-VolumesActionsTest-775986377 tempest-VolumesActionsTest-775986377-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:14:46.422381 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-fd5bec34-8dac-46f7-a2b8-db4945934467 tempest-VolumesActionsTest-775986377 tempest-VolumesActionsTest-775986377-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:14:46.422824 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-fd5bec34-8dac-46f7-a2b8-db4945934467 tempest-VolumesActionsTest-775986377 tempest-VolumesActionsTest-775986377-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:14:46.423234 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-fd5bec34-8dac-46f7-a2b8-db4945934467 tempest-VolumesActionsTest-775986377 tempest-VolumesActionsTest-775986377-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:14:46.557253 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.policy [None req-fd5bec34-8dac-46f7-a2b8-db4945934467 tempest-VolumesActionsTest-775986377 tempest-VolumesActionsTest-775986377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f4d65ffaab942f29d449b64805c765a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2ef3b6384a4194a26ba51078c425af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120799) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:14:46.565140 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-fd5bec34-8dac-46f7-a2b8-db4945934467 tempest-VolumesActionsTest-775986377 tempest-VolumesActionsTest-775986377-project] 10.222.0.17 "GET /compute/v2.1/servers/118d56f5-a1b4-402d-9e43-b432c2b63b14" status: 200 len: 1312 microversion: 2.1 time: 0.155830 Aug 23 07:14:46.565708 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 166/322] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:14:46 2022] GET /compute/v2.1/servers/118d56f5-a1b4-402d-9e43-b432c2b63b14 => generated 1312 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:14:46.617630 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-6d9deac0-a848-490a-8306-b924403f4240 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1867069699", "imageRef": "b899fd65-02ae-4b43-bac7-86f38fc3f224", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "9e95747b-9120-47f7-876e-b84ff790f199"}], "security_groups": [{"name": "tempest-securitygroup--651378343"}], "key_name": "tempest-keypair-735719574", "user_data": "}} {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 07:14:46.627262 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG dbcounter [-] [120798] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=120798) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:14:46.725114 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.network.neutron [None req-6d9deac0-a848-490a-8306-b924403f4240 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] validate_networks() for [('9e95747b-9120-47f7-876e-b84ff790f199', None, None, None, None, None)] {{(pid=120798) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 23 07:14:47.116743 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.virt.hardware [None req-6d9deac0-a848-490a-8306-b924403f4240 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Flavor limits 0:0:0 {{(pid=120798) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 07:14:47.117294 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.virt.hardware [None req-6d9deac0-a848-490a-8306-b924403f4240 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Image limits 0:0:0 {{(pid=120798) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 07:14:47.117618 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.virt.hardware [None req-6d9deac0-a848-490a-8306-b924403f4240 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Flavor pref 0:0:0 {{(pid=120798) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 07:14:47.118023 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.virt.hardware [None req-6d9deac0-a848-490a-8306-b924403f4240 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Image pref 0:0:0 {{(pid=120798) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 07:14:47.118428 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.virt.hardware [None req-6d9deac0-a848-490a-8306-b924403f4240 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120798) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 07:14:47.132720 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-6d9deac0-a848-490a-8306-b924403f4240 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:14:47.133202 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-6d9deac0-a848-490a-8306-b924403f4240 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:14:47.133640 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-6d9deac0-a848-490a-8306-b924403f4240 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:14:47.134365 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-6d9deac0-a848-490a-8306-b924403f4240 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:14:47.134816 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-6d9deac0-a848-490a-8306-b924403f4240 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:14:47.135234 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-6d9deac0-a848-490a-8306-b924403f4240 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:14:47.151357 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-1ec246e4-d466-4af5-a962-294eb14bf739 tempest-VolumesNegativeTest-2027890769 tempest-VolumesNegativeTest-2027890769-project] Calling method '>' {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:14:47.151934 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.compute.api [None req-1ec246e4-d466-4af5-a962-294eb14bf739 tempest-VolumesNegativeTest-2027890769 tempest-VolumesNegativeTest-2027890769-project] [instance: 52dfbaaf-557f-478e-bee8-e4856641b102] Fetching instance by UUID {{(pid=120799) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:14:47.154982 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.quota [None req-6d9deac0-a848-490a-8306-b924403f4240 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Getting quotas for project 135367be6e3f4b3d965ee0d99fdca524. Resources: {'ram', 'instances', 'cores'} {{(pid=120798) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 07:14:47.158289 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-1ec246e4-d466-4af5-a962-294eb14bf739 tempest-VolumesNegativeTest-2027890769 tempest-VolumesNegativeTest-2027890769-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:14:47.158779 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-1ec246e4-d466-4af5-a962-294eb14bf739 tempest-VolumesNegativeTest-2027890769 tempest-VolumesNegativeTest-2027890769-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:14:47.159193 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.quota [None req-6d9deac0-a848-490a-8306-b924403f4240 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Getting quotas for user 64d54cb95b264c18b45d90822507fae1 and project 135367be6e3f4b3d965ee0d99fdca524. Resources: {'ram', 'instances', 'cores'} {{(pid=120798) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 07:14:47.159305 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-1ec246e4-d466-4af5-a962-294eb14bf739 tempest-VolumesNegativeTest-2027890769 tempest-VolumesNegativeTest-2027890769-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:14:47.159911 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-1ec246e4-d466-4af5-a962-294eb14bf739 tempest-VolumesNegativeTest-2027890769 tempest-VolumesNegativeTest-2027890769-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:14:47.160358 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-1ec246e4-d466-4af5-a962-294eb14bf739 tempest-VolumesNegativeTest-2027890769 tempest-VolumesNegativeTest-2027890769-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:14:47.160775 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-1ec246e4-d466-4af5-a962-294eb14bf739 tempest-VolumesNegativeTest-2027890769 tempest-VolumesNegativeTest-2027890769-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:14:47.174159 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.compute.api [None req-6d9deac0-a848-490a-8306-b924403f4240 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Going to run 1 instances... {{(pid=120798) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 23 07:14:47.177489 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.compute.api [None req-6d9deac0-a848-490a-8306-b924403f4240 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] [instance: b9418fe6-a57e-4a99-becb-19a4d3a52da1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b899fd65-02ae-4b43-bac7-86f38fc3f224',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120798) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 07:14:47.228685 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [None req-6d9deac0-a848-490a-8306-b924403f4240 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 0.615394 Aug 23 07:14:47.234067 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 157/323] 10.222.0.17 () {60 vars in 1147 bytes} [Tue Aug 23 07:14:46 2022] POST /compute/v2.1/servers => generated 408 bytes in 617 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 23 07:14:47.234279 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-8252bae8-55a3-4122-b171-1516cae47422 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Calling method '>' {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:14:47.234784 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.compute.api [None req-8252bae8-55a3-4122-b171-1516cae47422 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] [instance: ce9a9c42-b9ed-40b1-b72c-390b85578204] Fetching instance by UUID {{(pid=120798) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:14:47.241733 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-8252bae8-55a3-4122-b171-1516cae47422 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:14:47.242216 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-8252bae8-55a3-4122-b171-1516cae47422 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:14:47.242648 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-8252bae8-55a3-4122-b171-1516cae47422 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:14:47.243335 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-8252bae8-55a3-4122-b171-1516cae47422 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:14:47.243843 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-8252bae8-55a3-4122-b171-1516cae47422 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:14:47.244228 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-8252bae8-55a3-4122-b171-1516cae47422 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:14:47.341186 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.policy [None req-1ec246e4-d466-4af5-a962-294eb14bf739 tempest-VolumesNegativeTest-2027890769 tempest-VolumesNegativeTest-2027890769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ed299381d5b49fb8577287af4368fe1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d91979a6ce9468c990b9e08e267d329', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120799) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:14:47.349876 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-1ec246e4-d466-4af5-a962-294eb14bf739 tempest-VolumesNegativeTest-2027890769 tempest-VolumesNegativeTest-2027890769-project] 10.222.0.17 "GET /compute/v2.1/servers/52dfbaaf-557f-478e-bee8-e4856641b102" status: 200 len: 1314 microversion: 2.1 time: 0.204275 Aug 23 07:14:47.350701 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 167/324] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:14:47 2022] GET /compute/v2.1/servers/52dfbaaf-557f-478e-bee8-e4856641b102 => generated 1314 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 07:14:47.364209 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-e20504f1-0a4e-4895-bf5a-f46a80eb37bf tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Calling method '>' {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:14:47.364879 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.compute.api [None req-e20504f1-0a4e-4895-bf5a-f46a80eb37bf tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] [instance: b9418fe6-a57e-4a99-becb-19a4d3a52da1] Fetching instance by UUID {{(pid=120799) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:14:47.428713 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.policy [None req-e20504f1-0a4e-4895-bf5a-f46a80eb37bf tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64d54cb95b264c18b45d90822507fae1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135367be6e3f4b3d965ee0d99fdca524', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120799) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:14:47.435600 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.policy [None req-8252bae8-55a3-4122-b171-1516cae47422 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '471dc5c1db64411ab1d80ad6c038e519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb44f62fa62e46528712f24479cbb19f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120798) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:14:47.437589 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-e20504f1-0a4e-4895-bf5a-f46a80eb37bf tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] 10.222.0.17 "GET /compute/v2.1/servers/b9418fe6-a57e-4a99-becb-19a4d3a52da1" status: 200 len: 1245 microversion: 2.1 time: 0.085269 Aug 23 07:14:47.438408 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 168/325] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:14:47 2022] GET /compute/v2.1/servers/b9418fe6-a57e-4a99-becb-19a4d3a52da1 => generated 1245 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:14:47.443569 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [None req-8252bae8-55a3-4122-b171-1516cae47422 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] 10.222.0.17 "GET /compute/v2.1/servers/ce9a9c42-b9ed-40b1-b72c-390b85578204" status: 200 len: 1366 microversion: 2.1 time: 0.213215 Aug 23 07:14:47.444117 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 158/326] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:14:47 2022] GET /compute/v2.1/servers/ce9a9c42-b9ed-40b1-b72c-390b85578204 => generated 1366 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:14:47.587175 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-abc06115-7842-40e9-90dd-855faf18e375 tempest-VolumesActionsTest-775986377 tempest-VolumesActionsTest-775986377-project] Calling method '>' {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:14:47.588042 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.compute.api [None req-abc06115-7842-40e9-90dd-855faf18e375 tempest-VolumesActionsTest-775986377 tempest-VolumesActionsTest-775986377-project] [instance: 118d56f5-a1b4-402d-9e43-b432c2b63b14] Fetching instance by UUID {{(pid=120799) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:14:47.594674 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-abc06115-7842-40e9-90dd-855faf18e375 tempest-VolumesActionsTest-775986377 tempest-VolumesActionsTest-775986377-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:14:47.595157 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-abc06115-7842-40e9-90dd-855faf18e375 tempest-VolumesActionsTest-775986377 tempest-VolumesActionsTest-775986377-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:14:47.595877 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-abc06115-7842-40e9-90dd-855faf18e375 tempest-VolumesActionsTest-775986377 tempest-VolumesActionsTest-775986377-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:14:47.596572 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-abc06115-7842-40e9-90dd-855faf18e375 tempest-VolumesActionsTest-775986377 tempest-VolumesActionsTest-775986377-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:14:47.597027 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-abc06115-7842-40e9-90dd-855faf18e375 tempest-VolumesActionsTest-775986377 tempest-VolumesActionsTest-775986377-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:14:47.597447 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-abc06115-7842-40e9-90dd-855faf18e375 tempest-VolumesActionsTest-775986377 tempest-VolumesActionsTest-775986377-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:14:47.736232 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.policy [None req-abc06115-7842-40e9-90dd-855faf18e375 tempest-VolumesActionsTest-775986377 tempest-VolumesActionsTest-775986377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f4d65ffaab942f29d449b64805c765a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2ef3b6384a4194a26ba51078c425af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120799) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:14:47.744446 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-abc06115-7842-40e9-90dd-855faf18e375 tempest-VolumesActionsTest-775986377 tempest-VolumesActionsTest-775986377-project] 10.222.0.17 "GET /compute/v2.1/servers/118d56f5-a1b4-402d-9e43-b432c2b63b14" status: 200 len: 1312 microversion: 2.1 time: 0.161992 Aug 23 07:14:47.745149 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 169/327] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:14:47 2022] GET /compute/v2.1/servers/118d56f5-a1b4-402d-9e43-b432c2b63b14 => generated 1312 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:14:48.370452 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-4fbbe4be-75a4-4276-8dfc-80e03b73b588 tempest-VolumesNegativeTest-2027890769 tempest-VolumesNegativeTest-2027890769-project] Calling method '>' {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:14:48.371054 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.compute.api [None req-4fbbe4be-75a4-4276-8dfc-80e03b73b588 tempest-VolumesNegativeTest-2027890769 tempest-VolumesNegativeTest-2027890769-project] [instance: 52dfbaaf-557f-478e-bee8-e4856641b102] Fetching instance by UUID {{(pid=120798) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:14:48.380185 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-4fbbe4be-75a4-4276-8dfc-80e03b73b588 tempest-VolumesNegativeTest-2027890769 tempest-VolumesNegativeTest-2027890769-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:14:48.380674 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-4fbbe4be-75a4-4276-8dfc-80e03b73b588 tempest-VolumesNegativeTest-2027890769 tempest-VolumesNegativeTest-2027890769-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:14:48.381105 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-4fbbe4be-75a4-4276-8dfc-80e03b73b588 tempest-VolumesNegativeTest-2027890769 tempest-VolumesNegativeTest-2027890769-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:14:48.381766 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-4fbbe4be-75a4-4276-8dfc-80e03b73b588 tempest-VolumesNegativeTest-2027890769 tempest-VolumesNegativeTest-2027890769-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:14:48.382383 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-4fbbe4be-75a4-4276-8dfc-80e03b73b588 tempest-VolumesNegativeTest-2027890769 tempest-VolumesNegativeTest-2027890769-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:14:48.382994 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-4fbbe4be-75a4-4276-8dfc-80e03b73b588 tempest-VolumesNegativeTest-2027890769 tempest-VolumesNegativeTest-2027890769-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:14:48.458642 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-c14e73e6-3231-4f2f-a3aa-9f5aa583c91c tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Calling method '>' {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:14:48.460248 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.compute.api [None req-c14e73e6-3231-4f2f-a3aa-9f5aa583c91c tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] [instance: b9418fe6-a57e-4a99-becb-19a4d3a52da1] Fetching instance by UUID {{(pid=120799) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:14:48.467605 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-c14e73e6-3231-4f2f-a3aa-9f5aa583c91c tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:14:48.468126 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-c14e73e6-3231-4f2f-a3aa-9f5aa583c91c tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:14:48.468810 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-c14e73e6-3231-4f2f-a3aa-9f5aa583c91c tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:14:48.470339 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-c14e73e6-3231-4f2f-a3aa-9f5aa583c91c tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:14:48.472455 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-c14e73e6-3231-4f2f-a3aa-9f5aa583c91c tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:14:48.473161 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-c14e73e6-3231-4f2f-a3aa-9f5aa583c91c tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:14:48.559230 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.policy [None req-c14e73e6-3231-4f2f-a3aa-9f5aa583c91c tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64d54cb95b264c18b45d90822507fae1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135367be6e3f4b3d965ee0d99fdca524', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120799) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:14:48.563365 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.policy [None req-4fbbe4be-75a4-4276-8dfc-80e03b73b588 tempest-VolumesNegativeTest-2027890769 tempest-VolumesNegativeTest-2027890769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ed299381d5b49fb8577287af4368fe1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d91979a6ce9468c990b9e08e267d329', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120798) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:14:48.567834 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-c14e73e6-3231-4f2f-a3aa-9f5aa583c91c tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] 10.222.0.17 "GET /compute/v2.1/servers/b9418fe6-a57e-4a99-becb-19a4d3a52da1" status: 200 len: 1297 microversion: 2.1 time: 0.113523 Aug 23 07:14:48.568411 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 170/328] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:14:48 2022] GET /compute/v2.1/servers/b9418fe6-a57e-4a99-becb-19a4d3a52da1 => generated 1297 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 07:14:48.571324 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [None req-4fbbe4be-75a4-4276-8dfc-80e03b73b588 tempest-VolumesNegativeTest-2027890769 tempest-VolumesNegativeTest-2027890769-project] 10.222.0.17 "GET /compute/v2.1/servers/52dfbaaf-557f-478e-bee8-e4856641b102" status: 200 len: 1463 microversion: 2.1 time: 0.204844 Aug 23 07:14:48.571983 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 159/329] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:14:48 2022] GET /compute/v2.1/servers/52dfbaaf-557f-478e-bee8-e4856641b102 => generated 1463 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:14:48.579435 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-0d775125-7e42-41c2-ab86-0b7709c9886e tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Calling method '>' {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:14:48.580113 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.compute.api [None req-0d775125-7e42-41c2-ab86-0b7709c9886e tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] [instance: ce9a9c42-b9ed-40b1-b72c-390b85578204] Fetching instance by UUID {{(pid=120799) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:14:48.587690 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-0d775125-7e42-41c2-ab86-0b7709c9886e tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:14:48.588242 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-0d775125-7e42-41c2-ab86-0b7709c9886e tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:14:48.588785 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-0d775125-7e42-41c2-ab86-0b7709c9886e tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:14:48.589469 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-0d775125-7e42-41c2-ab86-0b7709c9886e tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:14:48.589944 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-0d775125-7e42-41c2-ab86-0b7709c9886e tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:14:48.590368 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-0d775125-7e42-41c2-ab86-0b7709c9886e tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:14:48.621801 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-54cde335-14ce-40a7-b7aa-edf463a0b6e9 tempest-VolumesNegativeTest-2027890769 tempest-VolumesNegativeTest-2027890769-project] Calling method '>' {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:14:48.622283 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.compute.api [None req-54cde335-14ce-40a7-b7aa-edf463a0b6e9 tempest-VolumesNegativeTest-2027890769 tempest-VolumesNegativeTest-2027890769-project] [instance: 52dfbaaf-557f-478e-bee8-e4856641b102] Fetching instance by UUID {{(pid=120798) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:14:48.628507 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-54cde335-14ce-40a7-b7aa-edf463a0b6e9 tempest-VolumesNegativeTest-2027890769 tempest-VolumesNegativeTest-2027890769-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:14:48.628981 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-54cde335-14ce-40a7-b7aa-edf463a0b6e9 tempest-VolumesNegativeTest-2027890769 tempest-VolumesNegativeTest-2027890769-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:14:48.629401 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-54cde335-14ce-40a7-b7aa-edf463a0b6e9 tempest-VolumesNegativeTest-2027890769 tempest-VolumesNegativeTest-2027890769-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:14:48.630108 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-54cde335-14ce-40a7-b7aa-edf463a0b6e9 tempest-VolumesNegativeTest-2027890769 tempest-VolumesNegativeTest-2027890769-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:14:48.630545 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-54cde335-14ce-40a7-b7aa-edf463a0b6e9 tempest-VolumesNegativeTest-2027890769 tempest-VolumesNegativeTest-2027890769-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:14:48.630953 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-54cde335-14ce-40a7-b7aa-edf463a0b6e9 tempest-VolumesNegativeTest-2027890769 tempest-VolumesNegativeTest-2027890769-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:14:48.656695 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.compute.api [None req-54cde335-14ce-40a7-b7aa-edf463a0b6e9 tempest-VolumesNegativeTest-2027890769 tempest-VolumesNegativeTest-2027890769-project] [instance: 52dfbaaf-557f-478e-bee8-e4856641b102] Going to try to terminate instance {{(pid=120798) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 07:14:48.741029 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [None req-54cde335-14ce-40a7-b7aa-edf463a0b6e9 tempest-VolumesNegativeTest-2027890769 tempest-VolumesNegativeTest-2027890769-project] 10.222.0.17 "DELETE /compute/v2.1/servers/52dfbaaf-557f-478e-bee8-e4856641b102" status: 204 len: 0 microversion: 2.1 time: 0.122871 Aug 23 07:14:48.741625 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 160/330] 10.222.0.17 () {58 vars in 1239 bytes} [Tue Aug 23 07:14:48 2022] DELETE /compute/v2.1/servers/52dfbaaf-557f-478e-bee8-e4856641b102 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 23 07:14:48.751152 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-d01ead10-cca6-4d76-9b95-abe91aa381cc tempest-VolumesNegativeTest-2027890769 tempest-VolumesNegativeTest-2027890769-project] Calling method '>' {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:14:48.751892 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.compute.api [None req-d01ead10-cca6-4d76-9b95-abe91aa381cc tempest-VolumesNegativeTest-2027890769 tempest-VolumesNegativeTest-2027890769-project] [instance: 52dfbaaf-557f-478e-bee8-e4856641b102] Fetching instance by UUID {{(pid=120798) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:14:48.758215 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-d01ead10-cca6-4d76-9b95-abe91aa381cc tempest-VolumesNegativeTest-2027890769 tempest-VolumesNegativeTest-2027890769-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:14:48.758691 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-d01ead10-cca6-4d76-9b95-abe91aa381cc tempest-VolumesNegativeTest-2027890769 tempest-VolumesNegativeTest-2027890769-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:14:48.759111 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-d01ead10-cca6-4d76-9b95-abe91aa381cc tempest-VolumesNegativeTest-2027890769 tempest-VolumesNegativeTest-2027890769-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:14:48.761089 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-d01ead10-cca6-4d76-9b95-abe91aa381cc tempest-VolumesNegativeTest-2027890769 tempest-VolumesNegativeTest-2027890769-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:14:48.761089 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-d01ead10-cca6-4d76-9b95-abe91aa381cc tempest-VolumesNegativeTest-2027890769 tempest-VolumesNegativeTest-2027890769-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:14:48.761089 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-d01ead10-cca6-4d76-9b95-abe91aa381cc tempest-VolumesNegativeTest-2027890769 tempest-VolumesNegativeTest-2027890769-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:14:48.766363 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG dbcounter [-] [120798] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120798) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:14:49.043862 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.policy [None req-0d775125-7e42-41c2-ab86-0b7709c9886e tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '471dc5c1db64411ab1d80ad6c038e519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb44f62fa62e46528712f24479cbb19f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120799) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:14:49.046875 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.policy [None req-d01ead10-cca6-4d76-9b95-abe91aa381cc tempest-VolumesNegativeTest-2027890769 tempest-VolumesNegativeTest-2027890769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ed299381d5b49fb8577287af4368fe1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d91979a6ce9468c990b9e08e267d329', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120798) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:14:49.050331 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG dbcounter [-] [120799] Writing DB stats nova_cell1:SELECT=100 {{(pid=120799) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:14:49.055202 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [None req-d01ead10-cca6-4d76-9b95-abe91aa381cc tempest-VolumesNegativeTest-2027890769 tempest-VolumesNegativeTest-2027890769-project] 10.222.0.17 "GET /compute/v2.1/servers/52dfbaaf-557f-478e-bee8-e4856641b102" status: 200 len: 1469 microversion: 2.1 time: 0.308679 Aug 23 07:14:49.061613 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 161/331] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:14:48 2022] GET /compute/v2.1/servers/52dfbaaf-557f-478e-bee8-e4856641b102 => generated 1469 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 07:14:49.061613 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-4b57491c-38db-4318-a274-8c044c03aabb tempest-VolumesActionsTest-775986377 tempest-VolumesActionsTest-775986377-project] Calling method '>' {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:14:49.061613 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.compute.api [None req-4b57491c-38db-4318-a274-8c044c03aabb tempest-VolumesActionsTest-775986377 tempest-VolumesActionsTest-775986377-project] [instance: 118d56f5-a1b4-402d-9e43-b432c2b63b14] Fetching instance by UUID {{(pid=120798) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:14:49.065384 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-0d775125-7e42-41c2-ab86-0b7709c9886e tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] 10.222.0.17 "GET /compute/v2.1/servers/ce9a9c42-b9ed-40b1-b72c-390b85578204" status: 200 len: 1366 microversion: 2.1 time: 0.490404 Aug 23 07:14:49.066317 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 171/332] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:14:48 2022] GET /compute/v2.1/servers/ce9a9c42-b9ed-40b1-b72c-390b85578204 => generated 1366 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:14:49.076689 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-4b57491c-38db-4318-a274-8c044c03aabb tempest-VolumesActionsTest-775986377 tempest-VolumesActionsTest-775986377-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:14:49.077340 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-4b57491c-38db-4318-a274-8c044c03aabb tempest-VolumesActionsTest-775986377 tempest-VolumesActionsTest-775986377-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:14:49.077915 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-4b57491c-38db-4318-a274-8c044c03aabb tempest-VolumesActionsTest-775986377 tempest-VolumesActionsTest-775986377-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:14:49.078802 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-4b57491c-38db-4318-a274-8c044c03aabb tempest-VolumesActionsTest-775986377 tempest-VolumesActionsTest-775986377-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:14:49.079398 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-4b57491c-38db-4318-a274-8c044c03aabb tempest-VolumesActionsTest-775986377 tempest-VolumesActionsTest-775986377-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:14:49.080292 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-4b57491c-38db-4318-a274-8c044c03aabb tempest-VolumesActionsTest-775986377 tempest-VolumesActionsTest-775986377-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:14:49.260686 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.policy [None req-4b57491c-38db-4318-a274-8c044c03aabb tempest-VolumesActionsTest-775986377 tempest-VolumesActionsTest-775986377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f4d65ffaab942f29d449b64805c765a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2ef3b6384a4194a26ba51078c425af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120798) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:14:49.269202 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [None req-4b57491c-38db-4318-a274-8c044c03aabb tempest-VolumesActionsTest-775986377 tempest-VolumesActionsTest-775986377-project] 10.222.0.17 "GET /compute/v2.1/servers/118d56f5-a1b4-402d-9e43-b432c2b63b14" status: 200 len: 1312 microversion: 2.1 time: 0.212008 Aug 23 07:14:49.275989 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 162/333] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:14:49 2022] GET /compute/v2.1/servers/118d56f5-a1b4-402d-9e43-b432c2b63b14 => generated 1312 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:14:49.589770 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-dbef2f3f-561b-472e-81fe-617d94679e38 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Calling method '>' {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:14:49.590440 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.compute.api [None req-dbef2f3f-561b-472e-81fe-617d94679e38 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] [instance: b9418fe6-a57e-4a99-becb-19a4d3a52da1] Fetching instance by UUID {{(pid=120799) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:14:49.597892 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-dbef2f3f-561b-472e-81fe-617d94679e38 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:14:49.598371 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-dbef2f3f-561b-472e-81fe-617d94679e38 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:14:49.598794 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-dbef2f3f-561b-472e-81fe-617d94679e38 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:14:49.599494 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-dbef2f3f-561b-472e-81fe-617d94679e38 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:14:49.599936 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-dbef2f3f-561b-472e-81fe-617d94679e38 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:14:49.600349 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-dbef2f3f-561b-472e-81fe-617d94679e38 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:14:49.679010 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.policy [None req-dbef2f3f-561b-472e-81fe-617d94679e38 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64d54cb95b264c18b45d90822507fae1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135367be6e3f4b3d965ee0d99fdca524', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120799) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:14:49.687216 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-dbef2f3f-561b-472e-81fe-617d94679e38 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] 10.222.0.17 "GET /compute/v2.1/servers/b9418fe6-a57e-4a99-becb-19a4d3a52da1" status: 200 len: 1297 microversion: 2.1 time: 0.102451 Aug 23 07:14:49.688117 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 172/334] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:14:49 2022] GET /compute/v2.1/servers/b9418fe6-a57e-4a99-becb-19a4d3a52da1 => generated 1297 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:14:50.013588 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [req-b0871aca-d293-47fd-b4df-3ada197c92ca req-78b583b7-3b81-4a1f-9e96-f59614376db6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ce9a9c42-b9ed-40b1-b72c-390b85578204", "name": "network-vif-plugged", "status": "completed", "tag": "934b5d8d-aefe-4c06-83af-f3bb1ed3c80c"}]} {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 07:14:50.024388 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [req-b0871aca-d293-47fd-b4df-3ada197c92ca req-78b583b7-3b81-4a1f-9e96-f59614376db6 service nova] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:14:50.024771 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [req-b0871aca-d293-47fd-b4df-3ada197c92ca req-78b583b7-3b81-4a1f-9e96-f59614376db6 service nova] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:14:50.025387 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [req-b0871aca-d293-47fd-b4df-3ada197c92ca req-78b583b7-3b81-4a1f-9e96-f59614376db6 service nova] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:14:50.040075 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.compute.server_external_events [req-b0871aca-d293-47fd-b4df-3ada197c92ca req-78b583b7-3b81-4a1f-9e96-f59614376db6 service nova] Creating event network-vif-plugged:934b5d8d-aefe-4c06-83af-f3bb1ed3c80c for instance ce9a9c42-b9ed-40b1-b72c-390b85578204 on hv-cinder-85409 Aug 23 07:14:50.045502 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [req-b0871aca-d293-47fd-b4df-3ada197c92ca req-78b583b7-3b81-4a1f-9e96-f59614376db6 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036192 Aug 23 07:14:50.046096 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 163/335] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Aug 23 07:14:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 07:14:50.089348 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-234b5b95-007d-41a9-846b-326da287a48c tempest-VolumesNegativeTest-2027890769 tempest-VolumesNegativeTest-2027890769-project] Calling method '>' {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:14:50.090810 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-98e554bf-6b2f-4b71-bf72-4c269dc4dd30 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Calling method '>' {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:14:50.091467 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.compute.api [None req-234b5b95-007d-41a9-846b-326da287a48c tempest-VolumesNegativeTest-2027890769 tempest-VolumesNegativeTest-2027890769-project] [instance: 52dfbaaf-557f-478e-bee8-e4856641b102] Fetching instance by UUID {{(pid=120799) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:14:50.091621 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.compute.api [None req-98e554bf-6b2f-4b71-bf72-4c269dc4dd30 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] [instance: ce9a9c42-b9ed-40b1-b72c-390b85578204] Fetching instance by UUID {{(pid=120798) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:14:50.098887 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-98e554bf-6b2f-4b71-bf72-4c269dc4dd30 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:14:50.099329 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-98e554bf-6b2f-4b71-bf72-4c269dc4dd30 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:14:50.100015 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-98e554bf-6b2f-4b71-bf72-4c269dc4dd30 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:14:50.100831 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-98e554bf-6b2f-4b71-bf72-4c269dc4dd30 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:14:50.101037 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-234b5b95-007d-41a9-846b-326da287a48c tempest-VolumesNegativeTest-2027890769 tempest-VolumesNegativeTest-2027890769-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:14:50.101343 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-98e554bf-6b2f-4b71-bf72-4c269dc4dd30 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:14:50.101519 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-234b5b95-007d-41a9-846b-326da287a48c tempest-VolumesNegativeTest-2027890769 tempest-VolumesNegativeTest-2027890769-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:14:50.101790 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-98e554bf-6b2f-4b71-bf72-4c269dc4dd30 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:14:50.101946 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-234b5b95-007d-41a9-846b-326da287a48c tempest-VolumesNegativeTest-2027890769 tempest-VolumesNegativeTest-2027890769-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:14:50.106274 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-234b5b95-007d-41a9-846b-326da287a48c tempest-VolumesNegativeTest-2027890769 tempest-VolumesNegativeTest-2027890769-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:14:50.106733 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-234b5b95-007d-41a9-846b-326da287a48c tempest-VolumesNegativeTest-2027890769 tempest-VolumesNegativeTest-2027890769-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:14:50.107165 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-234b5b95-007d-41a9-846b-326da287a48c tempest-VolumesNegativeTest-2027890769 tempest-VolumesNegativeTest-2027890769-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:14:50.304339 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.policy [None req-98e554bf-6b2f-4b71-bf72-4c269dc4dd30 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '471dc5c1db64411ab1d80ad6c038e519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb44f62fa62e46528712f24479cbb19f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120798) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:14:50.317910 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [None req-98e554bf-6b2f-4b71-bf72-4c269dc4dd30 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] 10.222.0.17 "GET /compute/v2.1/servers/ce9a9c42-b9ed-40b1-b72c-390b85578204" status: 200 len: 1366 microversion: 2.1 time: 0.231379 Aug 23 07:14:50.320636 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 164/336] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:14:50 2022] GET /compute/v2.1/servers/ce9a9c42-b9ed-40b1-b72c-390b85578204 => generated 1366 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 07:14:50.327776 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-93426538-7d66-4394-bec6-39687e17df48 tempest-VolumesActionsTest-775986377 tempest-VolumesActionsTest-775986377-project] Calling method '>' {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:14:50.328704 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.compute.api [None req-93426538-7d66-4394-bec6-39687e17df48 tempest-VolumesActionsTest-775986377 tempest-VolumesActionsTest-775986377-project] [instance: 118d56f5-a1b4-402d-9e43-b432c2b63b14] Fetching instance by UUID {{(pid=120798) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:14:50.336988 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-93426538-7d66-4394-bec6-39687e17df48 tempest-VolumesActionsTest-775986377 tempest-VolumesActionsTest-775986377-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:14:50.337672 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-93426538-7d66-4394-bec6-39687e17df48 tempest-VolumesActionsTest-775986377 tempest-VolumesActionsTest-775986377-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:14:50.338357 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-93426538-7d66-4394-bec6-39687e17df48 tempest-VolumesActionsTest-775986377 tempest-VolumesActionsTest-775986377-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:14:50.339282 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-93426538-7d66-4394-bec6-39687e17df48 tempest-VolumesActionsTest-775986377 tempest-VolumesActionsTest-775986377-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:14:50.340008 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-93426538-7d66-4394-bec6-39687e17df48 tempest-VolumesActionsTest-775986377 tempest-VolumesActionsTest-775986377-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:14:50.340598 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-93426538-7d66-4394-bec6-39687e17df48 tempest-VolumesActionsTest-775986377 tempest-VolumesActionsTest-775986377-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:14:50.351027 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.policy [None req-234b5b95-007d-41a9-846b-326da287a48c tempest-VolumesNegativeTest-2027890769 tempest-VolumesNegativeTest-2027890769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ed299381d5b49fb8577287af4368fe1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d91979a6ce9468c990b9e08e267d329', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120799) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:14:50.359222 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-234b5b95-007d-41a9-846b-326da287a48c tempest-VolumesNegativeTest-2027890769 tempest-VolumesNegativeTest-2027890769-project] 10.222.0.17 "GET /compute/v2.1/servers/52dfbaaf-557f-478e-bee8-e4856641b102" status: 200 len: 1469 microversion: 2.1 time: 0.284959 Aug 23 07:14:50.360615 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 173/337] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:14:50 2022] GET /compute/v2.1/servers/52dfbaaf-557f-478e-bee8-e4856641b102 => generated 1469 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:14:50.484971 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.policy [None req-93426538-7d66-4394-bec6-39687e17df48 tempest-VolumesActionsTest-775986377 tempest-VolumesActionsTest-775986377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f4d65ffaab942f29d449b64805c765a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2ef3b6384a4194a26ba51078c425af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120798) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:14:50.498896 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [None req-93426538-7d66-4394-bec6-39687e17df48 tempest-VolumesActionsTest-775986377 tempest-VolumesActionsTest-775986377-project] 10.222.0.17 "GET /compute/v2.1/servers/118d56f5-a1b4-402d-9e43-b432c2b63b14" status: 200 len: 1312 microversion: 2.1 time: 0.171803 Aug 23 07:14:50.498896 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 165/338] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:14:50 2022] GET /compute/v2.1/servers/118d56f5-a1b4-402d-9e43-b432c2b63b14 => generated 1312 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:14:50.709960 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-749f7864-9355-4bed-aca6-166717867c31 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Calling method '>' {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:14:50.710708 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.compute.api [None req-749f7864-9355-4bed-aca6-166717867c31 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] [instance: b9418fe6-a57e-4a99-becb-19a4d3a52da1] Fetching instance by UUID {{(pid=120799) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:14:50.718346 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-749f7864-9355-4bed-aca6-166717867c31 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:14:50.719029 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-749f7864-9355-4bed-aca6-166717867c31 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:14:50.719639 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-749f7864-9355-4bed-aca6-166717867c31 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:14:50.720488 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-749f7864-9355-4bed-aca6-166717867c31 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:14:50.721238 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-749f7864-9355-4bed-aca6-166717867c31 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:14:50.721807 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-749f7864-9355-4bed-aca6-166717867c31 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:14:50.787604 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.policy [None req-749f7864-9355-4bed-aca6-166717867c31 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64d54cb95b264c18b45d90822507fae1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135367be6e3f4b3d965ee0d99fdca524', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120799) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:14:50.796156 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-749f7864-9355-4bed-aca6-166717867c31 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] 10.222.0.17 "GET /compute/v2.1/servers/b9418fe6-a57e-4a99-becb-19a4d3a52da1" status: 200 len: 1305 microversion: 2.1 time: 0.090532 Aug 23 07:14:50.796943 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 174/339] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:14:50 2022] GET /compute/v2.1/servers/b9418fe6-a57e-4a99-becb-19a4d3a52da1 => generated 1305 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:14:51.342110 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-d734cfd4-7161-4415-8a0d-6680b472c3c3 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Calling method '>' {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:14:51.343335 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.compute.api [None req-d734cfd4-7161-4415-8a0d-6680b472c3c3 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] [instance: ce9a9c42-b9ed-40b1-b72c-390b85578204] Fetching instance by UUID {{(pid=120798) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:14:51.350827 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-d734cfd4-7161-4415-8a0d-6680b472c3c3 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:14:51.351776 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-d734cfd4-7161-4415-8a0d-6680b472c3c3 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:14:51.352385 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-d734cfd4-7161-4415-8a0d-6680b472c3c3 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:14:51.353254 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-d734cfd4-7161-4415-8a0d-6680b472c3c3 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:14:51.353935 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-d734cfd4-7161-4415-8a0d-6680b472c3c3 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:14:51.354673 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-d734cfd4-7161-4415-8a0d-6680b472c3c3 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:14:51.382080 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-c90fa6e6-e6bc-4acb-87e5-dd1054f24ee0 tempest-VolumesNegativeTest-2027890769 tempest-VolumesNegativeTest-2027890769-project] Calling method '>' {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:14:51.383013 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.compute.api [None req-c90fa6e6-e6bc-4acb-87e5-dd1054f24ee0 tempest-VolumesNegativeTest-2027890769 tempest-VolumesNegativeTest-2027890769-project] [instance: 52dfbaaf-557f-478e-bee8-e4856641b102] Fetching instance by UUID {{(pid=120799) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:14:51.392769 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-c90fa6e6-e6bc-4acb-87e5-dd1054f24ee0 tempest-VolumesNegativeTest-2027890769 tempest-VolumesNegativeTest-2027890769-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:14:51.395389 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-c90fa6e6-e6bc-4acb-87e5-dd1054f24ee0 tempest-VolumesNegativeTest-2027890769 tempest-VolumesNegativeTest-2027890769-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:14:51.396119 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-c90fa6e6-e6bc-4acb-87e5-dd1054f24ee0 tempest-VolumesNegativeTest-2027890769 tempest-VolumesNegativeTest-2027890769-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:14:51.398538 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-c90fa6e6-e6bc-4acb-87e5-dd1054f24ee0 tempest-VolumesNegativeTest-2027890769 tempest-VolumesNegativeTest-2027890769-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:14:51.399495 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-c90fa6e6-e6bc-4acb-87e5-dd1054f24ee0 tempest-VolumesNegativeTest-2027890769 tempest-VolumesNegativeTest-2027890769-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:14:51.401629 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-c90fa6e6-e6bc-4acb-87e5-dd1054f24ee0 tempest-VolumesNegativeTest-2027890769 tempest-VolumesNegativeTest-2027890769-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:14:51.872885 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.policy [None req-d734cfd4-7161-4415-8a0d-6680b472c3c3 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '471dc5c1db64411ab1d80ad6c038e519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb44f62fa62e46528712f24479cbb19f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120798) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:14:51.890859 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [None req-d734cfd4-7161-4415-8a0d-6680b472c3c3 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] 10.222.0.17 "GET /compute/v2.1/servers/ce9a9c42-b9ed-40b1-b72c-390b85578204" status: 200 len: 1366 microversion: 2.1 time: 0.551842 Aug 23 07:14:51.891832 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 166/340] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:14:51 2022] GET /compute/v2.1/servers/ce9a9c42-b9ed-40b1-b72c-390b85578204 => generated 1366 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:14:51.909243 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-d3586f3b-2d0e-43e3-9696-4260a0de61c5 tempest-VolumesActionsTest-775986377 tempest-VolumesActionsTest-775986377-project] Calling method '>' {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:14:51.912204 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.compute.api [None req-d3586f3b-2d0e-43e3-9696-4260a0de61c5 tempest-VolumesActionsTest-775986377 tempest-VolumesActionsTest-775986377-project] [instance: 118d56f5-a1b4-402d-9e43-b432c2b63b14] Fetching instance by UUID {{(pid=120798) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:14:51.929429 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-d3586f3b-2d0e-43e3-9696-4260a0de61c5 tempest-VolumesActionsTest-775986377 tempest-VolumesActionsTest-775986377-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:14:51.930706 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-d3586f3b-2d0e-43e3-9696-4260a0de61c5 tempest-VolumesActionsTest-775986377 tempest-VolumesActionsTest-775986377-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:14:51.931789 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-d3586f3b-2d0e-43e3-9696-4260a0de61c5 tempest-VolumesActionsTest-775986377 tempest-VolumesActionsTest-775986377-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:14:51.932807 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-d3586f3b-2d0e-43e3-9696-4260a0de61c5 tempest-VolumesActionsTest-775986377 tempest-VolumesActionsTest-775986377-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:14:51.935103 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-d3586f3b-2d0e-43e3-9696-4260a0de61c5 tempest-VolumesActionsTest-775986377 tempest-VolumesActionsTest-775986377-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:14:51.935817 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-d3586f3b-2d0e-43e3-9696-4260a0de61c5 tempest-VolumesActionsTest-775986377 tempest-VolumesActionsTest-775986377-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:14:51.944447 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.policy [None req-c90fa6e6-e6bc-4acb-87e5-dd1054f24ee0 tempest-VolumesNegativeTest-2027890769 tempest-VolumesNegativeTest-2027890769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ed299381d5b49fb8577287af4368fe1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d91979a6ce9468c990b9e08e267d329', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120799) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:14:51.953831 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-c90fa6e6-e6bc-4acb-87e5-dd1054f24ee0 tempest-VolumesNegativeTest-2027890769 tempest-VolumesNegativeTest-2027890769-project] 10.222.0.17 "GET /compute/v2.1/servers/52dfbaaf-557f-478e-bee8-e4856641b102" status: 200 len: 1469 microversion: 2.1 time: 0.576541 Aug 23 07:14:51.954450 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 175/341] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:14:51 2022] GET /compute/v2.1/servers/52dfbaaf-557f-478e-bee8-e4856641b102 => generated 1469 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:14:51.964403 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-fc8c7937-694d-490d-adbd-f5bb02b7849c tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Calling method '>' {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:14:51.965283 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.compute.api [None req-fc8c7937-694d-490d-adbd-f5bb02b7849c tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] [instance: b9418fe6-a57e-4a99-becb-19a4d3a52da1] Fetching instance by UUID {{(pid=120799) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:14:51.981264 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-fc8c7937-694d-490d-adbd-f5bb02b7849c tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:14:51.982189 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-fc8c7937-694d-490d-adbd-f5bb02b7849c tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:14:51.983370 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-fc8c7937-694d-490d-adbd-f5bb02b7849c tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:14:51.984846 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-fc8c7937-694d-490d-adbd-f5bb02b7849c tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:14:51.985832 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-fc8c7937-694d-490d-adbd-f5bb02b7849c tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:14:51.986263 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-fc8c7937-694d-490d-adbd-f5bb02b7849c tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:14:52.089411 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.policy [None req-fc8c7937-694d-490d-adbd-f5bb02b7849c tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64d54cb95b264c18b45d90822507fae1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135367be6e3f4b3d965ee0d99fdca524', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120799) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:14:52.108212 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-fc8c7937-694d-490d-adbd-f5bb02b7849c tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] 10.222.0.17 "GET /compute/v2.1/servers/b9418fe6-a57e-4a99-becb-19a4d3a52da1" status: 200 len: 1303 microversion: 2.1 time: 0.150215 Aug 23 07:14:52.124898 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 176/342] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:14:51 2022] GET /compute/v2.1/servers/b9418fe6-a57e-4a99-becb-19a4d3a52da1 => generated 1303 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:14:52.246605 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.policy [None req-d3586f3b-2d0e-43e3-9696-4260a0de61c5 tempest-VolumesActionsTest-775986377 tempest-VolumesActionsTest-775986377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f4d65ffaab942f29d449b64805c765a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2ef3b6384a4194a26ba51078c425af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120798) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:14:52.258772 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [None req-d3586f3b-2d0e-43e3-9696-4260a0de61c5 tempest-VolumesActionsTest-775986377 tempest-VolumesActionsTest-775986377-project] 10.222.0.17 "GET /compute/v2.1/servers/118d56f5-a1b4-402d-9e43-b432c2b63b14" status: 200 len: 1495 microversion: 2.1 time: 0.362657 Aug 23 07:14:52.260276 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 167/343] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:14:51 2022] GET /compute/v2.1/servers/118d56f5-a1b4-402d-9e43-b432c2b63b14 => generated 1495 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:14:52.313293 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [req-a16197f9-e331-4876-a5b7-9109274c2001 req-d302f238-fb63-428b-a759-f543f2e4a3fd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "52dfbaaf-557f-478e-bee8-e4856641b102", "name": "network-vif-deleted", "tag": "7a88af17-4e94-444a-bfe6-7115e2a6bf50"}]} {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 07:14:52.341761 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [req-a16197f9-e331-4876-a5b7-9109274c2001 req-d302f238-fb63-428b-a759-f543f2e4a3fd service nova] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:14:52.342944 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [req-a16197f9-e331-4876-a5b7-9109274c2001 req-d302f238-fb63-428b-a759-f543f2e4a3fd service nova] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:14:52.345859 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [req-a16197f9-e331-4876-a5b7-9109274c2001 req-d302f238-fb63-428b-a759-f543f2e4a3fd service nova] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:14:52.375925 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.compute.server_external_events [req-a16197f9-e331-4876-a5b7-9109274c2001 req-d302f238-fb63-428b-a759-f543f2e4a3fd service nova] Creating event network-vif-deleted:7a88af17-4e94-444a-bfe6-7115e2a6bf50 for instance 52dfbaaf-557f-478e-bee8-e4856641b102 on hv-cinder-85409 Aug 23 07:14:52.383811 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [req-a16197f9-e331-4876-a5b7-9109274c2001 req-d302f238-fb63-428b-a759-f543f2e4a3fd service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074751 Aug 23 07:14:52.384870 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 177/344] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Aug 23 07:14:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 07:14:52.869971 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-f536254f-7873-41c0-8277-f02a6dec9504 tempest-VolumesActionsTest-775986377 tempest-VolumesActionsTest-775986377-project] Calling method '>' {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:14:52.871870 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.compute.api [None req-f536254f-7873-41c0-8277-f02a6dec9504 tempest-VolumesActionsTest-775986377 tempest-VolumesActionsTest-775986377-project] [instance: 118d56f5-a1b4-402d-9e43-b432c2b63b14] Fetching instance by UUID {{(pid=120798) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:14:52.880118 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-f536254f-7873-41c0-8277-f02a6dec9504 tempest-VolumesActionsTest-775986377 tempest-VolumesActionsTest-775986377-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:14:52.880860 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-f536254f-7873-41c0-8277-f02a6dec9504 tempest-VolumesActionsTest-775986377 tempest-VolumesActionsTest-775986377-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:14:52.881546 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-f536254f-7873-41c0-8277-f02a6dec9504 tempest-VolumesActionsTest-775986377 tempest-VolumesActionsTest-775986377-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:14:52.882286 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-f536254f-7873-41c0-8277-f02a6dec9504 tempest-VolumesActionsTest-775986377 tempest-VolumesActionsTest-775986377-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:14:52.882938 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-f536254f-7873-41c0-8277-f02a6dec9504 tempest-VolumesActionsTest-775986377 tempest-VolumesActionsTest-775986377-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:14:52.883353 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-f536254f-7873-41c0-8277-f02a6dec9504 tempest-VolumesActionsTest-775986377 tempest-VolumesActionsTest-775986377-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:14:52.914735 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-11819cc8-740d-4c91-a284-12752b1a87bd tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Calling method '>' {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:14:52.915630 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.compute.api [None req-11819cc8-740d-4c91-a284-12752b1a87bd tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] [instance: ce9a9c42-b9ed-40b1-b72c-390b85578204] Fetching instance by UUID {{(pid=120799) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:14:52.924769 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.compute.api [None req-f536254f-7873-41c0-8277-f02a6dec9504 tempest-VolumesActionsTest-775986377 tempest-VolumesActionsTest-775986377-project] [instance: 118d56f5-a1b4-402d-9e43-b432c2b63b14] Going to try to terminate instance {{(pid=120798) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 07:14:52.935171 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-11819cc8-740d-4c91-a284-12752b1a87bd tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:14:52.936548 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-11819cc8-740d-4c91-a284-12752b1a87bd tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:14:52.938069 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-11819cc8-740d-4c91-a284-12752b1a87bd tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:14:52.939322 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-11819cc8-740d-4c91-a284-12752b1a87bd tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:14:52.940234 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-11819cc8-740d-4c91-a284-12752b1a87bd tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:14:52.940861 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-11819cc8-740d-4c91-a284-12752b1a87bd tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:14:53.025227 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [None req-f536254f-7873-41c0-8277-f02a6dec9504 tempest-VolumesActionsTest-775986377 tempest-VolumesActionsTest-775986377-project] 10.222.0.17 "DELETE /compute/v2.1/servers/118d56f5-a1b4-402d-9e43-b432c2b63b14" status: 204 len: 0 microversion: 2.1 time: 0.159679 Aug 23 07:14:53.030151 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 168/345] 10.222.0.17 () {58 vars in 1239 bytes} [Tue Aug 23 07:14:52 2022] DELETE /compute/v2.1/servers/118d56f5-a1b4-402d-9e43-b432c2b63b14 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 23 07:14:53.036626 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-d1e8186b-516d-48ec-b174-7424bb2c9c7c tempest-VolumesNegativeTest-2027890769 tempest-VolumesNegativeTest-2027890769-project] Calling method '>' {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:14:53.037398 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.compute.api [None req-d1e8186b-516d-48ec-b174-7424bb2c9c7c tempest-VolumesNegativeTest-2027890769 tempest-VolumesNegativeTest-2027890769-project] [instance: 52dfbaaf-557f-478e-bee8-e4856641b102] Fetching instance by UUID {{(pid=120798) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:14:53.045311 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-d1e8186b-516d-48ec-b174-7424bb2c9c7c tempest-VolumesNegativeTest-2027890769 tempest-VolumesNegativeTest-2027890769-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:14:53.045792 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-d1e8186b-516d-48ec-b174-7424bb2c9c7c tempest-VolumesNegativeTest-2027890769 tempest-VolumesNegativeTest-2027890769-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:14:53.046234 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-d1e8186b-516d-48ec-b174-7424bb2c9c7c tempest-VolumesNegativeTest-2027890769 tempest-VolumesNegativeTest-2027890769-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:14:53.046942 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-d1e8186b-516d-48ec-b174-7424bb2c9c7c tempest-VolumesNegativeTest-2027890769 tempest-VolumesNegativeTest-2027890769-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:14:53.047377 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-d1e8186b-516d-48ec-b174-7424bb2c9c7c tempest-VolumesNegativeTest-2027890769 tempest-VolumesNegativeTest-2027890769-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:14:53.047877 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-d1e8186b-516d-48ec-b174-7424bb2c9c7c tempest-VolumesNegativeTest-2027890769 tempest-VolumesNegativeTest-2027890769-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:14:53.129290 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-d1e8186b-516d-48ec-b174-7424bb2c9c7c tempest-VolumesNegativeTest-2027890769 tempest-VolumesNegativeTest-2027890769-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:14:53.129892 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-d1e8186b-516d-48ec-b174-7424bb2c9c7c tempest-VolumesNegativeTest-2027890769 tempest-VolumesNegativeTest-2027890769-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:14:53.130445 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-d1e8186b-516d-48ec-b174-7424bb2c9c7c tempest-VolumesNegativeTest-2027890769 tempest-VolumesNegativeTest-2027890769-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:14:53.131092 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.objects.instance [None req-d1e8186b-516d-48ec-b174-7424bb2c9c7c tempest-VolumesNegativeTest-2027890769 tempest-VolumesNegativeTest-2027890769-project] Lazy-loading 'fault' on Instance uuid 52dfbaaf-557f-478e-bee8-e4856641b102 {{(pid=120798) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 07:14:53.252876 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.policy [None req-d1e8186b-516d-48ec-b174-7424bb2c9c7c tempest-VolumesNegativeTest-2027890769 tempest-VolumesNegativeTest-2027890769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ed299381d5b49fb8577287af4368fe1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d91979a6ce9468c990b9e08e267d329', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120798) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:14:53.269324 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.policy [None req-11819cc8-740d-4c91-a284-12752b1a87bd tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '471dc5c1db64411ab1d80ad6c038e519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb44f62fa62e46528712f24479cbb19f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120799) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:14:53.269948 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [None req-d1e8186b-516d-48ec-b174-7424bb2c9c7c tempest-VolumesNegativeTest-2027890769 tempest-VolumesNegativeTest-2027890769-project] 10.222.0.17 "GET /compute/v2.1/servers/52dfbaaf-557f-478e-bee8-e4856641b102" status: 200 len: 1304 microversion: 2.1 time: 0.238062 Aug 23 07:14:53.274669 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 169/346] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:14:53 2022] GET /compute/v2.1/servers/52dfbaaf-557f-478e-bee8-e4856641b102 => generated 1304 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:14:53.291935 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-ef00addb-e0f2-46f6-b77a-210dd5db7a13 tempest-VolumesActionsTest-775986377 tempest-VolumesActionsTest-775986377-project] Calling method '>' {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:14:53.292699 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.compute.api [None req-ef00addb-e0f2-46f6-b77a-210dd5db7a13 tempest-VolumesActionsTest-775986377 tempest-VolumesActionsTest-775986377-project] [instance: 118d56f5-a1b4-402d-9e43-b432c2b63b14] Fetching instance by UUID {{(pid=120798) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:14:53.303373 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-ef00addb-e0f2-46f6-b77a-210dd5db7a13 tempest-VolumesActionsTest-775986377 tempest-VolumesActionsTest-775986377-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:14:53.305269 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-ef00addb-e0f2-46f6-b77a-210dd5db7a13 tempest-VolumesActionsTest-775986377 tempest-VolumesActionsTest-775986377-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:14:53.306072 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-ef00addb-e0f2-46f6-b77a-210dd5db7a13 tempest-VolumesActionsTest-775986377 tempest-VolumesActionsTest-775986377-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:14:53.307806 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-ef00addb-e0f2-46f6-b77a-210dd5db7a13 tempest-VolumesActionsTest-775986377 tempest-VolumesActionsTest-775986377-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:14:53.308221 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-11819cc8-740d-4c91-a284-12752b1a87bd tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] 10.222.0.17 "GET /compute/v2.1/servers/ce9a9c42-b9ed-40b1-b72c-390b85578204" status: 200 len: 1366 microversion: 2.1 time: 0.400090 Aug 23 07:14:53.309211 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-ef00addb-e0f2-46f6-b77a-210dd5db7a13 tempest-VolumesActionsTest-775986377 tempest-VolumesActionsTest-775986377-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:14:53.311103 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 178/347] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:14:52 2022] GET /compute/v2.1/servers/ce9a9c42-b9ed-40b1-b72c-390b85578204 => generated 1366 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 07:14:53.323934 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-ef00addb-e0f2-46f6-b77a-210dd5db7a13 tempest-VolumesActionsTest-775986377 tempest-VolumesActionsTest-775986377-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:14:53.334113 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-a3218bb1-b9b5-47aa-aa67-4dcd98bdd96f tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Calling method '>' {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:14:53.334742 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.compute.api [None req-a3218bb1-b9b5-47aa-aa67-4dcd98bdd96f tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] [instance: b9418fe6-a57e-4a99-becb-19a4d3a52da1] Fetching instance by UUID {{(pid=120799) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:14:53.342617 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-a3218bb1-b9b5-47aa-aa67-4dcd98bdd96f tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:14:53.343307 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-a3218bb1-b9b5-47aa-aa67-4dcd98bdd96f tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:14:53.343782 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-a3218bb1-b9b5-47aa-aa67-4dcd98bdd96f tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:14:53.345923 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-a3218bb1-b9b5-47aa-aa67-4dcd98bdd96f tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:14:53.346385 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-a3218bb1-b9b5-47aa-aa67-4dcd98bdd96f tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:14:53.346811 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-a3218bb1-b9b5-47aa-aa67-4dcd98bdd96f tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:14:53.673772 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.policy [None req-ef00addb-e0f2-46f6-b77a-210dd5db7a13 tempest-VolumesActionsTest-775986377 tempest-VolumesActionsTest-775986377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f4d65ffaab942f29d449b64805c765a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2ef3b6384a4194a26ba51078c425af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120798) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:14:53.691007 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [None req-ef00addb-e0f2-46f6-b77a-210dd5db7a13 tempest-VolumesActionsTest-775986377 tempest-VolumesActionsTest-775986377-project] 10.222.0.17 "GET /compute/v2.1/servers/118d56f5-a1b4-402d-9e43-b432c2b63b14" status: 200 len: 1501 microversion: 2.1 time: 0.414714 Aug 23 07:14:53.703655 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 170/348] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:14:53 2022] GET /compute/v2.1/servers/118d56f5-a1b4-402d-9e43-b432c2b63b14 => generated 1501 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:14:53.709989 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.policy [None req-a3218bb1-b9b5-47aa-aa67-4dcd98bdd96f tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64d54cb95b264c18b45d90822507fae1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135367be6e3f4b3d965ee0d99fdca524', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120799) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:14:53.718765 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-a3218bb1-b9b5-47aa-aa67-4dcd98bdd96f tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] 10.222.0.17 "GET /compute/v2.1/servers/b9418fe6-a57e-4a99-becb-19a4d3a52da1" status: 200 len: 1370 microversion: 2.1 time: 0.388897 Aug 23 07:14:53.719692 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 179/349] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:14:53 2022] GET /compute/v2.1/servers/b9418fe6-a57e-4a99-becb-19a4d3a52da1 => generated 1370 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:14:54.208591 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [req-5cf655a4-37a3-4d8d-8f1f-2846b73fae47 req-138e5967-3c5e-49f2-aecd-d5e26ac654ee service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b9418fe6-a57e-4a99-becb-19a4d3a52da1", "tag": "13257b29-baec-4cb2-9910-64f78a6db6ba"}]} {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 07:14:54.218882 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [req-5cf655a4-37a3-4d8d-8f1f-2846b73fae47 req-138e5967-3c5e-49f2-aecd-d5e26ac654ee service nova] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:14:54.219759 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [req-5cf655a4-37a3-4d8d-8f1f-2846b73fae47 req-138e5967-3c5e-49f2-aecd-d5e26ac654ee service nova] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:14:54.220388 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [req-5cf655a4-37a3-4d8d-8f1f-2846b73fae47 req-138e5967-3c5e-49f2-aecd-d5e26ac654ee service nova] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:14:54.233712 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.compute.server_external_events [req-5cf655a4-37a3-4d8d-8f1f-2846b73fae47 req-138e5967-3c5e-49f2-aecd-d5e26ac654ee service nova] Creating event network-changed:13257b29-baec-4cb2-9910-64f78a6db6ba for instance b9418fe6-a57e-4a99-becb-19a4d3a52da1 on hv-cinder-85409 Aug 23 07:14:54.245231 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [req-5cf655a4-37a3-4d8d-8f1f-2846b73fae47 req-138e5967-3c5e-49f2-aecd-d5e26ac654ee service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040582 Aug 23 07:14:54.250093 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 171/350] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Aug 23 07:14:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 07:14:54.298536 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-0f99b377-0dae-40f2-af32-0b0df4f01b59 tempest-VolumesNegativeTest-2027890769 tempest-VolumesNegativeTest-2027890769-project] Calling method '>' {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:14:54.299934 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.compute.api [None req-0f99b377-0dae-40f2-af32-0b0df4f01b59 tempest-VolumesNegativeTest-2027890769 tempest-VolumesNegativeTest-2027890769-project] [instance: 52dfbaaf-557f-478e-bee8-e4856641b102] Fetching instance by UUID {{(pid=120799) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:14:54.308066 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-0f99b377-0dae-40f2-af32-0b0df4f01b59 tempest-VolumesNegativeTest-2027890769 tempest-VolumesNegativeTest-2027890769-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:14:54.309351 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-0f99b377-0dae-40f2-af32-0b0df4f01b59 tempest-VolumesNegativeTest-2027890769 tempest-VolumesNegativeTest-2027890769-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:14:54.309988 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-0f99b377-0dae-40f2-af32-0b0df4f01b59 tempest-VolumesNegativeTest-2027890769 tempest-VolumesNegativeTest-2027890769-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:14:54.311020 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-0f99b377-0dae-40f2-af32-0b0df4f01b59 tempest-VolumesNegativeTest-2027890769 tempest-VolumesNegativeTest-2027890769-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:14:54.311697 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-0f99b377-0dae-40f2-af32-0b0df4f01b59 tempest-VolumesNegativeTest-2027890769 tempest-VolumesNegativeTest-2027890769-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:14:54.312297 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-0f99b377-0dae-40f2-af32-0b0df4f01b59 tempest-VolumesNegativeTest-2027890769 tempest-VolumesNegativeTest-2027890769-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:14:54.336887 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-0f874e1b-4aba-4d62-9214-8c68b84b37db tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Calling method '>' {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:14:54.337557 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.compute.api [None req-0f874e1b-4aba-4d62-9214-8c68b84b37db tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] [instance: ce9a9c42-b9ed-40b1-b72c-390b85578204] Fetching instance by UUID {{(pid=120798) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:14:54.344617 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-0f874e1b-4aba-4d62-9214-8c68b84b37db tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:14:54.345591 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-0f874e1b-4aba-4d62-9214-8c68b84b37db tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:14:54.346266 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-0f874e1b-4aba-4d62-9214-8c68b84b37db tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:14:54.347173 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-0f874e1b-4aba-4d62-9214-8c68b84b37db tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:14:54.347854 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-0f874e1b-4aba-4d62-9214-8c68b84b37db tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:14:54.348483 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-0f874e1b-4aba-4d62-9214-8c68b84b37db tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:14:54.349704 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-0f99b377-0dae-40f2-af32-0b0df4f01b59 tempest-VolumesNegativeTest-2027890769 tempest-VolumesNegativeTest-2027890769-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:14:54.350186 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-0f99b377-0dae-40f2-af32-0b0df4f01b59 tempest-VolumesNegativeTest-2027890769 tempest-VolumesNegativeTest-2027890769-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:14:54.350614 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-0f99b377-0dae-40f2-af32-0b0df4f01b59 tempest-VolumesNegativeTest-2027890769 tempest-VolumesNegativeTest-2027890769-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:14:54.351066 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.objects.instance [None req-0f99b377-0dae-40f2-af32-0b0df4f01b59 tempest-VolumesNegativeTest-2027890769 tempest-VolumesNegativeTest-2027890769-project] Lazy-loading 'fault' on Instance uuid 52dfbaaf-557f-478e-bee8-e4856641b102 {{(pid=120799) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 07:14:54.413183 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.policy [None req-0f99b377-0dae-40f2-af32-0b0df4f01b59 tempest-VolumesNegativeTest-2027890769 tempest-VolumesNegativeTest-2027890769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ed299381d5b49fb8577287af4368fe1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d91979a6ce9468c990b9e08e267d329', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120799) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:14:54.429013 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-0f99b377-0dae-40f2-af32-0b0df4f01b59 tempest-VolumesNegativeTest-2027890769 tempest-VolumesNegativeTest-2027890769-project] 10.222.0.17 "GET /compute/v2.1/servers/52dfbaaf-557f-478e-bee8-e4856641b102" status: 200 len: 1304 microversion: 2.1 time: 0.134411 Aug 23 07:14:54.443755 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 180/351] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:14:54 2022] GET /compute/v2.1/servers/52dfbaaf-557f-478e-bee8-e4856641b102 => generated 1304 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 07:14:54.533546 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.policy [None req-0f874e1b-4aba-4d62-9214-8c68b84b37db tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '471dc5c1db64411ab1d80ad6c038e519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb44f62fa62e46528712f24479cbb19f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120798) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:14:54.544891 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [None req-0f874e1b-4aba-4d62-9214-8c68b84b37db tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] 10.222.0.17 "GET /compute/v2.1/servers/ce9a9c42-b9ed-40b1-b72c-390b85578204" status: 200 len: 1557 microversion: 2.1 time: 0.211672 Aug 23 07:14:54.545752 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 172/352] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:14:54 2022] GET /compute/v2.1/servers/ce9a9c42-b9ed-40b1-b72c-390b85578204 => generated 1557 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:14:54.565491 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-b7702885-6f01-41d4-b042-eeb96a730fb9 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Calling method '>' {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:14:54.566179 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.compute.api [None req-b7702885-6f01-41d4-b042-eeb96a730fb9 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] [instance: ce9a9c42-b9ed-40b1-b72c-390b85578204] Fetching instance by UUID {{(pid=120799) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:14:54.572538 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-b7702885-6f01-41d4-b042-eeb96a730fb9 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:14:54.573024 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-b7702885-6f01-41d4-b042-eeb96a730fb9 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:14:54.573458 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-b7702885-6f01-41d4-b042-eeb96a730fb9 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:14:54.574156 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-b7702885-6f01-41d4-b042-eeb96a730fb9 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:14:54.574983 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-b7702885-6f01-41d4-b042-eeb96a730fb9 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:14:54.575432 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-b7702885-6f01-41d4-b042-eeb96a730fb9 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:14:54.675630 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-b7702885-6f01-41d4-b042-eeb96a730fb9 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] 10.222.0.17 "GET /compute/v2.1/servers/ce9a9c42-b9ed-40b1-b72c-390b85578204/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.114012 Aug 23 07:14:54.676355 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 181/353] 10.222.0.17 () {58 vars in 1275 bytes} [Tue Aug 23 07:14:54 2022] GET /compute/v2.1/servers/ce9a9c42-b9ed-40b1-b72c-390b85578204/os-interface => generated 285 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 07:14:54.721262 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-30d55edf-8c67-403f-9b81-686a1c987830 tempest-VolumesActionsTest-775986377 tempest-VolumesActionsTest-775986377-project] Calling method '>' {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:14:54.721923 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.compute.api [None req-30d55edf-8c67-403f-9b81-686a1c987830 tempest-VolumesActionsTest-775986377 tempest-VolumesActionsTest-775986377-project] [instance: 118d56f5-a1b4-402d-9e43-b432c2b63b14] Fetching instance by UUID {{(pid=120798) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:14:54.740375 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-24a7227e-81c4-4eb4-b41a-6876bc25cf2f tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Calling method '>' {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:14:54.740979 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.compute.api [None req-24a7227e-81c4-4eb4-b41a-6876bc25cf2f tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] [instance: b9418fe6-a57e-4a99-becb-19a4d3a52da1] Fetching instance by UUID {{(pid=120799) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:14:54.755245 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-24a7227e-81c4-4eb4-b41a-6876bc25cf2f tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:14:54.755793 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-30d55edf-8c67-403f-9b81-686a1c987830 tempest-VolumesActionsTest-775986377 tempest-VolumesActionsTest-775986377-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:14:54.757545 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-30d55edf-8c67-403f-9b81-686a1c987830 tempest-VolumesActionsTest-775986377 tempest-VolumesActionsTest-775986377-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:14:54.758069 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-30d55edf-8c67-403f-9b81-686a1c987830 tempest-VolumesActionsTest-775986377 tempest-VolumesActionsTest-775986377-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:14:54.760775 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-24a7227e-81c4-4eb4-b41a-6876bc25cf2f tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:14:54.761452 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-24a7227e-81c4-4eb4-b41a-6876bc25cf2f tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:14:54.762177 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-30d55edf-8c67-403f-9b81-686a1c987830 tempest-VolumesActionsTest-775986377 tempest-VolumesActionsTest-775986377-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:14:54.762796 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-30d55edf-8c67-403f-9b81-686a1c987830 tempest-VolumesActionsTest-775986377 tempest-VolumesActionsTest-775986377-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:14:54.763227 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-30d55edf-8c67-403f-9b81-686a1c987830 tempest-VolumesActionsTest-775986377 tempest-VolumesActionsTest-775986377-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:14:54.763581 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-24a7227e-81c4-4eb4-b41a-6876bc25cf2f tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:14:54.764383 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-24a7227e-81c4-4eb4-b41a-6876bc25cf2f tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:14:54.765018 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-24a7227e-81c4-4eb4-b41a-6876bc25cf2f tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:14:55.088698 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.policy [None req-24a7227e-81c4-4eb4-b41a-6876bc25cf2f tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64d54cb95b264c18b45d90822507fae1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135367be6e3f4b3d965ee0d99fdca524', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120799) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:14:55.098927 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-24a7227e-81c4-4eb4-b41a-6876bc25cf2f tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] 10.222.0.17 "GET /compute/v2.1/servers/b9418fe6-a57e-4a99-becb-19a4d3a52da1" status: 200 len: 1370 microversion: 2.1 time: 0.362534 Aug 23 07:14:55.105330 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.policy [None req-30d55edf-8c67-403f-9b81-686a1c987830 tempest-VolumesActionsTest-775986377 tempest-VolumesActionsTest-775986377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f4d65ffaab942f29d449b64805c765a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2ef3b6384a4194a26ba51078c425af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120798) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:14:55.108415 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 182/354] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:14:54 2022] GET /compute/v2.1/servers/b9418fe6-a57e-4a99-becb-19a4d3a52da1 => generated 1370 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 07:14:55.118887 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [None req-30d55edf-8c67-403f-9b81-686a1c987830 tempest-VolumesActionsTest-775986377 tempest-VolumesActionsTest-775986377-project] 10.222.0.17 "GET /compute/v2.1/servers/118d56f5-a1b4-402d-9e43-b432c2b63b14" status: 200 len: 1501 microversion: 2.1 time: 0.405656 Aug 23 07:14:55.120052 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 173/355] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:14:54 2022] GET /compute/v2.1/servers/118d56f5-a1b4-402d-9e43-b432c2b63b14 => generated 1501 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:14:55.450714 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-73147097-5a24-42bc-9106-234d9eb27086 tempest-VolumesNegativeTest-2027890769 tempest-VolumesNegativeTest-2027890769-project] Calling method '>' {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:14:55.451655 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.compute.api [None req-73147097-5a24-42bc-9106-234d9eb27086 tempest-VolumesNegativeTest-2027890769 tempest-VolumesNegativeTest-2027890769-project] [instance: 52dfbaaf-557f-478e-bee8-e4856641b102] Fetching instance by UUID {{(pid=120799) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:14:55.463057 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-73147097-5a24-42bc-9106-234d9eb27086 tempest-VolumesNegativeTest-2027890769 tempest-VolumesNegativeTest-2027890769-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:14:55.463930 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-73147097-5a24-42bc-9106-234d9eb27086 tempest-VolumesNegativeTest-2027890769 tempest-VolumesNegativeTest-2027890769-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:14:55.464574 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-73147097-5a24-42bc-9106-234d9eb27086 tempest-VolumesNegativeTest-2027890769 tempest-VolumesNegativeTest-2027890769-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:14:55.465579 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-73147097-5a24-42bc-9106-234d9eb27086 tempest-VolumesNegativeTest-2027890769 tempest-VolumesNegativeTest-2027890769-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:14:55.471653 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-73147097-5a24-42bc-9106-234d9eb27086 tempest-VolumesNegativeTest-2027890769 tempest-VolumesNegativeTest-2027890769-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:14:55.472398 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-73147097-5a24-42bc-9106-234d9eb27086 tempest-VolumesNegativeTest-2027890769 tempest-VolumesNegativeTest-2027890769-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:14:55.497953 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.wsgi [None req-73147097-5a24-42bc-9106-234d9eb27086 tempest-VolumesNegativeTest-2027890769 tempest-VolumesNegativeTest-2027890769-project] HTTP exception thrown: Instance 52dfbaaf-557f-478e-bee8-e4856641b102 could not be found. Aug 23 07:14:55.505695 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-73147097-5a24-42bc-9106-234d9eb27086 tempest-VolumesNegativeTest-2027890769 tempest-VolumesNegativeTest-2027890769-project] Request method failure captured: Aug 23 07:14:55.505695 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: request: GET /compute/v2.1/servers/52dfbaaf-557f-478e-bee8-e4856641b102 HTTP/1.1 Aug 23 07:14:55.505695 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: Accept: application/json Aug 23 07:14:55.505695 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: Accept-Encoding: identity Aug 23 07:14:55.505695 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: Connection: close Aug 23 07:14:55.505695 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: Content-Length: 0 Aug 23 07:14:55.505695 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: Content-Type: application/json Aug 23 07:14:55.505695 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: Host: 10.222.0.17 Aug 23 07:14:55.505695 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: Openstack-System-Scope: None Aug 23 07:14:55.505695 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: User-Agent: python-urllib3/1.26.11 Aug 23 07:14:55.505695 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-Auth-Token: gAAAAABjBH5HCP40E6dt3luPe_xKQx-OmDqvbmArvhpXH__CoeaToExbX31wz0LRf9mAhZPEc9-hU3KrWwS4EsNnXlU3YBpaaSON54Y_mVcuFUBM824f_nLdLxNXVaMeKev3iUQkFzdiKlCmFTWVEy9SjIoLYtlwzbSv1W9_GLlMahozaprKExw Aug 23 07:14:55.505695 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-Domain-Id: None Aug 23 07:14:55.505695 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-Domain-Name: None Aug 23 07:14:55.505695 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-Identity-Status: Confirmed Aug 23 07:14:55.505695 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-Is-Admin-Project: True Aug 23 07:14:55.505695 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-Project-Domain-Id: default Aug 23 07:14:55.505695 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-Project-Domain-Name: Default Aug 23 07:14:55.505695 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-Project-Id: 3d91979a6ce9468c990b9e08e267d329 Aug 23 07:14:55.505695 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-Project-Name: tempest-VolumesNegativeTest-2027890769 Aug 23 07:14:55.505695 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-Role: reader,member Aug 23 07:14:55.505695 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-Roles: reader,member Aug 23 07:14:55.506993 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/3d91979a6ce9468c990b9e08e267d329"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/3d91979a6ce9468c990b9e08e267d329"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_3d91979a6ce9468c990b9e08e267d329"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/3d91979a6ce9468c990b9e08e267d329"}]}] Aug 23 07:14:55.506993 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-Tenant: tempest-VolumesNegativeTest-2027890769 Aug 23 07:14:55.506993 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-Tenant-Id: 3d91979a6ce9468c990b9e08e267d329 Aug 23 07:14:55.506993 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-Tenant-Name: tempest-VolumesNegativeTest-2027890769 Aug 23 07:14:55.506993 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-User: tempest-VolumesNegativeTest-2027890769-project Aug 23 07:14:55.506993 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-User-Domain-Id: default Aug 23 07:14:55.506993 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-User-Domain-Name: Default Aug 23 07:14:55.506993 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-User-Id: 6ed299381d5b49fb8577287af4368fe1 Aug 23 07:14:55.506993 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-User-Name: tempest-VolumesNegativeTest-2027890769-project Aug 23 07:14:55.506993 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: method: > Aug 23 07:14:55.506993 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: exception: Instance 52dfbaaf-557f-478e-bee8-e4856641b102 could not be found. Aug 23 07:14:55.506993 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: action_args: {'id': '52dfbaaf-557f-478e-bee8-e4856641b102'} Aug 23 07:14:55.507751 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 07:14:55.507751 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 07:14:55.507751 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 07:14:55.507751 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 07:14:55.507751 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 07:14:55.507751 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 07:14:55.507751 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 07:14:55.507751 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 07:14:55.507751 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 07:14:55.507751 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 07:14:55.507751 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 52dfbaaf-557f-478e-bee8-e4856641b102 could not be found. Aug 23 07:14:55.507751 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi Aug 23 07:14:55.507751 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 07:14:55.507751 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi Aug 23 07:14:55.507751 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 07:14:55.507751 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 07:14:55.507751 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 07:14:55.507751 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 07:14:55.507751 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 07:14:55.507751 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 07:14:55.508902 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 07:14:55.508902 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 07:14:55.508902 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 07:14:55.508902 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 07:14:55.508902 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 07:14:55.508902 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 07:14:55.508902 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 07:14:55.508902 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 52dfbaaf-557f-478e-bee8-e4856641b102 could not be found. Aug 23 07:14:55.508902 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi Aug 23 07:14:55.508902 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 07:14:55.508902 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi Aug 23 07:14:55.508902 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 07:14:55.508902 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 07:14:55.508902 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 07:14:55.508902 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 07:14:55.508902 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 07:14:55.508902 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 52dfbaaf-557f-478e-bee8-e4856641b102 could not be found. Aug 23 07:14:55.508902 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi Aug 23 07:14:55.513594 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-73147097-5a24-42bc-9106-234d9eb27086 tempest-VolumesNegativeTest-2027890769 tempest-VolumesNegativeTest-2027890769-project] Returning 404 to user: Instance 52dfbaaf-557f-478e-bee8-e4856641b102 could not be found. {{(pid=120799) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 07:14:55.515431 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-73147097-5a24-42bc-9106-234d9eb27086 tempest-VolumesNegativeTest-2027890769 tempest-VolumesNegativeTest-2027890769-project] 10.222.0.17 "GET /compute/v2.1/servers/52dfbaaf-557f-478e-bee8-e4856641b102" status: 404 len: 111 microversion: 2.1 time: 0.068903 Aug 23 07:14:55.516316 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 183/356] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:14:55 2022] GET /compute/v2.1/servers/52dfbaaf-557f-478e-bee8-e4856641b102 => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 07:14:56.122831 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-bdc8c9fe-9fea-409d-87ae-86108b396f64 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Calling method '>' {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:14:56.124742 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.compute.api [None req-bdc8c9fe-9fea-409d-87ae-86108b396f64 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] [instance: b9418fe6-a57e-4a99-becb-19a4d3a52da1] Fetching instance by UUID {{(pid=120798) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:14:56.135348 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-bdc8c9fe-9fea-409d-87ae-86108b396f64 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:14:56.135896 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-bdc8c9fe-9fea-409d-87ae-86108b396f64 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:14:56.137256 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-bdc8c9fe-9fea-409d-87ae-86108b396f64 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:14:56.138486 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-bdc8c9fe-9fea-409d-87ae-86108b396f64 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:14:56.139286 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-bdc8c9fe-9fea-409d-87ae-86108b396f64 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:14:56.141284 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-bdc8c9fe-9fea-409d-87ae-86108b396f64 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:14:56.144292 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-b743fd33-6fb2-4e5d-b7f4-023b34e9d912 tempest-VolumesActionsTest-775986377 tempest-VolumesActionsTest-775986377-project] Calling method '>' {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:14:56.145154 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.compute.api [None req-b743fd33-6fb2-4e5d-b7f4-023b34e9d912 tempest-VolumesActionsTest-775986377 tempest-VolumesActionsTest-775986377-project] [instance: 118d56f5-a1b4-402d-9e43-b432c2b63b14] Fetching instance by UUID {{(pid=120799) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:14:56.156502 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-b743fd33-6fb2-4e5d-b7f4-023b34e9d912 tempest-VolumesActionsTest-775986377 tempest-VolumesActionsTest-775986377-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:14:56.157244 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-b743fd33-6fb2-4e5d-b7f4-023b34e9d912 tempest-VolumesActionsTest-775986377 tempest-VolumesActionsTest-775986377-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:14:56.157851 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-b743fd33-6fb2-4e5d-b7f4-023b34e9d912 tempest-VolumesActionsTest-775986377 tempest-VolumesActionsTest-775986377-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:14:56.158760 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-b743fd33-6fb2-4e5d-b7f4-023b34e9d912 tempest-VolumesActionsTest-775986377 tempest-VolumesActionsTest-775986377-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:14:56.159199 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-b743fd33-6fb2-4e5d-b7f4-023b34e9d912 tempest-VolumesActionsTest-775986377 tempest-VolumesActionsTest-775986377-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:14:56.159915 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-b743fd33-6fb2-4e5d-b7f4-023b34e9d912 tempest-VolumesActionsTest-775986377 tempest-VolumesActionsTest-775986377-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:14:56.479257 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.policy [None req-b743fd33-6fb2-4e5d-b7f4-023b34e9d912 tempest-VolumesActionsTest-775986377 tempest-VolumesActionsTest-775986377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f4d65ffaab942f29d449b64805c765a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2ef3b6384a4194a26ba51078c425af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120799) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:14:56.492147 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-b743fd33-6fb2-4e5d-b7f4-023b34e9d912 tempest-VolumesActionsTest-775986377 tempest-VolumesActionsTest-775986377-project] 10.222.0.17 "GET /compute/v2.1/servers/118d56f5-a1b4-402d-9e43-b432c2b63b14" status: 200 len: 1501 microversion: 2.1 time: 0.351489 Aug 23 07:14:56.493980 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 184/357] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:14:56 2022] GET /compute/v2.1/servers/118d56f5-a1b4-402d-9e43-b432c2b63b14 => generated 1501 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:14:56.510081 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [req-cdba45dc-71be-4ff2-9ddb-ff268df3d271 req-ef989593-ae7c-4c17-aa54-ac5c4c36e376 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ce9a9c42-b9ed-40b1-b72c-390b85578204", "tag": "934b5d8d-aefe-4c06-83af-f3bb1ed3c80c"}]} {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 07:14:56.521132 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.policy [None req-bdc8c9fe-9fea-409d-87ae-86108b396f64 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64d54cb95b264c18b45d90822507fae1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135367be6e3f4b3d965ee0d99fdca524', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120798) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:14:56.532491 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [None req-bdc8c9fe-9fea-409d-87ae-86108b396f64 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] 10.222.0.17 "GET /compute/v2.1/servers/b9418fe6-a57e-4a99-becb-19a4d3a52da1" status: 200 len: 1370 microversion: 2.1 time: 0.415632 Aug 23 07:14:56.533047 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 174/358] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:14:56 2022] GET /compute/v2.1/servers/b9418fe6-a57e-4a99-becb-19a4d3a52da1 => generated 1370 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:14:56.535711 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [req-cdba45dc-71be-4ff2-9ddb-ff268df3d271 req-ef989593-ae7c-4c17-aa54-ac5c4c36e376 service nova] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:14:56.536468 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [req-cdba45dc-71be-4ff2-9ddb-ff268df3d271 req-ef989593-ae7c-4c17-aa54-ac5c4c36e376 service nova] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:14:56.537096 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [req-cdba45dc-71be-4ff2-9ddb-ff268df3d271 req-ef989593-ae7c-4c17-aa54-ac5c4c36e376 service nova] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:14:56.556950 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.compute.server_external_events [req-cdba45dc-71be-4ff2-9ddb-ff268df3d271 req-ef989593-ae7c-4c17-aa54-ac5c4c36e376 service nova] Creating event network-changed:934b5d8d-aefe-4c06-83af-f3bb1ed3c80c for instance ce9a9c42-b9ed-40b1-b72c-390b85578204 on hv-cinder-85409 Aug 23 07:14:56.564203 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [req-cdba45dc-71be-4ff2-9ddb-ff268df3d271 req-ef989593-ae7c-4c17-aa54-ac5c4c36e376 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068303 Aug 23 07:14:56.564967 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 185/359] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Aug 23 07:14:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 07:14:57.516695 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-6986bc3b-e3eb-46e9-bb4c-9e92bafb0ae2 tempest-VolumesActionsTest-775986377 tempest-VolumesActionsTest-775986377-project] Calling method '>' {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:14:57.517980 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.compute.api [None req-6986bc3b-e3eb-46e9-bb4c-9e92bafb0ae2 tempest-VolumesActionsTest-775986377 tempest-VolumesActionsTest-775986377-project] [instance: 118d56f5-a1b4-402d-9e43-b432c2b63b14] Fetching instance by UUID {{(pid=120798) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:14:57.522116 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG dbcounter [-] [120798] Writing DB stats nova_cell0:SELECT=2 {{(pid=120798) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:14:57.523515 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG dbcounter [-] [120798] Writing DB stats nova_cell0:SELECT=6 {{(pid=120798) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:14:57.535175 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-6986bc3b-e3eb-46e9-bb4c-9e92bafb0ae2 tempest-VolumesActionsTest-775986377 tempest-VolumesActionsTest-775986377-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:14:57.536294 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-6986bc3b-e3eb-46e9-bb4c-9e92bafb0ae2 tempest-VolumesActionsTest-775986377 tempest-VolumesActionsTest-775986377-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:14:57.536783 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-6986bc3b-e3eb-46e9-bb4c-9e92bafb0ae2 tempest-VolumesActionsTest-775986377 tempest-VolumesActionsTest-775986377-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:14:57.538297 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-6986bc3b-e3eb-46e9-bb4c-9e92bafb0ae2 tempest-VolumesActionsTest-775986377 tempest-VolumesActionsTest-775986377-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:14:57.539042 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-6986bc3b-e3eb-46e9-bb4c-9e92bafb0ae2 tempest-VolumesActionsTest-775986377 tempest-VolumesActionsTest-775986377-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:14:57.539786 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-6986bc3b-e3eb-46e9-bb4c-9e92bafb0ae2 tempest-VolumesActionsTest-775986377 tempest-VolumesActionsTest-775986377-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:14:57.551359 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG dbcounter [-] [120799] Writing DB stats nova_cell0:SELECT=6 {{(pid=120799) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:14:57.561824 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-1b880532-2298-42fd-a034-8de3c6da48f7 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Calling method '>' {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:14:57.564273 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.compute.api [None req-1b880532-2298-42fd-a034-8de3c6da48f7 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] [instance: b9418fe6-a57e-4a99-becb-19a4d3a52da1] Fetching instance by UUID {{(pid=120799) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:14:57.583895 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-1b880532-2298-42fd-a034-8de3c6da48f7 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:14:57.586270 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-1b880532-2298-42fd-a034-8de3c6da48f7 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:14:57.586926 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-1b880532-2298-42fd-a034-8de3c6da48f7 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:14:57.590440 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-1b880532-2298-42fd-a034-8de3c6da48f7 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:14:57.591302 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-1b880532-2298-42fd-a034-8de3c6da48f7 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:14:57.592000 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-1b880532-2298-42fd-a034-8de3c6da48f7 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:14:57.941637 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.policy [None req-6986bc3b-e3eb-46e9-bb4c-9e92bafb0ae2 tempest-VolumesActionsTest-775986377 tempest-VolumesActionsTest-775986377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f4d65ffaab942f29d449b64805c765a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2ef3b6384a4194a26ba51078c425af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120798) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:14:57.948929 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.policy [None req-1b880532-2298-42fd-a034-8de3c6da48f7 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64d54cb95b264c18b45d90822507fae1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135367be6e3f4b3d965ee0d99fdca524', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120799) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:14:57.957802 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-1b880532-2298-42fd-a034-8de3c6da48f7 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] 10.222.0.17 "GET /compute/v2.1/servers/b9418fe6-a57e-4a99-becb-19a4d3a52da1" status: 200 len: 1370 microversion: 2.1 time: 0.407803 Aug 23 07:14:57.962447 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [None req-6986bc3b-e3eb-46e9-bb4c-9e92bafb0ae2 tempest-VolumesActionsTest-775986377 tempest-VolumesActionsTest-775986377-project] 10.222.0.17 "GET /compute/v2.1/servers/118d56f5-a1b4-402d-9e43-b432c2b63b14" status: 200 len: 1501 microversion: 2.1 time: 0.450819 Aug 23 07:14:57.963034 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 175/360] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:14:57 2022] GET /compute/v2.1/servers/118d56f5-a1b4-402d-9e43-b432c2b63b14 => generated 1501 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:14:57.971567 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 186/361] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:14:57 2022] GET /compute/v2.1/servers/b9418fe6-a57e-4a99-becb-19a4d3a52da1 => generated 1370 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 07:14:58.427645 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [req-b3e9441f-89b9-4795-88d5-64cba6229d3e req-aa0e9777-e572-4508-bb60-7cc931963897 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "118d56f5-a1b4-402d-9e43-b432c2b63b14", "name": "network-vif-unplugged", "status": "completed", "tag": "f9d34eea-2f38-4bee-b52d-66dae9718e50"}]} {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 07:14:58.449501 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [req-b3e9441f-89b9-4795-88d5-64cba6229d3e req-aa0e9777-e572-4508-bb60-7cc931963897 service nova] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:14:58.449771 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [req-b3e9441f-89b9-4795-88d5-64cba6229d3e req-aa0e9777-e572-4508-bb60-7cc931963897 service nova] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:14:58.457683 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [req-b3e9441f-89b9-4795-88d5-64cba6229d3e req-aa0e9777-e572-4508-bb60-7cc931963897 service nova] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:14:58.497249 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.compute.server_external_events [req-b3e9441f-89b9-4795-88d5-64cba6229d3e req-aa0e9777-e572-4508-bb60-7cc931963897 service nova] Creating event network-vif-unplugged:f9d34eea-2f38-4bee-b52d-66dae9718e50 for instance 118d56f5-a1b4-402d-9e43-b432c2b63b14 on hv-cinder-85409 Aug 23 07:14:58.522577 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [req-b3e9441f-89b9-4795-88d5-64cba6229d3e req-aa0e9777-e572-4508-bb60-7cc931963897 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.116655 Aug 23 07:14:58.525103 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 176/362] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Aug 23 07:14:58 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 07:14:58.984191 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-bae044db-2780-4bd8-a1e9-1fbbfcc9799d tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Calling method '>' {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:14:58.985016 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-945b5fb3-e584-40d1-aebe-040b3426851f tempest-VolumesActionsTest-775986377 tempest-VolumesActionsTest-775986377-project] Calling method '>' {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:14:58.985493 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.compute.api [None req-bae044db-2780-4bd8-a1e9-1fbbfcc9799d tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] [instance: b9418fe6-a57e-4a99-becb-19a4d3a52da1] Fetching instance by UUID {{(pid=120799) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:14:58.986474 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.compute.api [None req-945b5fb3-e584-40d1-aebe-040b3426851f tempest-VolumesActionsTest-775986377 tempest-VolumesActionsTest-775986377-project] [instance: 118d56f5-a1b4-402d-9e43-b432c2b63b14] Fetching instance by UUID {{(pid=120798) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:14:58.992658 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-bae044db-2780-4bd8-a1e9-1fbbfcc9799d tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:14:58.993536 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-bae044db-2780-4bd8-a1e9-1fbbfcc9799d tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:14:58.994114 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-bae044db-2780-4bd8-a1e9-1fbbfcc9799d tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:14:58.994971 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-bae044db-2780-4bd8-a1e9-1fbbfcc9799d tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:14:58.995582 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-bae044db-2780-4bd8-a1e9-1fbbfcc9799d tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:14:58.996169 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-bae044db-2780-4bd8-a1e9-1fbbfcc9799d tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:14:58.998037 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-945b5fb3-e584-40d1-aebe-040b3426851f tempest-VolumesActionsTest-775986377 tempest-VolumesActionsTest-775986377-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:14:58.998528 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-945b5fb3-e584-40d1-aebe-040b3426851f tempest-VolumesActionsTest-775986377 tempest-VolumesActionsTest-775986377-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:14:59.000941 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-945b5fb3-e584-40d1-aebe-040b3426851f tempest-VolumesActionsTest-775986377 tempest-VolumesActionsTest-775986377-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:14:59.001668 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-945b5fb3-e584-40d1-aebe-040b3426851f tempest-VolumesActionsTest-775986377 tempest-VolumesActionsTest-775986377-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:14:59.002120 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-945b5fb3-e584-40d1-aebe-040b3426851f tempest-VolumesActionsTest-775986377 tempest-VolumesActionsTest-775986377-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:14:59.002544 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-945b5fb3-e584-40d1-aebe-040b3426851f tempest-VolumesActionsTest-775986377 tempest-VolumesActionsTest-775986377-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:14:59.240612 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.policy [None req-945b5fb3-e584-40d1-aebe-040b3426851f tempest-VolumesActionsTest-775986377 tempest-VolumesActionsTest-775986377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f4d65ffaab942f29d449b64805c765a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2ef3b6384a4194a26ba51078c425af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120798) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:14:59.244551 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG dbcounter [-] [120798] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120798) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:14:59.256446 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [None req-945b5fb3-e584-40d1-aebe-040b3426851f tempest-VolumesActionsTest-775986377 tempest-VolumesActionsTest-775986377-project] 10.222.0.17 "GET /compute/v2.1/servers/118d56f5-a1b4-402d-9e43-b432c2b63b14" status: 200 len: 1459 microversion: 2.1 time: 0.276379 Aug 23 07:14:59.257048 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 177/363] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:14:58 2022] GET /compute/v2.1/servers/118d56f5-a1b4-402d-9e43-b432c2b63b14 => generated 1459 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:14:59.271647 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [req-37de7900-a901-4027-8e05-27df426b2111 req-555a117d-37ae-44f0-b657-eb4f978fb79b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "118d56f5-a1b4-402d-9e43-b432c2b63b14", "name": "network-vif-deleted", "tag": "f9d34eea-2f38-4bee-b52d-66dae9718e50"}]} {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 07:14:59.292783 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [req-37de7900-a901-4027-8e05-27df426b2111 req-555a117d-37ae-44f0-b657-eb4f978fb79b service nova] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:14:59.293314 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [req-37de7900-a901-4027-8e05-27df426b2111 req-555a117d-37ae-44f0-b657-eb4f978fb79b service nova] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:14:59.293724 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [req-37de7900-a901-4027-8e05-27df426b2111 req-555a117d-37ae-44f0-b657-eb4f978fb79b service nova] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:14:59.319360 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.compute.server_external_events [req-37de7900-a901-4027-8e05-27df426b2111 req-555a117d-37ae-44f0-b657-eb4f978fb79b service nova] Creating event network-vif-deleted:f9d34eea-2f38-4bee-b52d-66dae9718e50 for instance 118d56f5-a1b4-402d-9e43-b432c2b63b14 on hv-cinder-85409 Aug 23 07:14:59.340550 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [req-37de7900-a901-4027-8e05-27df426b2111 req-555a117d-37ae-44f0-b657-eb4f978fb79b service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079505 Aug 23 07:14:59.341773 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 178/364] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Aug 23 07:14:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 07:14:59.499955 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.policy [None req-bae044db-2780-4bd8-a1e9-1fbbfcc9799d tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64d54cb95b264c18b45d90822507fae1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135367be6e3f4b3d965ee0d99fdca524', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120799) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:14:59.505871 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-bae044db-2780-4bd8-a1e9-1fbbfcc9799d tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] 10.222.0.17 "GET /compute/v2.1/servers/b9418fe6-a57e-4a99-becb-19a4d3a52da1" status: 200 len: 1370 microversion: 2.1 time: 0.525768 Aug 23 07:14:59.508043 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 187/365] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:14:58 2022] GET /compute/v2.1/servers/b9418fe6-a57e-4a99-becb-19a4d3a52da1 => generated 1370 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:15:00.284298 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-e5cae0a6-be4d-490d-9d03-1d27540a1ea1 tempest-VolumesActionsTest-775986377 tempest-VolumesActionsTest-775986377-project] Calling method '>' {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:15:00.284982 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.compute.api [None req-e5cae0a6-be4d-490d-9d03-1d27540a1ea1 tempest-VolumesActionsTest-775986377 tempest-VolumesActionsTest-775986377-project] [instance: 118d56f5-a1b4-402d-9e43-b432c2b63b14] Fetching instance by UUID {{(pid=120798) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:15:00.292341 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-e5cae0a6-be4d-490d-9d03-1d27540a1ea1 tempest-VolumesActionsTest-775986377 tempest-VolumesActionsTest-775986377-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:15:00.292788 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-e5cae0a6-be4d-490d-9d03-1d27540a1ea1 tempest-VolumesActionsTest-775986377 tempest-VolumesActionsTest-775986377-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:15:00.293878 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-e5cae0a6-be4d-490d-9d03-1d27540a1ea1 tempest-VolumesActionsTest-775986377 tempest-VolumesActionsTest-775986377-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:15:00.294966 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-e5cae0a6-be4d-490d-9d03-1d27540a1ea1 tempest-VolumesActionsTest-775986377 tempest-VolumesActionsTest-775986377-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:15:00.295647 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-e5cae0a6-be4d-490d-9d03-1d27540a1ea1 tempest-VolumesActionsTest-775986377 tempest-VolumesActionsTest-775986377-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:15:00.296316 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-e5cae0a6-be4d-490d-9d03-1d27540a1ea1 tempest-VolumesActionsTest-775986377 tempest-VolumesActionsTest-775986377-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:15:00.339157 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-e5cae0a6-be4d-490d-9d03-1d27540a1ea1 tempest-VolumesActionsTest-775986377 tempest-VolumesActionsTest-775986377-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:15:00.339567 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-e5cae0a6-be4d-490d-9d03-1d27540a1ea1 tempest-VolumesActionsTest-775986377 tempest-VolumesActionsTest-775986377-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:15:00.340421 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-e5cae0a6-be4d-490d-9d03-1d27540a1ea1 tempest-VolumesActionsTest-775986377 tempest-VolumesActionsTest-775986377-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:15:00.341067 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.objects.instance [None req-e5cae0a6-be4d-490d-9d03-1d27540a1ea1 tempest-VolumesActionsTest-775986377 tempest-VolumesActionsTest-775986377-project] Lazy-loading 'fault' on Instance uuid 118d56f5-a1b4-402d-9e43-b432c2b63b14 {{(pid=120798) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 07:15:00.526955 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-7224930a-23df-48a7-8524-eedd06830ff7 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Calling method '>' {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:15:00.528694 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.compute.api [None req-7224930a-23df-48a7-8524-eedd06830ff7 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] [instance: b9418fe6-a57e-4a99-becb-19a4d3a52da1] Fetching instance by UUID {{(pid=120799) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:15:00.538475 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-7224930a-23df-48a7-8524-eedd06830ff7 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:15:00.539748 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-7224930a-23df-48a7-8524-eedd06830ff7 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:15:00.541188 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-7224930a-23df-48a7-8524-eedd06830ff7 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:15:00.542193 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-7224930a-23df-48a7-8524-eedd06830ff7 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:15:00.543157 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-7224930a-23df-48a7-8524-eedd06830ff7 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:15:00.543910 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-7224930a-23df-48a7-8524-eedd06830ff7 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:15:00.602324 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.policy [None req-e5cae0a6-be4d-490d-9d03-1d27540a1ea1 tempest-VolumesActionsTest-775986377 tempest-VolumesActionsTest-775986377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f4d65ffaab942f29d449b64805c765a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2ef3b6384a4194a26ba51078c425af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120798) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:15:00.613216 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [None req-e5cae0a6-be4d-490d-9d03-1d27540a1ea1 tempest-VolumesActionsTest-775986377 tempest-VolumesActionsTest-775986377-project] 10.222.0.17 "GET /compute/v2.1/servers/118d56f5-a1b4-402d-9e43-b432c2b63b14" status: 200 len: 1302 microversion: 2.1 time: 0.333919 Aug 23 07:15:00.614505 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 179/366] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:15:00 2022] GET /compute/v2.1/servers/118d56f5-a1b4-402d-9e43-b432c2b63b14 => generated 1302 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:15:00.896225 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.policy [None req-7224930a-23df-48a7-8524-eedd06830ff7 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64d54cb95b264c18b45d90822507fae1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135367be6e3f4b3d965ee0d99fdca524', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120799) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:15:00.909454 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-7224930a-23df-48a7-8524-eedd06830ff7 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] 10.222.0.17 "GET /compute/v2.1/servers/b9418fe6-a57e-4a99-becb-19a4d3a52da1" status: 200 len: 1370 microversion: 2.1 time: 0.386489 Aug 23 07:15:00.910463 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 188/367] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:15:00 2022] GET /compute/v2.1/servers/b9418fe6-a57e-4a99-becb-19a4d3a52da1 => generated 1370 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 07:15:01.635315 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-58245b5d-eef9-4b3d-97de-d0a2a64a89b9 tempest-VolumesActionsTest-775986377 tempest-VolumesActionsTest-775986377-project] Calling method '>' {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:15:01.637516 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.compute.api [None req-58245b5d-eef9-4b3d-97de-d0a2a64a89b9 tempest-VolumesActionsTest-775986377 tempest-VolumesActionsTest-775986377-project] [instance: 118d56f5-a1b4-402d-9e43-b432c2b63b14] Fetching instance by UUID {{(pid=120798) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:15:01.649760 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-58245b5d-eef9-4b3d-97de-d0a2a64a89b9 tempest-VolumesActionsTest-775986377 tempest-VolumesActionsTest-775986377-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:15:01.659479 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-58245b5d-eef9-4b3d-97de-d0a2a64a89b9 tempest-VolumesActionsTest-775986377 tempest-VolumesActionsTest-775986377-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:15:01.661734 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-58245b5d-eef9-4b3d-97de-d0a2a64a89b9 tempest-VolumesActionsTest-775986377 tempest-VolumesActionsTest-775986377-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:15:01.663314 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-58245b5d-eef9-4b3d-97de-d0a2a64a89b9 tempest-VolumesActionsTest-775986377 tempest-VolumesActionsTest-775986377-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:15:01.664612 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-58245b5d-eef9-4b3d-97de-d0a2a64a89b9 tempest-VolumesActionsTest-775986377 tempest-VolumesActionsTest-775986377-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:15:01.665201 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-58245b5d-eef9-4b3d-97de-d0a2a64a89b9 tempest-VolumesActionsTest-775986377 tempest-VolumesActionsTest-775986377-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:15:01.693580 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.wsgi [None req-58245b5d-eef9-4b3d-97de-d0a2a64a89b9 tempest-VolumesActionsTest-775986377 tempest-VolumesActionsTest-775986377-project] HTTP exception thrown: Instance 118d56f5-a1b4-402d-9e43-b432c2b63b14 could not be found. Aug 23 07:15:01.696006 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-58245b5d-eef9-4b3d-97de-d0a2a64a89b9 tempest-VolumesActionsTest-775986377 tempest-VolumesActionsTest-775986377-project] Request method failure captured: Aug 23 07:15:01.696006 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: request: GET /compute/v2.1/servers/118d56f5-a1b4-402d-9e43-b432c2b63b14 HTTP/1.1 Aug 23 07:15:01.696006 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: Accept: application/json Aug 23 07:15:01.696006 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: Accept-Encoding: identity Aug 23 07:15:01.696006 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: Connection: close Aug 23 07:15:01.696006 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: Content-Length: 0 Aug 23 07:15:01.696006 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: Content-Type: application/json Aug 23 07:15:01.696006 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: Host: 10.222.0.17 Aug 23 07:15:01.696006 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: Openstack-System-Scope: None Aug 23 07:15:01.696006 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: User-Agent: python-urllib3/1.26.11 Aug 23 07:15:01.696006 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-Auth-Token: gAAAAABjBH4wLWXVolk5tOBY9srh-W8M15AgOm0wjYKM5cfFv7ON2wMUFp_fjguxFLAzsUglL3IPbuzM-OIUnoocHY3jI89mhKK1wNVFt4gJx0lAo4bo-fthx83f9GoaftqzXyjBaeGoL-do17fvGJLY1a_UQYyfYYsFb4vhJPRDpo_cQpie_4I Aug 23 07:15:01.696006 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-Domain-Id: None Aug 23 07:15:01.696006 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-Domain-Name: None Aug 23 07:15:01.696006 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-Identity-Status: Confirmed Aug 23 07:15:01.696006 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-Is-Admin-Project: True Aug 23 07:15:01.696006 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-Project-Domain-Id: default Aug 23 07:15:01.696006 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-Project-Domain-Name: Default Aug 23 07:15:01.696006 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-Project-Id: 0a2ef3b6384a4194a26ba51078c425af Aug 23 07:15:01.696006 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-Project-Name: tempest-VolumesActionsTest-775986377 Aug 23 07:15:01.696006 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-Role: reader,member Aug 23 07:15:01.696006 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-Roles: reader,member Aug 23 07:15:01.697484 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/0a2ef3b6384a4194a26ba51078c425af"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/0a2ef3b6384a4194a26ba51078c425af"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_0a2ef3b6384a4194a26ba51078c425af"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/0a2ef3b6384a4194a26ba51078c425af"}]}] Aug 23 07:15:01.697484 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-Tenant: tempest-VolumesActionsTest-775986377 Aug 23 07:15:01.697484 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-Tenant-Id: 0a2ef3b6384a4194a26ba51078c425af Aug 23 07:15:01.697484 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-Tenant-Name: tempest-VolumesActionsTest-775986377 Aug 23 07:15:01.697484 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-User: tempest-VolumesActionsTest-775986377-project Aug 23 07:15:01.697484 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-User-Domain-Id: default Aug 23 07:15:01.697484 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-User-Domain-Name: Default Aug 23 07:15:01.697484 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-User-Id: 9f4d65ffaab942f29d449b64805c765a Aug 23 07:15:01.697484 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-User-Name: tempest-VolumesActionsTest-775986377-project Aug 23 07:15:01.697484 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: method: > Aug 23 07:15:01.697484 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: exception: Instance 118d56f5-a1b4-402d-9e43-b432c2b63b14 could not be found. Aug 23 07:15:01.697484 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: action_args: {'id': '118d56f5-a1b4-402d-9e43-b432c2b63b14'} Aug 23 07:15:01.701846 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 07:15:01.701846 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 07:15:01.701846 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 07:15:01.701846 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 07:15:01.701846 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 07:15:01.701846 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 07:15:01.701846 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 07:15:01.701846 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 07:15:01.701846 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 07:15:01.701846 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 07:15:01.701846 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 118d56f5-a1b4-402d-9e43-b432c2b63b14 could not be found. Aug 23 07:15:01.701846 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi Aug 23 07:15:01.701846 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 07:15:01.701846 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi Aug 23 07:15:01.701846 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 07:15:01.701846 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 07:15:01.701846 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 07:15:01.701846 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 07:15:01.701846 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 07:15:01.701846 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 07:15:01.703505 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 07:15:01.703505 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 07:15:01.703505 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 07:15:01.703505 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 07:15:01.703505 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 07:15:01.703505 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 07:15:01.703505 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 07:15:01.703505 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 118d56f5-a1b4-402d-9e43-b432c2b63b14 could not be found. Aug 23 07:15:01.703505 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi Aug 23 07:15:01.703505 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 07:15:01.703505 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi Aug 23 07:15:01.703505 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 07:15:01.703505 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 07:15:01.703505 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 07:15:01.703505 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 07:15:01.703505 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 07:15:01.703505 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 118d56f5-a1b4-402d-9e43-b432c2b63b14 could not be found. Aug 23 07:15:01.703505 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi Aug 23 07:15:01.704724 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-58245b5d-eef9-4b3d-97de-d0a2a64a89b9 tempest-VolumesActionsTest-775986377 tempest-VolumesActionsTest-775986377-project] Returning 404 to user: Instance 118d56f5-a1b4-402d-9e43-b432c2b63b14 could not be found. {{(pid=120798) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 07:15:01.704724 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [None req-58245b5d-eef9-4b3d-97de-d0a2a64a89b9 tempest-VolumesActionsTest-775986377 tempest-VolumesActionsTest-775986377-project] 10.222.0.17 "GET /compute/v2.1/servers/118d56f5-a1b4-402d-9e43-b432c2b63b14" status: 404 len: 111 microversion: 2.1 time: 0.066648 Aug 23 07:15:01.704724 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 180/368] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:15:01 2022] GET /compute/v2.1/servers/118d56f5-a1b4-402d-9e43-b432c2b63b14 => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 07:15:01.939451 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-6455d274-d239-41fa-8879-208503285606 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Calling method '>' {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:15:01.940879 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.compute.api [None req-6455d274-d239-41fa-8879-208503285606 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] [instance: b9418fe6-a57e-4a99-becb-19a4d3a52da1] Fetching instance by UUID {{(pid=120799) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:15:01.953221 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-6455d274-d239-41fa-8879-208503285606 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:15:01.954028 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-6455d274-d239-41fa-8879-208503285606 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:15:01.954732 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-6455d274-d239-41fa-8879-208503285606 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:15:01.955646 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-6455d274-d239-41fa-8879-208503285606 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:15:01.959194 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-6455d274-d239-41fa-8879-208503285606 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:15:01.959949 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-6455d274-d239-41fa-8879-208503285606 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:15:02.736052 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.policy [None req-6455d274-d239-41fa-8879-208503285606 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64d54cb95b264c18b45d90822507fae1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135367be6e3f4b3d965ee0d99fdca524', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120799) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:15:02.762561 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-6455d274-d239-41fa-8879-208503285606 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] 10.222.0.17 "GET /compute/v2.1/servers/b9418fe6-a57e-4a99-becb-19a4d3a52da1" status: 200 len: 1370 microversion: 2.1 time: 0.828376 Aug 23 07:15:02.764585 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 189/369] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:15:01 2022] GET /compute/v2.1/servers/b9418fe6-a57e-4a99-becb-19a4d3a52da1 => generated 1370 bytes in 838 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:15:03.791386 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-8856a727-5b7c-431b-9ed3-ad13948767ca tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Calling method '>' {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:15:03.792747 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.compute.api [None req-8856a727-5b7c-431b-9ed3-ad13948767ca tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] [instance: b9418fe6-a57e-4a99-becb-19a4d3a52da1] Fetching instance by UUID {{(pid=120798) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:15:03.807513 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-8856a727-5b7c-431b-9ed3-ad13948767ca tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:15:03.808935 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-8856a727-5b7c-431b-9ed3-ad13948767ca tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:15:03.810284 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-8856a727-5b7c-431b-9ed3-ad13948767ca tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:15:03.811293 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-8856a727-5b7c-431b-9ed3-ad13948767ca tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:15:03.812304 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-8856a727-5b7c-431b-9ed3-ad13948767ca tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:15:03.812991 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-8856a727-5b7c-431b-9ed3-ad13948767ca tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:15:03.988623 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.policy [None req-8856a727-5b7c-431b-9ed3-ad13948767ca tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64d54cb95b264c18b45d90822507fae1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135367be6e3f4b3d965ee0d99fdca524', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120798) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:15:03.999566 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [None req-8856a727-5b7c-431b-9ed3-ad13948767ca tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] 10.222.0.17 "GET /compute/v2.1/servers/b9418fe6-a57e-4a99-becb-19a4d3a52da1" status: 200 len: 1370 microversion: 2.1 time: 0.214276 Aug 23 07:15:04.000448 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 181/370] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:15:03 2022] GET /compute/v2.1/servers/b9418fe6-a57e-4a99-becb-19a4d3a52da1 => generated 1370 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:15:05.023000 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-422799bc-73ea-48c3-a65a-1ddbcb872f23 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Calling method '>' {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:15:05.023713 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.compute.api [None req-422799bc-73ea-48c3-a65a-1ddbcb872f23 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] [instance: b9418fe6-a57e-4a99-becb-19a4d3a52da1] Fetching instance by UUID {{(pid=120799) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:15:05.030721 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-422799bc-73ea-48c3-a65a-1ddbcb872f23 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:15:05.037546 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-422799bc-73ea-48c3-a65a-1ddbcb872f23 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:15:05.038215 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-422799bc-73ea-48c3-a65a-1ddbcb872f23 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:15:05.038987 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-422799bc-73ea-48c3-a65a-1ddbcb872f23 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:15:05.039667 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-422799bc-73ea-48c3-a65a-1ddbcb872f23 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:15:05.040292 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-422799bc-73ea-48c3-a65a-1ddbcb872f23 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:15:05.073431 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG dbcounter [-] [120799] Writing DB stats nova_cell1:SELECT=100 {{(pid=120799) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:15:05.266471 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.policy [None req-422799bc-73ea-48c3-a65a-1ddbcb872f23 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64d54cb95b264c18b45d90822507fae1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135367be6e3f4b3d965ee0d99fdca524', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120799) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:15:05.278639 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-422799bc-73ea-48c3-a65a-1ddbcb872f23 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] 10.222.0.17 "GET /compute/v2.1/servers/b9418fe6-a57e-4a99-becb-19a4d3a52da1" status: 200 len: 1370 microversion: 2.1 time: 0.260016 Aug 23 07:15:05.285457 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 190/371] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:15:05 2022] GET /compute/v2.1/servers/b9418fe6-a57e-4a99-becb-19a4d3a52da1 => generated 1370 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:15:06.298840 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-62d5d1a0-82e2-41b4-ac6e-d81dd419514e tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Calling method '>' {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:15:06.299397 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.compute.api [None req-62d5d1a0-82e2-41b4-ac6e-d81dd419514e tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] [instance: b9418fe6-a57e-4a99-becb-19a4d3a52da1] Fetching instance by UUID {{(pid=120798) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:15:06.319948 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-62d5d1a0-82e2-41b4-ac6e-d81dd419514e tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:15:06.320454 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-62d5d1a0-82e2-41b4-ac6e-d81dd419514e tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:15:06.320883 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-62d5d1a0-82e2-41b4-ac6e-d81dd419514e tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:15:06.321617 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-62d5d1a0-82e2-41b4-ac6e-d81dd419514e tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:15:06.322067 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-62d5d1a0-82e2-41b4-ac6e-d81dd419514e tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:15:06.322490 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-62d5d1a0-82e2-41b4-ac6e-d81dd419514e tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:15:06.644275 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.policy [None req-62d5d1a0-82e2-41b4-ac6e-d81dd419514e tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64d54cb95b264c18b45d90822507fae1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135367be6e3f4b3d965ee0d99fdca524', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120798) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:15:06.655064 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [None req-62d5d1a0-82e2-41b4-ac6e-d81dd419514e tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] 10.222.0.17 "GET /compute/v2.1/servers/b9418fe6-a57e-4a99-becb-19a4d3a52da1" status: 200 len: 1370 microversion: 2.1 time: 0.360280 Aug 23 07:15:06.656429 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 182/372] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:15:06 2022] GET /compute/v2.1/servers/b9418fe6-a57e-4a99-becb-19a4d3a52da1 => generated 1370 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:15:07.173398 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [req-753c0fbc-edce-4ff9-85f3-18bd7dbe29cd req-1c2e7eae-afe8-4499-9ec3-e63ea2283f12 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b9418fe6-a57e-4a99-becb-19a4d3a52da1", "name": "network-vif-plugged", "status": "completed", "tag": "13257b29-baec-4cb2-9910-64f78a6db6ba"}]} {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 07:15:07.195383 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [req-753c0fbc-edce-4ff9-85f3-18bd7dbe29cd req-1c2e7eae-afe8-4499-9ec3-e63ea2283f12 service nova] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:15:07.195982 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [req-753c0fbc-edce-4ff9-85f3-18bd7dbe29cd req-1c2e7eae-afe8-4499-9ec3-e63ea2283f12 service nova] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:15:07.196486 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [req-753c0fbc-edce-4ff9-85f3-18bd7dbe29cd req-1c2e7eae-afe8-4499-9ec3-e63ea2283f12 service nova] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:15:07.229753 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.compute.server_external_events [req-753c0fbc-edce-4ff9-85f3-18bd7dbe29cd req-1c2e7eae-afe8-4499-9ec3-e63ea2283f12 service nova] Creating event network-vif-plugged:13257b29-baec-4cb2-9910-64f78a6db6ba for instance b9418fe6-a57e-4a99-becb-19a4d3a52da1 on hv-cinder-85409 Aug 23 07:15:07.245379 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [req-753c0fbc-edce-4ff9-85f3-18bd7dbe29cd req-1c2e7eae-afe8-4499-9ec3-e63ea2283f12 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076434 Aug 23 07:15:07.247319 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 191/373] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Aug 23 07:15:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 07:15:07.684431 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-234b4ad1-0495-4de0-814f-a040bdd5f891 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Calling method '>' {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:15:07.685887 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.compute.api [None req-234b4ad1-0495-4de0-814f-a040bdd5f891 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] [instance: b9418fe6-a57e-4a99-becb-19a4d3a52da1] Fetching instance by UUID {{(pid=120798) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:15:07.693554 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-234b4ad1-0495-4de0-814f-a040bdd5f891 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:15:07.694637 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-234b4ad1-0495-4de0-814f-a040bdd5f891 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:15:07.701194 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-234b4ad1-0495-4de0-814f-a040bdd5f891 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:15:07.702188 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-234b4ad1-0495-4de0-814f-a040bdd5f891 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:15:07.702677 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-234b4ad1-0495-4de0-814f-a040bdd5f891 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:15:07.703101 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-234b4ad1-0495-4de0-814f-a040bdd5f891 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:15:07.936839 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.policy [None req-234b4ad1-0495-4de0-814f-a040bdd5f891 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64d54cb95b264c18b45d90822507fae1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135367be6e3f4b3d965ee0d99fdca524', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120798) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:15:07.944837 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [None req-234b4ad1-0495-4de0-814f-a040bdd5f891 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] 10.222.0.17 "GET /compute/v2.1/servers/b9418fe6-a57e-4a99-becb-19a4d3a52da1" status: 200 len: 1370 microversion: 2.1 time: 0.268638 Aug 23 07:15:07.952220 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 183/374] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:15:07 2022] GET /compute/v2.1/servers/b9418fe6-a57e-4a99-becb-19a4d3a52da1 => generated 1370 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:15:08.973053 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-cbd1539a-2960-4f58-9bb4-de37dcf7f7eb tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Calling method '>' {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:15:08.973607 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.compute.api [None req-cbd1539a-2960-4f58-9bb4-de37dcf7f7eb tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] [instance: b9418fe6-a57e-4a99-becb-19a4d3a52da1] Fetching instance by UUID {{(pid=120799) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:15:09.012825 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-cbd1539a-2960-4f58-9bb4-de37dcf7f7eb tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:15:09.016463 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-cbd1539a-2960-4f58-9bb4-de37dcf7f7eb tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:15:09.017139 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-cbd1539a-2960-4f58-9bb4-de37dcf7f7eb tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:15:09.031789 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-cbd1539a-2960-4f58-9bb4-de37dcf7f7eb tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:15:09.033112 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-cbd1539a-2960-4f58-9bb4-de37dcf7f7eb tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:15:09.033549 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-cbd1539a-2960-4f58-9bb4-de37dcf7f7eb tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:15:09.274120 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.policy [None req-cbd1539a-2960-4f58-9bb4-de37dcf7f7eb tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64d54cb95b264c18b45d90822507fae1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135367be6e3f4b3d965ee0d99fdca524', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120799) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:15:09.288205 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-cbd1539a-2960-4f58-9bb4-de37dcf7f7eb tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] 10.222.0.17 "GET /compute/v2.1/servers/b9418fe6-a57e-4a99-becb-19a4d3a52da1" status: 200 len: 1370 microversion: 2.1 time: 0.316695 Aug 23 07:15:09.291108 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 192/375] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:15:08 2022] GET /compute/v2.1/servers/b9418fe6-a57e-4a99-becb-19a4d3a52da1 => generated 1370 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:15:10.312281 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-d988c161-f20d-43d1-a097-96e6dfd2fa36 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Calling method '>' {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:15:10.312902 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.compute.api [None req-d988c161-f20d-43d1-a097-96e6dfd2fa36 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] [instance: b9418fe6-a57e-4a99-becb-19a4d3a52da1] Fetching instance by UUID {{(pid=120798) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:15:10.325226 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-d988c161-f20d-43d1-a097-96e6dfd2fa36 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:15:10.330413 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-d988c161-f20d-43d1-a097-96e6dfd2fa36 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:15:10.331618 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-d988c161-f20d-43d1-a097-96e6dfd2fa36 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:15:10.334492 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-d988c161-f20d-43d1-a097-96e6dfd2fa36 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:15:10.337286 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-d988c161-f20d-43d1-a097-96e6dfd2fa36 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:15:10.338306 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-d988c161-f20d-43d1-a097-96e6dfd2fa36 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:15:10.580185 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.policy [None req-d988c161-f20d-43d1-a097-96e6dfd2fa36 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64d54cb95b264c18b45d90822507fae1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135367be6e3f4b3d965ee0d99fdca524', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120798) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:15:10.590225 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [None req-d988c161-f20d-43d1-a097-96e6dfd2fa36 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] 10.222.0.17 "GET /compute/v2.1/servers/b9418fe6-a57e-4a99-becb-19a4d3a52da1" status: 200 len: 1370 microversion: 2.1 time: 0.281789 Aug 23 07:15:10.591120 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 184/376] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:15:10 2022] GET /compute/v2.1/servers/b9418fe6-a57e-4a99-becb-19a4d3a52da1 => generated 1370 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:15:11.620584 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-429d981b-7d5c-47d6-94ce-fef72d314fc3 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Calling method '>' {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:15:11.622013 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.compute.api [None req-429d981b-7d5c-47d6-94ce-fef72d314fc3 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] [instance: b9418fe6-a57e-4a99-becb-19a4d3a52da1] Fetching instance by UUID {{(pid=120799) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:15:11.635575 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-429d981b-7d5c-47d6-94ce-fef72d314fc3 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:15:11.636011 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-429d981b-7d5c-47d6-94ce-fef72d314fc3 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:15:11.636437 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-429d981b-7d5c-47d6-94ce-fef72d314fc3 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:15:11.664699 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-429d981b-7d5c-47d6-94ce-fef72d314fc3 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:15:11.665235 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-429d981b-7d5c-47d6-94ce-fef72d314fc3 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.028s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:15:11.673894 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-429d981b-7d5c-47d6-94ce-fef72d314fc3 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:15:12.200245 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.policy [None req-429d981b-7d5c-47d6-94ce-fef72d314fc3 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64d54cb95b264c18b45d90822507fae1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135367be6e3f4b3d965ee0d99fdca524', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120799) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:15:12.217465 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-429d981b-7d5c-47d6-94ce-fef72d314fc3 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] 10.222.0.17 "GET /compute/v2.1/servers/b9418fe6-a57e-4a99-becb-19a4d3a52da1" status: 200 len: 1370 microversion: 2.1 time: 0.608186 Aug 23 07:15:12.221185 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 193/377] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:15:11 2022] GET /compute/v2.1/servers/b9418fe6-a57e-4a99-becb-19a4d3a52da1 => generated 1370 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:15:13.240427 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-822a992c-1ebd-47cc-802f-00be1ccf5397 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Calling method '>' {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:15:13.241044 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.compute.api [None req-822a992c-1ebd-47cc-802f-00be1ccf5397 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] [instance: b9418fe6-a57e-4a99-becb-19a4d3a52da1] Fetching instance by UUID {{(pid=120798) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:15:13.252567 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-822a992c-1ebd-47cc-802f-00be1ccf5397 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:15:13.253056 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-822a992c-1ebd-47cc-802f-00be1ccf5397 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:15:13.253480 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-822a992c-1ebd-47cc-802f-00be1ccf5397 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:15:13.265480 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-822a992c-1ebd-47cc-802f-00be1ccf5397 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:15:13.265980 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-822a992c-1ebd-47cc-802f-00be1ccf5397 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:15:13.266413 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-822a992c-1ebd-47cc-802f-00be1ccf5397 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:15:13.810828 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.policy [None req-822a992c-1ebd-47cc-802f-00be1ccf5397 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64d54cb95b264c18b45d90822507fae1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135367be6e3f4b3d965ee0d99fdca524', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120798) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:15:13.833757 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [None req-822a992c-1ebd-47cc-802f-00be1ccf5397 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] 10.222.0.17 "GET /compute/v2.1/servers/b9418fe6-a57e-4a99-becb-19a4d3a52da1" status: 200 len: 1565 microversion: 2.1 time: 0.590688 Aug 23 07:15:13.836301 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 185/378] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:15:13 2022] GET /compute/v2.1/servers/b9418fe6-a57e-4a99-becb-19a4d3a52da1 => generated 1565 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:15:13.863529 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-5c3b1385-b2ae-46a1-8fef-004b7b23a137 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Calling method '>' {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:15:13.864217 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.compute.api [None req-5c3b1385-b2ae-46a1-8fef-004b7b23a137 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] [instance: b9418fe6-a57e-4a99-becb-19a4d3a52da1] Fetching instance by UUID {{(pid=120799) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:15:13.875732 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-5c3b1385-b2ae-46a1-8fef-004b7b23a137 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:15:13.876380 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-5c3b1385-b2ae-46a1-8fef-004b7b23a137 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:15:13.877747 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-5c3b1385-b2ae-46a1-8fef-004b7b23a137 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:15:13.879950 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-5c3b1385-b2ae-46a1-8fef-004b7b23a137 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:15:13.880552 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-5c3b1385-b2ae-46a1-8fef-004b7b23a137 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:15:13.884362 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-5c3b1385-b2ae-46a1-8fef-004b7b23a137 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:15:14.131991 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-5c3b1385-b2ae-46a1-8fef-004b7b23a137 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] 10.222.0.17 "GET /compute/v2.1/servers/b9418fe6-a57e-4a99-becb-19a4d3a52da1/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.278315 Aug 23 07:15:14.132890 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 194/379] 10.222.0.17 () {58 vars in 1275 bytes} [Tue Aug 23 07:15:13 2022] GET /compute/v2.1/servers/b9418fe6-a57e-4a99-becb-19a4d3a52da1/os-interface => generated 285 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 07:15:15.845336 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-6519c5f1-7ec4-4262-9d8b-528aa737915b tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] Action: 'create', calling method: .version_select at 0x7fe3c63a45e0>, body: {"keypair": {"name": "tempest-TestShelveInstance-118391273", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBINybL0Q0Tr6koQkvK0xO5MHV8yM+Fiog2ZrS2blwQTXC9DoEKnw+l+fr97j6wjBnsLoG6NcM8+Hq64TjM7owshVx0p4MA8FRbC+4cELyammRtZR/RhtHsxDnQFXLEX4cg=="}} {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 07:15:15.894356 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.quota [None req-6519c5f1-7ec4-4262-9d8b-528aa737915b tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] Getting quotas for project fd004facbaed41a7a54a3ed6a6a44305. Resources: {'key_pairs'} {{(pid=120798) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 07:15:15.917259 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.quota [None req-6519c5f1-7ec4-4262-9d8b-528aa737915b tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] Getting quotas for user c26232f042844a898c19d1f63152b428 and project fd004facbaed41a7a54a3ed6a6a44305. Resources: {'key_pairs'} {{(pid=120798) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 07:15:15.963938 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG dbcounter [-] [120798] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=4,nova_api:UPDATE=2 {{(pid=120798) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:15:16.007547 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [None req-6519c5f1-7ec4-4262-9d8b-528aa737915b tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.586147 Aug 23 07:15:16.014165 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 186/380] 10.222.0.17 () {60 vars in 1159 bytes} [Tue Aug 23 07:15:15 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 07:15:17.595357 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [req-00791e72-d0ec-4979-b7ef-81150be359fc req-22daecaa-c47d-45bf-8984-dfb247044b7f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b9418fe6-a57e-4a99-becb-19a4d3a52da1", "tag": "13257b29-baec-4cb2-9910-64f78a6db6ba"}]} {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 07:15:17.605845 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG dbcounter [-] [120799] Writing DB stats nova_api:SELECT=63 {{(pid=120799) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:15:17.613278 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [req-00791e72-d0ec-4979-b7ef-81150be359fc req-22daecaa-c47d-45bf-8984-dfb247044b7f service nova] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:15:17.614277 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [req-00791e72-d0ec-4979-b7ef-81150be359fc req-22daecaa-c47d-45bf-8984-dfb247044b7f service nova] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:15:17.614854 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [req-00791e72-d0ec-4979-b7ef-81150be359fc req-22daecaa-c47d-45bf-8984-dfb247044b7f service nova] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:15:17.630217 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.compute.server_external_events [req-00791e72-d0ec-4979-b7ef-81150be359fc req-22daecaa-c47d-45bf-8984-dfb247044b7f service nova] Creating event network-changed:13257b29-baec-4cb2-9910-64f78a6db6ba for instance b9418fe6-a57e-4a99-becb-19a4d3a52da1 on hv-cinder-85409 Aug 23 07:15:17.635297 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [req-00791e72-d0ec-4979-b7ef-81150be359fc req-22daecaa-c47d-45bf-8984-dfb247044b7f service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054930 Aug 23 07:15:17.636923 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 195/381] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Aug 23 07:15:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 07:15:37.051350 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG dbcounter [-] [120798] Writing DB stats nova_cell1:SELECT=42 {{(pid=120798) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:15:37.052980 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG dbcounter [-] [120798] Writing DB stats nova_cell0:SELECT=4 {{(pid=120798) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:15:37.493102 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-2cd9f772-b04f-43b8-9456-553866939c6c tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Action: 'create', calling method: .version_select at 0x7fe3c610f5e0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1565151740", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHiJmKbkfFfdCiMKpLET7xsKQWvgp/LvjOWCnIRCKrqsiCOKRycPowjZYqdDYAc6KSGHriuGoz6UarwG1vjU9J8RKVguDVnRhDEJlgcP18vyfkTcaBGVKbk7ULp+X6zyhg=="}} {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 07:15:37.516042 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.quota [None req-2cd9f772-b04f-43b8-9456-553866939c6c tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Getting quotas for project f43b271d00f74eb7aa3d0719315c5a99. Resources: {'key_pairs'} {{(pid=120798) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 07:15:37.522758 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.quota [None req-2cd9f772-b04f-43b8-9456-553866939c6c tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Getting quotas for user ffd12f09606b4e6ba12f63b976df1884 and project f43b271d00f74eb7aa3d0719315c5a99. Resources: {'key_pairs'} {{(pid=120798) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 07:15:37.603891 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [None req-2cd9f772-b04f-43b8-9456-553866939c6c tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.553985 Aug 23 07:15:37.604600 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 187/382] 10.222.0.17 () {60 vars in 1159 bytes} [Tue Aug 23 07:15:37 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 07:15:39.732220 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-38c8b5da-ac95-43ba-9ac3-b5fb0724750d tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Calling method '>' {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:15:39.733196 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.compute.api [None req-38c8b5da-ac95-43ba-9ac3-b5fb0724750d tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] [instance: ce9a9c42-b9ed-40b1-b72c-390b85578204] Fetching instance by UUID {{(pid=120799) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:15:39.751156 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG dbcounter [-] [120799] Writing DB stats nova_api:SELECT=1 {{(pid=120799) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:15:39.752749 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG dbcounter [-] [120799] Writing DB stats nova_cell1:SELECT=22 {{(pid=120799) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:15:39.759340 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-38c8b5da-ac95-43ba-9ac3-b5fb0724750d tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:15:39.760054 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-38c8b5da-ac95-43ba-9ac3-b5fb0724750d tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:15:39.760715 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-38c8b5da-ac95-43ba-9ac3-b5fb0724750d tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:15:39.764051 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-38c8b5da-ac95-43ba-9ac3-b5fb0724750d tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:15:39.764895 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-38c8b5da-ac95-43ba-9ac3-b5fb0724750d tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:15:39.765470 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-38c8b5da-ac95-43ba-9ac3-b5fb0724750d tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:15:39.824255 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-38c8b5da-ac95-43ba-9ac3-b5fb0724750d tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] 10.222.0.17 "GET /compute/v2.1/servers/ce9a9c42-b9ed-40b1-b72c-390b85578204/ips" status: 200 len: 151 microversion: 2.1 time: 0.098166 Aug 23 07:15:39.827132 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 196/383] 10.222.0.17 () {58 vars in 1248 bytes} [Tue Aug 23 07:15:39 2022] GET /compute/v2.1/servers/ce9a9c42-b9ed-40b1-b72c-390b85578204/ips => generated 151 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 07:15:39.839137 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-0494b6fc-b7f0-407b-9960-ef36724c23f7 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f1522f2b-5404-4c16-a30d-7283a999033d"}} {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 07:15:39.841941 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.compute.api [None req-0494b6fc-b7f0-407b-9960-ef36724c23f7 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] [instance: ce9a9c42-b9ed-40b1-b72c-390b85578204] Fetching instance by UUID {{(pid=120798) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:15:39.859356 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-0494b6fc-b7f0-407b-9960-ef36724c23f7 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:15:39.859889 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-0494b6fc-b7f0-407b-9960-ef36724c23f7 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:15:39.860324 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-0494b6fc-b7f0-407b-9960-ef36724c23f7 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:15:39.861035 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-0494b6fc-b7f0-407b-9960-ef36724c23f7 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:15:39.875016 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-0494b6fc-b7f0-407b-9960-ef36724c23f7 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:15:39.875526 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-0494b6fc-b7f0-407b-9960-ef36724c23f7 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:15:40.170083 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.wsgi [None req-0494b6fc-b7f0-407b-9960-ef36724c23f7 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] HTTP exception thrown: Invalid volume: volume f1522f2b-5404-4c16-a30d-7283a999033d is already attached to instances: 057628ba-a74f-426e-ba25-a3b79c3b6339 Aug 23 07:15:40.177351 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-0494b6fc-b7f0-407b-9960-ef36724c23f7 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Request method failure captured: Aug 23 07:15:40.177351 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: request: POST /compute/v2.1/servers/ce9a9c42-b9ed-40b1-b72c-390b85578204/os-volume_attachments HTTP/1.1 Aug 23 07:15:40.177351 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: Accept: application/json Aug 23 07:15:40.177351 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: Accept-Encoding: identity Aug 23 07:15:40.177351 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: Connection: close Aug 23 07:15:40.177351 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: Content-Length: 74 Aug 23 07:15:40.177351 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: Content-Type: application/json Aug 23 07:15:40.177351 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: Host: 10.222.0.17 Aug 23 07:15:40.177351 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: Openstack-System-Scope: None Aug 23 07:15:40.177351 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: User-Agent: python-urllib3/1.26.11 Aug 23 07:15:40.177351 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-Auth-Token: gAAAAABjBH3ZHMVVLXoXwNDfQQNusO5G5GN02PnHIiEEKbUNElvY7Grlo8u229xKVdQ1mmEwia_EWu2jEutb1fyYPOf6jNbBH41b4mzr6zipvsQ6BtbbjaOUpVuAli-fuxu6YJZFtXM3RMEYq-CLnj1C8WH54zH3cmVnSq_F2KlyAaedAUE420Q Aug 23 07:15:40.177351 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-Domain-Id: None Aug 23 07:15:40.177351 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-Domain-Name: None Aug 23 07:15:40.177351 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-Identity-Status: Confirmed Aug 23 07:15:40.177351 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-Is-Admin-Project: True Aug 23 07:15:40.177351 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-Project-Domain-Id: default Aug 23 07:15:40.177351 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-Project-Domain-Name: Default Aug 23 07:15:40.177351 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-Project-Id: eb44f62fa62e46528712f24479cbb19f Aug 23 07:15:40.177351 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-Project-Name: tempest-AttachVolumeNegativeTest-880454297 Aug 23 07:15:40.177351 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-Role: reader,member Aug 23 07:15:40.177351 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-Roles: reader,member Aug 23 07:15:40.178774 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/eb44f62fa62e46528712f24479cbb19f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/eb44f62fa62e46528712f24479cbb19f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_eb44f62fa62e46528712f24479cbb19f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/eb44f62fa62e46528712f24479cbb19f"}]}] Aug 23 07:15:40.178774 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-Tenant: tempest-AttachVolumeNegativeTest-880454297 Aug 23 07:15:40.178774 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-Tenant-Id: eb44f62fa62e46528712f24479cbb19f Aug 23 07:15:40.178774 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-880454297 Aug 23 07:15:40.178774 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-User: tempest-AttachVolumeNegativeTest-880454297-project Aug 23 07:15:40.178774 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-User-Domain-Id: default Aug 23 07:15:40.178774 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-User-Domain-Name: Default Aug 23 07:15:40.178774 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-User-Id: 471dc5c1db64411ab1d80ad6c038e519 Aug 23 07:15:40.178774 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-User-Name: tempest-AttachVolumeNegativeTest-880454297-project Aug 23 07:15:40.178774 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: Aug 23 07:15:40.178774 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: {"volumeAttachment": {"volumeId": "f1522f2b-5404-4c16-a30d-7283a999033d"}} Aug 23 07:15:40.178774 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: method: > Aug 23 07:15:40.179611 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: exception: Invalid volume: volume f1522f2b-5404-4c16-a30d-7283a999033d is already attached to instances: 057628ba-a74f-426e-ba25-a3b79c3b6339 Aug 23 07:15:40.179611 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: action_args: {'server_id': 'ce9a9c42-b9ed-40b1-b72c-390b85578204', 'body': {'volumeAttachment': {'volumeId': 'f1522f2b-5404-4c16-a30d-7283a999033d'}}} Aug 23 07:15:40.179611 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 07:15:40.179611 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 07:15:40.179611 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 23 07:15:40.179611 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 23 07:15:40.179611 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 23 07:15:40.179611 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 23 07:15:40.179611 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 23 07:15:40.179611 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 23 07:15:40.179611 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5113, in attach_volume Aug 23 07:15:40.179611 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 23 07:15:40.179611 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4953, in _check_volume_already_attached Aug 23 07:15:40.179611 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 23 07:15:40.179611 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume f1522f2b-5404-4c16-a30d-7283a999033d is already attached to instances: 057628ba-a74f-426e-ba25-a3b79c3b6339 Aug 23 07:15:40.179611 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi Aug 23 07:15:40.179611 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 07:15:40.179611 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi Aug 23 07:15:40.179611 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 07:15:40.180763 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 07:15:40.180763 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 07:15:40.180763 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 07:15:40.180763 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 07:15:40.180763 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 07:15:40.180763 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 07:15:40.180763 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 23 07:15:40.180763 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 23 07:15:40.180763 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 23 07:15:40.180763 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 23 07:15:40.180763 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 23 07:15:40.180763 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 23 07:15:40.180763 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 23 07:15:40.180763 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 23 07:15:40.180763 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume f1522f2b-5404-4c16-a30d-7283a999033d is already attached to instances: 057628ba-a74f-426e-ba25-a3b79c3b6339 Aug 23 07:15:40.180763 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi Aug 23 07:15:40.180763 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 07:15:40.180763 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi Aug 23 07:15:40.180763 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 07:15:40.180763 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 07:15:40.186429 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 07:15:40.186429 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 07:15:40.186429 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 07:15:40.186429 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume f1522f2b-5404-4c16-a30d-7283a999033d is already attached to instances: 057628ba-a74f-426e-ba25-a3b79c3b6339 Aug 23 07:15:40.186429 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi Aug 23 07:15:40.186429 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-0494b6fc-b7f0-407b-9960-ef36724c23f7 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Returning 400 to user: Invalid volume: volume f1522f2b-5404-4c16-a30d-7283a999033d is already attached to instances: 057628ba-a74f-426e-ba25-a3b79c3b6339 {{(pid=120798) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 07:15:40.186429 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [None req-0494b6fc-b7f0-407b-9960-ef36724c23f7 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] 10.222.0.17 "POST /compute/v2.1/servers/ce9a9c42-b9ed-40b1-b72c-390b85578204/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.346688 Aug 23 07:15:40.186429 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 188/384] 10.222.0.17 () {60 vars in 1323 bytes} [Tue Aug 23 07:15:39 2022] POST /compute/v2.1/servers/ce9a9c42-b9ed-40b1-b72c-390b85578204/os-volume_attachments => generated 174 bytes in 348 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 23 07:15:40.190934 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-56c1b53b-a643-4bad-ba9d-b68192667169 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Calling method '>' {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:15:40.191449 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.compute.api [None req-56c1b53b-a643-4bad-ba9d-b68192667169 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] [instance: ce9a9c42-b9ed-40b1-b72c-390b85578204] Fetching instance by UUID {{(pid=120799) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:15:40.217664 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-56c1b53b-a643-4bad-ba9d-b68192667169 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:15:40.218326 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-56c1b53b-a643-4bad-ba9d-b68192667169 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:15:40.218775 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-56c1b53b-a643-4bad-ba9d-b68192667169 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:15:40.219561 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-56c1b53b-a643-4bad-ba9d-b68192667169 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:15:40.220014 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-56c1b53b-a643-4bad-ba9d-b68192667169 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:15:40.220433 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-56c1b53b-a643-4bad-ba9d-b68192667169 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:15:40.271459 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.compute.api [None req-56c1b53b-a643-4bad-ba9d-b68192667169 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] [instance: ce9a9c42-b9ed-40b1-b72c-390b85578204] Going to try to terminate instance {{(pid=120799) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 07:15:40.482408 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-56c1b53b-a643-4bad-ba9d-b68192667169 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] 10.222.0.17 "DELETE /compute/v2.1/servers/ce9a9c42-b9ed-40b1-b72c-390b85578204" status: 204 len: 0 microversion: 2.1 time: 0.295367 Aug 23 07:15:40.494128 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 197/385] 10.222.0.17 () {58 vars in 1239 bytes} [Tue Aug 23 07:15:40 2022] DELETE /compute/v2.1/servers/ce9a9c42-b9ed-40b1-b72c-390b85578204 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 23 07:15:40.502670 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-1edf7157-2e34-4970-99ea-e9d3ea468f10 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Calling method '>' {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:15:40.503321 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.compute.api [None req-1edf7157-2e34-4970-99ea-e9d3ea468f10 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] [instance: ce9a9c42-b9ed-40b1-b72c-390b85578204] Fetching instance by UUID {{(pid=120798) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:15:40.511182 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-1edf7157-2e34-4970-99ea-e9d3ea468f10 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:15:40.512256 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-1edf7157-2e34-4970-99ea-e9d3ea468f10 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:15:40.514573 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-1edf7157-2e34-4970-99ea-e9d3ea468f10 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:15:40.515606 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-1edf7157-2e34-4970-99ea-e9d3ea468f10 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:15:40.516270 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-1edf7157-2e34-4970-99ea-e9d3ea468f10 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:15:40.516894 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-1edf7157-2e34-4970-99ea-e9d3ea468f10 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:15:40.794757 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.policy [None req-1edf7157-2e34-4970-99ea-e9d3ea468f10 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '471dc5c1db64411ab1d80ad6c038e519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb44f62fa62e46528712f24479cbb19f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120798) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:15:40.808029 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [None req-1edf7157-2e34-4970-99ea-e9d3ea468f10 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] 10.222.0.17 "GET /compute/v2.1/servers/ce9a9c42-b9ed-40b1-b72c-390b85578204" status: 200 len: 1682 microversion: 2.1 time: 0.308891 Aug 23 07:15:40.809199 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 189/386] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:15:40 2022] GET /compute/v2.1/servers/ce9a9c42-b9ed-40b1-b72c-390b85578204 => generated 1682 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:15:41.831058 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-9057226f-5fe7-4d32-aebc-ce9c5408d188 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Calling method '>' {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:15:41.832490 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.compute.api [None req-9057226f-5fe7-4d32-aebc-ce9c5408d188 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] [instance: ce9a9c42-b9ed-40b1-b72c-390b85578204] Fetching instance by UUID {{(pid=120799) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:15:41.841698 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-9057226f-5fe7-4d32-aebc-ce9c5408d188 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:15:41.855153 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-9057226f-5fe7-4d32-aebc-ce9c5408d188 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:15:41.857244 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-9057226f-5fe7-4d32-aebc-ce9c5408d188 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:15:41.860615 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-9057226f-5fe7-4d32-aebc-ce9c5408d188 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:15:41.861299 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-9057226f-5fe7-4d32-aebc-ce9c5408d188 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:15:41.861896 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-9057226f-5fe7-4d32-aebc-ce9c5408d188 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:15:42.153817 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.policy [None req-9057226f-5fe7-4d32-aebc-ce9c5408d188 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '471dc5c1db64411ab1d80ad6c038e519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb44f62fa62e46528712f24479cbb19f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120799) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:15:42.169285 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-9057226f-5fe7-4d32-aebc-ce9c5408d188 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] 10.222.0.17 "GET /compute/v2.1/servers/ce9a9c42-b9ed-40b1-b72c-390b85578204" status: 200 len: 1682 microversion: 2.1 time: 0.339775 Aug 23 07:15:42.174980 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 198/387] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:15:41 2022] GET /compute/v2.1/servers/ce9a9c42-b9ed-40b1-b72c-390b85578204 => generated 1682 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:15:43.232870 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-eadfd3bd-01e6-4b29-b813-9f6c148d0d4a tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Calling method '>' {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:15:43.238208 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.compute.api [None req-eadfd3bd-01e6-4b29-b813-9f6c148d0d4a tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] [instance: ce9a9c42-b9ed-40b1-b72c-390b85578204] Fetching instance by UUID {{(pid=120798) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:15:43.272026 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-eadfd3bd-01e6-4b29-b813-9f6c148d0d4a tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:15:43.274904 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-eadfd3bd-01e6-4b29-b813-9f6c148d0d4a tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:15:43.275829 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-eadfd3bd-01e6-4b29-b813-9f6c148d0d4a tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:15:43.280154 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-eadfd3bd-01e6-4b29-b813-9f6c148d0d4a tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:15:43.281694 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-eadfd3bd-01e6-4b29-b813-9f6c148d0d4a tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:15:43.284759 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-eadfd3bd-01e6-4b29-b813-9f6c148d0d4a tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:15:44.437872 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.policy [None req-eadfd3bd-01e6-4b29-b813-9f6c148d0d4a tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '471dc5c1db64411ab1d80ad6c038e519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb44f62fa62e46528712f24479cbb19f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120798) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:15:44.458566 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [None req-eadfd3bd-01e6-4b29-b813-9f6c148d0d4a tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] 10.222.0.17 "GET /compute/v2.1/servers/ce9a9c42-b9ed-40b1-b72c-390b85578204" status: 200 len: 1682 microversion: 2.1 time: 1.262365 Aug 23 07:15:44.479075 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 190/388] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:15:43 2022] GET /compute/v2.1/servers/ce9a9c42-b9ed-40b1-b72c-390b85578204 => generated 1682 bytes in 1278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:15:44.927983 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [req-ed1ca490-dd70-414c-b757-65e13d33d96a req-82249481-f101-42fd-94b5-0fcc469d14d8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ce9a9c42-b9ed-40b1-b72c-390b85578204", "name": "network-vif-deleted", "tag": "934b5d8d-aefe-4c06-83af-f3bb1ed3c80c"}]} {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 07:15:44.976327 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [req-ed1ca490-dd70-414c-b757-65e13d33d96a req-82249481-f101-42fd-94b5-0fcc469d14d8 service nova] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:15:44.985279 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [req-ed1ca490-dd70-414c-b757-65e13d33d96a req-82249481-f101-42fd-94b5-0fcc469d14d8 service nova] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:15:44.985732 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [req-ed1ca490-dd70-414c-b757-65e13d33d96a req-82249481-f101-42fd-94b5-0fcc469d14d8 service nova] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:15:45.015172 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.compute.server_external_events [req-ed1ca490-dd70-414c-b757-65e13d33d96a req-82249481-f101-42fd-94b5-0fcc469d14d8 service nova] Creating event network-vif-deleted:934b5d8d-aefe-4c06-83af-f3bb1ed3c80c for instance ce9a9c42-b9ed-40b1-b72c-390b85578204 on hv-cinder-85409 Aug 23 07:15:45.031796 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [req-ed1ca490-dd70-414c-b757-65e13d33d96a req-82249481-f101-42fd-94b5-0fcc469d14d8 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.111719 Aug 23 07:15:45.034997 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 199/389] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Aug 23 07:15:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 07:15:45.483210 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-e8f37297-6b00-403d-85e4-1a22f50996f0 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Calling method '>' {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:15:45.484075 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.compute.api [None req-e8f37297-6b00-403d-85e4-1a22f50996f0 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] [instance: ce9a9c42-b9ed-40b1-b72c-390b85578204] Fetching instance by UUID {{(pid=120798) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:15:45.493143 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-e8f37297-6b00-403d-85e4-1a22f50996f0 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:15:45.493790 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-e8f37297-6b00-403d-85e4-1a22f50996f0 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:15:45.494422 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-e8f37297-6b00-403d-85e4-1a22f50996f0 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:15:45.495334 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-e8f37297-6b00-403d-85e4-1a22f50996f0 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:15:45.496091 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-e8f37297-6b00-403d-85e4-1a22f50996f0 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:15:45.496779 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-e8f37297-6b00-403d-85e4-1a22f50996f0 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:15:45.537068 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-e8f37297-6b00-403d-85e4-1a22f50996f0 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:15:45.538428 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-e8f37297-6b00-403d-85e4-1a22f50996f0 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:15:45.539302 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-e8f37297-6b00-403d-85e4-1a22f50996f0 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:15:45.540013 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.objects.instance [None req-e8f37297-6b00-403d-85e4-1a22f50996f0 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lazy-loading 'fault' on Instance uuid ce9a9c42-b9ed-40b1-b72c-390b85578204 {{(pid=120798) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 07:15:45.670280 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.policy [None req-e8f37297-6b00-403d-85e4-1a22f50996f0 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '471dc5c1db64411ab1d80ad6c038e519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb44f62fa62e46528712f24479cbb19f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120798) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:15:45.690591 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [None req-e8f37297-6b00-403d-85e4-1a22f50996f0 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] 10.222.0.17 "GET /compute/v2.1/servers/ce9a9c42-b9ed-40b1-b72c-390b85578204" status: 200 len: 1331 microversion: 2.1 time: 0.212715 Aug 23 07:15:45.710681 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 191/390] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:15:45 2022] GET /compute/v2.1/servers/ce9a9c42-b9ed-40b1-b72c-390b85578204 => generated 1331 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:15:46.716875 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-1c99d604-733e-497b-b6d2-caae5fda0d77 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Calling method '>' {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:15:46.718238 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.compute.api [None req-1c99d604-733e-497b-b6d2-caae5fda0d77 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] [instance: ce9a9c42-b9ed-40b1-b72c-390b85578204] Fetching instance by UUID {{(pid=120799) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:15:46.729669 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-1c99d604-733e-497b-b6d2-caae5fda0d77 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:15:46.732666 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-1c99d604-733e-497b-b6d2-caae5fda0d77 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:15:46.733309 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-1c99d604-733e-497b-b6d2-caae5fda0d77 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:15:46.739903 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-1c99d604-733e-497b-b6d2-caae5fda0d77 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:15:46.740889 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-1c99d604-733e-497b-b6d2-caae5fda0d77 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:15:46.741660 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-1c99d604-733e-497b-b6d2-caae5fda0d77 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:15:46.786066 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.wsgi [None req-1c99d604-733e-497b-b6d2-caae5fda0d77 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] HTTP exception thrown: Instance ce9a9c42-b9ed-40b1-b72c-390b85578204 could not be found. Aug 23 07:15:46.788015 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-1c99d604-733e-497b-b6d2-caae5fda0d77 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Request method failure captured: Aug 23 07:15:46.788015 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: request: GET /compute/v2.1/servers/ce9a9c42-b9ed-40b1-b72c-390b85578204 HTTP/1.1 Aug 23 07:15:46.788015 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: Accept: application/json Aug 23 07:15:46.788015 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: Accept-Encoding: identity Aug 23 07:15:46.788015 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: Connection: close Aug 23 07:15:46.788015 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: Content-Length: 0 Aug 23 07:15:46.788015 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: Content-Type: application/json Aug 23 07:15:46.788015 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: Host: 10.222.0.17 Aug 23 07:15:46.788015 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: Openstack-System-Scope: None Aug 23 07:15:46.788015 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: User-Agent: python-urllib3/1.26.11 Aug 23 07:15:46.788015 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-Auth-Token: gAAAAABjBH3ZHMVVLXoXwNDfQQNusO5G5GN02PnHIiEEKbUNElvY7Grlo8u229xKVdQ1mmEwia_EWu2jEutb1fyYPOf6jNbBH41b4mzr6zipvsQ6BtbbjaOUpVuAli-fuxu6YJZFtXM3RMEYq-CLnj1C8WH54zH3cmVnSq_F2KlyAaedAUE420Q Aug 23 07:15:46.788015 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-Domain-Id: None Aug 23 07:15:46.788015 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-Domain-Name: None Aug 23 07:15:46.788015 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-Identity-Status: Confirmed Aug 23 07:15:46.788015 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-Is-Admin-Project: True Aug 23 07:15:46.788015 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-Project-Domain-Id: default Aug 23 07:15:46.788015 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-Project-Domain-Name: Default Aug 23 07:15:46.788015 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-Project-Id: eb44f62fa62e46528712f24479cbb19f Aug 23 07:15:46.788015 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-Project-Name: tempest-AttachVolumeNegativeTest-880454297 Aug 23 07:15:46.788015 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-Role: reader,member Aug 23 07:15:46.788015 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-Roles: reader,member Aug 23 07:15:46.789596 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/eb44f62fa62e46528712f24479cbb19f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/eb44f62fa62e46528712f24479cbb19f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_eb44f62fa62e46528712f24479cbb19f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/eb44f62fa62e46528712f24479cbb19f"}]}] Aug 23 07:15:46.789596 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-Tenant: tempest-AttachVolumeNegativeTest-880454297 Aug 23 07:15:46.789596 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-Tenant-Id: eb44f62fa62e46528712f24479cbb19f Aug 23 07:15:46.789596 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-880454297 Aug 23 07:15:46.789596 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-User: tempest-AttachVolumeNegativeTest-880454297-project Aug 23 07:15:46.789596 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-User-Domain-Id: default Aug 23 07:15:46.789596 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-User-Domain-Name: Default Aug 23 07:15:46.789596 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-User-Id: 471dc5c1db64411ab1d80ad6c038e519 Aug 23 07:15:46.789596 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-User-Name: tempest-AttachVolumeNegativeTest-880454297-project Aug 23 07:15:46.789596 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: method: > Aug 23 07:15:46.789596 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: exception: Instance ce9a9c42-b9ed-40b1-b72c-390b85578204 could not be found. Aug 23 07:15:46.789596 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: action_args: {'id': 'ce9a9c42-b9ed-40b1-b72c-390b85578204'} Aug 23 07:15:46.790473 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 07:15:46.790473 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 07:15:46.790473 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 07:15:46.790473 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 07:15:46.790473 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 07:15:46.790473 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 07:15:46.790473 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 07:15:46.790473 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 07:15:46.790473 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 07:15:46.790473 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 07:15:46.790473 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ce9a9c42-b9ed-40b1-b72c-390b85578204 could not be found. Aug 23 07:15:46.790473 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi Aug 23 07:15:46.790473 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 07:15:46.790473 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi Aug 23 07:15:46.790473 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 07:15:46.790473 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 07:15:46.790473 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 07:15:46.790473 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 07:15:46.790473 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 07:15:46.790473 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 07:15:46.791958 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 07:15:46.791958 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 07:15:46.791958 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 07:15:46.791958 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 07:15:46.791958 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 07:15:46.791958 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 07:15:46.791958 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 07:15:46.791958 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ce9a9c42-b9ed-40b1-b72c-390b85578204 could not be found. Aug 23 07:15:46.791958 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi Aug 23 07:15:46.791958 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 07:15:46.791958 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi Aug 23 07:15:46.791958 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 07:15:46.791958 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 07:15:46.791958 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 07:15:46.791958 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 07:15:46.791958 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 07:15:46.791958 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ce9a9c42-b9ed-40b1-b72c-390b85578204 could not be found. Aug 23 07:15:46.791958 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi Aug 23 07:15:46.794447 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-1c99d604-733e-497b-b6d2-caae5fda0d77 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Returning 404 to user: Instance ce9a9c42-b9ed-40b1-b72c-390b85578204 could not be found. {{(pid=120799) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 07:15:46.798508 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-1c99d604-733e-497b-b6d2-caae5fda0d77 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] 10.222.0.17 "GET /compute/v2.1/servers/ce9a9c42-b9ed-40b1-b72c-390b85578204" status: 404 len: 111 microversion: 2.1 time: 0.085997 Aug 23 07:15:46.799746 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 200/391] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:15:46 2022] GET /compute/v2.1/servers/ce9a9c42-b9ed-40b1-b72c-390b85578204 => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 07:15:46.808678 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-e108df79-78ee-48cc-80b4-2712995b9a1d tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Calling method '.version_select at 0x7fe3c610dd30>' {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:15:46.865820 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [None req-e108df79-78ee-48cc-80b4-2712995b9a1d tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1754755496" status: 202 len: 0 microversion: 2.1 time: 0.061333 Aug 23 07:15:46.866791 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 192/392] 10.222.0.17 () {58 vars in 1221 bytes} [Tue Aug 23 07:15:46 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1754755496 => generated 0 bytes in 63 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 07:15:48.058817 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-df4ff619-dbb7-4f10-95b8-232692b2dca7 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Calling method '>' {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:15:48.059552 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.compute.api [None req-df4ff619-dbb7-4f10-95b8-232692b2dca7 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] [instance: 057628ba-a74f-426e-ba25-a3b79c3b6339] Fetching instance by UUID {{(pid=120799) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:15:48.071832 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-df4ff619-dbb7-4f10-95b8-232692b2dca7 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:15:48.072471 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-df4ff619-dbb7-4f10-95b8-232692b2dca7 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:15:48.073009 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-df4ff619-dbb7-4f10-95b8-232692b2dca7 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:15:48.073829 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-df4ff619-dbb7-4f10-95b8-232692b2dca7 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:15:48.074420 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-df4ff619-dbb7-4f10-95b8-232692b2dca7 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:15:48.074941 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-df4ff619-dbb7-4f10-95b8-232692b2dca7 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:15:48.318566 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.objects.instance [None req-df4ff619-dbb7-4f10-95b8-232692b2dca7 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lazy-loading 'services' on Instance uuid 057628ba-a74f-426e-ba25-a3b79c3b6339 {{(pid=120799) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 07:15:48.537263 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-df4ff619-dbb7-4f10-95b8-232692b2dca7 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] 10.222.0.17 "DELETE /compute/v2.1/servers/057628ba-a74f-426e-ba25-a3b79c3b6339/os-volume_attachments/f1522f2b-5404-4c16-a30d-7283a999033d" status: 202 len: 0 microversion: 2.1 time: 0.473492 Aug 23 07:15:48.552136 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG dbcounter [-] [120798] Writing DB stats nova_cell0:SELECT=4 {{(pid=120798) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:15:48.557812 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-8b13a78d-ef50-4403-85c5-b32b902e5f17 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Calling method '>' {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:15:48.560329 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.compute.api [None req-8b13a78d-ef50-4403-85c5-b32b902e5f17 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] [instance: 057628ba-a74f-426e-ba25-a3b79c3b6339] Fetching instance by UUID {{(pid=120798) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:15:48.566398 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 201/393] 10.222.0.17 () {58 vars in 1416 bytes} [Tue Aug 23 07:15:48 2022] DELETE /compute/v2.1/servers/057628ba-a74f-426e-ba25-a3b79c3b6339/os-volume_attachments/f1522f2b-5404-4c16-a30d-7283a999033d => generated 0 bytes in 512 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 07:15:48.574355 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-8b13a78d-ef50-4403-85c5-b32b902e5f17 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:15:48.575139 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-8b13a78d-ef50-4403-85c5-b32b902e5f17 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:15:48.575891 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-8b13a78d-ef50-4403-85c5-b32b902e5f17 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:15:48.576869 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-8b13a78d-ef50-4403-85c5-b32b902e5f17 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:15:48.579606 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-8b13a78d-ef50-4403-85c5-b32b902e5f17 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:15:48.580282 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-8b13a78d-ef50-4403-85c5-b32b902e5f17 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:15:48.618624 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [None req-8b13a78d-ef50-4403-85c5-b32b902e5f17 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] 10.222.0.17 "GET /compute/v2.1/servers/057628ba-a74f-426e-ba25-a3b79c3b6339/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.069616 Aug 23 07:15:48.619232 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 193/394] 10.222.0.17 () {58 vars in 1302 bytes} [Tue Aug 23 07:15:48 2022] GET /compute/v2.1/servers/057628ba-a74f-426e-ba25-a3b79c3b6339/os-volume_attachments => generated 197 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 07:15:49.634530 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-92ac0730-dc3d-4e0a-924c-06568400525d tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Calling method '>' {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:15:49.638037 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.compute.api [None req-92ac0730-dc3d-4e0a-924c-06568400525d tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] [instance: 057628ba-a74f-426e-ba25-a3b79c3b6339] Fetching instance by UUID {{(pid=120799) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:15:49.659678 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-92ac0730-dc3d-4e0a-924c-06568400525d tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:15:49.663623 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-92ac0730-dc3d-4e0a-924c-06568400525d tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:15:49.664289 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-92ac0730-dc3d-4e0a-924c-06568400525d tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:15:49.665215 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-92ac0730-dc3d-4e0a-924c-06568400525d tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:15:49.665840 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-92ac0730-dc3d-4e0a-924c-06568400525d tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:15:49.667406 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-92ac0730-dc3d-4e0a-924c-06568400525d tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:15:49.766878 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-92ac0730-dc3d-4e0a-924c-06568400525d tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] 10.222.0.17 "GET /compute/v2.1/servers/057628ba-a74f-426e-ba25-a3b79c3b6339/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.139510 Aug 23 07:15:49.773222 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 202/395] 10.222.0.17 () {58 vars in 1302 bytes} [Tue Aug 23 07:15:49 2022] GET /compute/v2.1/servers/057628ba-a74f-426e-ba25-a3b79c3b6339/os-volume_attachments => generated 25 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 23 07:15:49.884092 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-c2daedd5-b2d5-4311-bff9-94b44bf6cb9c tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Calling method '>' {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:15:49.884734 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.compute.api [None req-c2daedd5-b2d5-4311-bff9-94b44bf6cb9c tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] [instance: 057628ba-a74f-426e-ba25-a3b79c3b6339] Fetching instance by UUID {{(pid=120798) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:15:49.904305 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-c2daedd5-b2d5-4311-bff9-94b44bf6cb9c tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:15:49.904305 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-c2daedd5-b2d5-4311-bff9-94b44bf6cb9c tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:15:49.904305 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-c2daedd5-b2d5-4311-bff9-94b44bf6cb9c tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:15:49.904784 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-c2daedd5-b2d5-4311-bff9-94b44bf6cb9c tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:15:49.905251 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-c2daedd5-b2d5-4311-bff9-94b44bf6cb9c tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:15:49.905664 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-c2daedd5-b2d5-4311-bff9-94b44bf6cb9c tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:15:49.936718 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.compute.api [None req-c2daedd5-b2d5-4311-bff9-94b44bf6cb9c tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] [instance: 057628ba-a74f-426e-ba25-a3b79c3b6339] Going to try to terminate instance {{(pid=120798) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 07:15:50.044369 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-4e5b6205-1d59-489e-ad9a-40116b93be8e tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-773257239", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-118391273", "security_groups": [{"name": "tempest-secgroup-smoke-918010385"}], "networks": [{"uuid": "813c546c-7b87-45f7-bc3b-0e2dea189743"}], "block_device_mapping_v2": [{"uuid": "c50820cb-51b1-4558-9865-e753d133021e", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 07:15:50.113219 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [None req-c2daedd5-b2d5-4311-bff9-94b44bf6cb9c tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] 10.222.0.17 "DELETE /compute/v2.1/servers/057628ba-a74f-426e-ba25-a3b79c3b6339" status: 204 len: 0 microversion: 2.1 time: 0.232476 Aug 23 07:15:50.114924 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 194/396] 10.222.0.17 () {58 vars in 1239 bytes} [Tue Aug 23 07:15:49 2022] DELETE /compute/v2.1/servers/057628ba-a74f-426e-ba25-a3b79c3b6339 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 23 07:15:50.123972 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-4ee2fb76-ae2b-42ea-8c8f-e73f6164b7e8 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Calling method '>' {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:15:50.130703 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.compute.api [None req-4ee2fb76-ae2b-42ea-8c8f-e73f6164b7e8 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] [instance: 057628ba-a74f-426e-ba25-a3b79c3b6339] Fetching instance by UUID {{(pid=120798) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:15:50.144934 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-4ee2fb76-ae2b-42ea-8c8f-e73f6164b7e8 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:15:50.145502 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-4ee2fb76-ae2b-42ea-8c8f-e73f6164b7e8 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:15:50.146165 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-4ee2fb76-ae2b-42ea-8c8f-e73f6164b7e8 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:15:50.147974 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-4ee2fb76-ae2b-42ea-8c8f-e73f6164b7e8 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:15:50.148657 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-4ee2fb76-ae2b-42ea-8c8f-e73f6164b7e8 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:15:50.149275 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-4ee2fb76-ae2b-42ea-8c8f-e73f6164b7e8 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:15:50.280370 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.network.neutron [None req-4e5b6205-1d59-489e-ad9a-40116b93be8e tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] validate_networks() for [('813c546c-7b87-45f7-bc3b-0e2dea189743', None, None, None, None, None)] {{(pid=120799) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 23 07:15:50.485521 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.policy [None req-4ee2fb76-ae2b-42ea-8c8f-e73f6164b7e8 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '471dc5c1db64411ab1d80ad6c038e519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb44f62fa62e46528712f24479cbb19f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120798) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:15:50.505428 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [None req-4ee2fb76-ae2b-42ea-8c8f-e73f6164b7e8 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] 10.222.0.17 "GET /compute/v2.1/servers/057628ba-a74f-426e-ba25-a3b79c3b6339" status: 200 len: 1679 microversion: 2.1 time: 0.385661 Aug 23 07:15:50.506785 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 195/397] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:15:50 2022] GET /compute/v2.1/servers/057628ba-a74f-426e-ba25-a3b79c3b6339 => generated 1679 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 07:15:50.799134 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-b596ed4b-aaea-4f6a-8ed3-e4be82c1d02a tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] Action: 'create', calling method: .version_select at 0x7fe3c6405700>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-324828606", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOljeiXffQQExJ/OCVT5aCKkIEmLxUpY/1QnhgkV2Wr10J+sSKXexW0icvgKDSS4Mf12kxEG36blQgzoSsqhfbnv+XLNwHJ+g2EiGif4idygxrm5gceMLt0FX2dE2ohcDg=="}} {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 07:15:50.819102 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.quota [None req-b596ed4b-aaea-4f6a-8ed3-e4be82c1d02a tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] Getting quotas for project f9466597900d4a3ca60a2ef8b7678c87. Resources: {'key_pairs'} {{(pid=120798) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 07:15:50.825850 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.quota [None req-b596ed4b-aaea-4f6a-8ed3-e4be82c1d02a tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] Getting quotas for user a5e8c33634b246319de495d269c05124 and project f9466597900d4a3ca60a2ef8b7678c87. Resources: {'key_pairs'} {{(pid=120798) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 07:15:50.851276 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [None req-b596ed4b-aaea-4f6a-8ed3-e4be82c1d02a tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.056143 Aug 23 07:15:50.852138 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 196/398] 10.222.0.17 () {60 vars in 1159 bytes} [Tue Aug 23 07:15:50 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 07:15:50.912229 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.virt.hardware [None req-4e5b6205-1d59-489e-ad9a-40116b93be8e tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] Flavor limits 0:0:0 {{(pid=120799) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 07:15:50.913614 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.virt.hardware [None req-4e5b6205-1d59-489e-ad9a-40116b93be8e tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] Image limits 0:0:0 {{(pid=120799) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 07:15:50.914234 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.virt.hardware [None req-4e5b6205-1d59-489e-ad9a-40116b93be8e tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] Flavor pref 0:0:0 {{(pid=120799) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 07:15:50.914792 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.virt.hardware [None req-4e5b6205-1d59-489e-ad9a-40116b93be8e tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] Image pref 0:0:0 {{(pid=120799) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 07:15:50.915481 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.virt.hardware [None req-4e5b6205-1d59-489e-ad9a-40116b93be8e tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120799) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 07:15:50.928757 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-4e5b6205-1d59-489e-ad9a-40116b93be8e tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:15:50.929427 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-4e5b6205-1d59-489e-ad9a-40116b93be8e tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:15:50.929847 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-4e5b6205-1d59-489e-ad9a-40116b93be8e tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:15:50.930689 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-4e5b6205-1d59-489e-ad9a-40116b93be8e tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:15:50.931281 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-4e5b6205-1d59-489e-ad9a-40116b93be8e tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:15:50.932011 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-4e5b6205-1d59-489e-ad9a-40116b93be8e tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:15:50.952736 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.quota [None req-4e5b6205-1d59-489e-ad9a-40116b93be8e tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] Getting quotas for project fd004facbaed41a7a54a3ed6a6a44305. Resources: {'ram', 'instances', 'cores'} {{(pid=120799) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 07:15:50.957745 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.quota [None req-4e5b6205-1d59-489e-ad9a-40116b93be8e tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] Getting quotas for user c26232f042844a898c19d1f63152b428 and project fd004facbaed41a7a54a3ed6a6a44305. Resources: {'ram', 'instances', 'cores'} {{(pid=120799) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 07:15:50.983333 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-4d9ac294-c7d3-4573-a096-d6baf243f549 tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1039954038", "imageRef": "b5227b70-0bb2-415e-8427-5220d05abb88", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-324828606", "networks": [{"uuid": "3c70d981-08f8-4da9-b803-73ceaa6a9659"}]}} {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 07:15:51.037008 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.compute.api [None req-4e5b6205-1d59-489e-ad9a-40116b93be8e tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] Going to run 1 instances... {{(pid=120799) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 23 07:15:51.038673 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.network.neutron [None req-4d9ac294-c7d3-4573-a096-d6baf243f549 tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] validate_networks() for [('3c70d981-08f8-4da9-b803-73ceaa6a9659', None, None, None, None, None)] {{(pid=120798) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 23 07:15:51.039949 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.compute.api [None req-4e5b6205-1d59-489e-ad9a-40116b93be8e tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] [instance: 0c761eab-49ac-4396-9907-70845ad75c64] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='c50820cb-51b1-4558-9865-e753d133021e',volume_size=None,volume_type=None)] {{(pid=120799) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 07:15:51.220972 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-4e5b6205-1d59-489e-ad9a-40116b93be8e tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.181023 Aug 23 07:15:51.221907 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 203/399] 10.222.0.17 () {60 vars in 1147 bytes} [Tue Aug 23 07:15:50 2022] POST /compute/v2.1/servers => generated 405 bytes in 1183 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 23 07:15:51.251627 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-23003105-8e3b-49ae-a60c-9a3861dc95e2 tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] Calling method '>' {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:15:51.254815 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.compute.api [None req-23003105-8e3b-49ae-a60c-9a3861dc95e2 tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] [instance: 0c761eab-49ac-4396-9907-70845ad75c64] Fetching instance by UUID {{(pid=120799) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:15:51.354325 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.policy [None req-23003105-8e3b-49ae-a60c-9a3861dc95e2 tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c26232f042844a898c19d1f63152b428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd004facbaed41a7a54a3ed6a6a44305', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120799) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:15:51.362299 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-23003105-8e3b-49ae-a60c-9a3861dc95e2 tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] 10.222.0.17 "GET /compute/v2.1/servers/0c761eab-49ac-4396-9907-70845ad75c64" status: 200 len: 1087 microversion: 2.1 time: 0.132582 Aug 23 07:15:51.375492 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 204/400] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:15:51 2022] GET /compute/v2.1/servers/0c761eab-49ac-4396-9907-70845ad75c64 => generated 1087 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:15:51.531705 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-2b100a35-8688-431d-83d6-1233f9e2b88c tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Calling method '>' {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:15:51.532341 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.compute.api [None req-2b100a35-8688-431d-83d6-1233f9e2b88c tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] [instance: 057628ba-a74f-426e-ba25-a3b79c3b6339] Fetching instance by UUID {{(pid=120799) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:15:51.538176 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-2b100a35-8688-431d-83d6-1233f9e2b88c tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:15:51.538650 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-2b100a35-8688-431d-83d6-1233f9e2b88c tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:15:51.539249 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-2b100a35-8688-431d-83d6-1233f9e2b88c tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:15:51.540117 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-2b100a35-8688-431d-83d6-1233f9e2b88c tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:15:51.540558 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-2b100a35-8688-431d-83d6-1233f9e2b88c tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:15:51.540976 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-2b100a35-8688-431d-83d6-1233f9e2b88c tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:15:51.544846 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.virt.hardware [None req-4d9ac294-c7d3-4573-a096-d6baf243f549 tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] Flavor limits 0:0:0 {{(pid=120798) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 07:15:51.546453 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.virt.hardware [None req-4d9ac294-c7d3-4573-a096-d6baf243f549 tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] Image limits 0:0:0 {{(pid=120798) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 07:15:51.546453 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.virt.hardware [None req-4d9ac294-c7d3-4573-a096-d6baf243f549 tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] Flavor pref 0:0:0 {{(pid=120798) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 07:15:51.546453 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.virt.hardware [None req-4d9ac294-c7d3-4573-a096-d6baf243f549 tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] Image pref 0:0:0 {{(pid=120798) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 07:15:51.546759 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.virt.hardware [None req-4d9ac294-c7d3-4573-a096-d6baf243f549 tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120798) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 07:15:51.556733 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-4d9ac294-c7d3-4573-a096-d6baf243f549 tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:15:51.557408 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-4d9ac294-c7d3-4573-a096-d6baf243f549 tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:15:51.557836 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-4d9ac294-c7d3-4573-a096-d6baf243f549 tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:15:51.558698 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-4d9ac294-c7d3-4573-a096-d6baf243f549 tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:15:51.559116 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-4d9ac294-c7d3-4573-a096-d6baf243f549 tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:15:51.559568 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-4d9ac294-c7d3-4573-a096-d6baf243f549 tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:15:51.577601 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.quota [None req-4d9ac294-c7d3-4573-a096-d6baf243f549 tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] Getting quotas for project f9466597900d4a3ca60a2ef8b7678c87. Resources: {'ram', 'instances', 'cores'} {{(pid=120798) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 07:15:51.582202 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.quota [None req-4d9ac294-c7d3-4573-a096-d6baf243f549 tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] Getting quotas for user a5e8c33634b246319de495d269c05124 and project f9466597900d4a3ca60a2ef8b7678c87. Resources: {'ram', 'instances', 'cores'} {{(pid=120798) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 07:15:51.596880 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.compute.api [None req-4d9ac294-c7d3-4573-a096-d6baf243f549 tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] Going to run 1 instances... {{(pid=120798) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 23 07:15:51.599194 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.compute.api [None req-4d9ac294-c7d3-4573-a096-d6baf243f549 tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] [instance: f7783f88-5770-4ca3-a5cf-294f044d21a8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b5227b70-0bb2-415e-8427-5220d05abb88',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120798) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 07:15:51.664457 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [None req-4d9ac294-c7d3-4573-a096-d6baf243f549 tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.685447 Aug 23 07:15:51.665510 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 197/401] 10.222.0.17 () {60 vars in 1147 bytes} [Tue Aug 23 07:15:50 2022] POST /compute/v2.1/servers => generated 380 bytes in 687 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 23 07:15:51.678801 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-45249f92-fad3-4c85-9f13-ea57d115e5c4 tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] Calling method '>' {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:15:51.679582 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.compute.api [None req-45249f92-fad3-4c85-9f13-ea57d115e5c4 tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] [instance: f7783f88-5770-4ca3-a5cf-294f044d21a8] Fetching instance by UUID {{(pid=120798) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:15:51.711013 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.policy [None req-2b100a35-8688-431d-83d6-1233f9e2b88c tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '471dc5c1db64411ab1d80ad6c038e519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb44f62fa62e46528712f24479cbb19f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120799) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:15:51.722401 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-2b100a35-8688-431d-83d6-1233f9e2b88c tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] 10.222.0.17 "GET /compute/v2.1/servers/057628ba-a74f-426e-ba25-a3b79c3b6339" status: 200 len: 1679 microversion: 2.1 time: 0.194582 Aug 23 07:15:51.723098 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 205/402] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:15:51 2022] GET /compute/v2.1/servers/057628ba-a74f-426e-ba25-a3b79c3b6339 => generated 1679 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:15:51.762408 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.policy [None req-45249f92-fad3-4c85-9f13-ea57d115e5c4 tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5e8c33634b246319de495d269c05124', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9466597900d4a3ca60a2ef8b7678c87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120798) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:15:51.772359 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [None req-45249f92-fad3-4c85-9f13-ea57d115e5c4 tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] 10.222.0.17 "GET /compute/v2.1/servers/f7783f88-5770-4ca3-a5cf-294f044d21a8" status: 200 len: 1258 microversion: 2.1 time: 0.098959 Aug 23 07:15:51.773141 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 198/403] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:15:51 2022] GET /compute/v2.1/servers/f7783f88-5770-4ca3-a5cf-294f044d21a8 => generated 1258 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:15:52.390047 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-2061b543-c8ee-4fa0-ae5f-c1e594157a8e tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] Calling method '>' {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:15:52.391567 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.compute.api [None req-2061b543-c8ee-4fa0-ae5f-c1e594157a8e tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] [instance: 0c761eab-49ac-4396-9907-70845ad75c64] Fetching instance by UUID {{(pid=120799) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:15:52.411948 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-2061b543-c8ee-4fa0-ae5f-c1e594157a8e tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:15:52.413383 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-2061b543-c8ee-4fa0-ae5f-c1e594157a8e tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:15:52.414398 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-2061b543-c8ee-4fa0-ae5f-c1e594157a8e tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:15:52.417912 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-2061b543-c8ee-4fa0-ae5f-c1e594157a8e tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:15:52.418659 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-2061b543-c8ee-4fa0-ae5f-c1e594157a8e tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:15:52.420238 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-2061b543-c8ee-4fa0-ae5f-c1e594157a8e tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:15:52.639977 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.policy [None req-2061b543-c8ee-4fa0-ae5f-c1e594157a8e tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c26232f042844a898c19d1f63152b428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd004facbaed41a7a54a3ed6a6a44305', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120799) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:15:52.648060 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-2061b543-c8ee-4fa0-ae5f-c1e594157a8e tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] 10.222.0.17 "GET /compute/v2.1/servers/0c761eab-49ac-4396-9907-70845ad75c64" status: 200 len: 1193 microversion: 2.1 time: 0.264639 Aug 23 07:15:52.648901 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 206/404] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:15:52 2022] GET /compute/v2.1/servers/0c761eab-49ac-4396-9907-70845ad75c64 => generated 1193 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:15:52.743704 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-7fae20c6-52ea-4942-82c0-5c348ca7e2f1 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Calling method '>' {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:15:52.744317 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.compute.api [None req-7fae20c6-52ea-4942-82c0-5c348ca7e2f1 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] [instance: 057628ba-a74f-426e-ba25-a3b79c3b6339] Fetching instance by UUID {{(pid=120798) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:15:52.750834 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-7fae20c6-52ea-4942-82c0-5c348ca7e2f1 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:15:52.751315 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-7fae20c6-52ea-4942-82c0-5c348ca7e2f1 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:15:52.751775 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-7fae20c6-52ea-4942-82c0-5c348ca7e2f1 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:15:52.752463 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-7fae20c6-52ea-4942-82c0-5c348ca7e2f1 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:15:52.752980 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-7fae20c6-52ea-4942-82c0-5c348ca7e2f1 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:15:52.753456 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-7fae20c6-52ea-4942-82c0-5c348ca7e2f1 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:15:52.793577 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-6e6a5d5f-3399-4eac-85ee-4407e6a401f4 tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] Calling method '>' {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:15:52.794171 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.compute.api [None req-6e6a5d5f-3399-4eac-85ee-4407e6a401f4 tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] [instance: f7783f88-5770-4ca3-a5cf-294f044d21a8] Fetching instance by UUID {{(pid=120799) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:15:52.804944 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-6e6a5d5f-3399-4eac-85ee-4407e6a401f4 tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:15:52.805418 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-6e6a5d5f-3399-4eac-85ee-4407e6a401f4 tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:15:52.805842 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-6e6a5d5f-3399-4eac-85ee-4407e6a401f4 tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:15:52.806541 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-6e6a5d5f-3399-4eac-85ee-4407e6a401f4 tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:15:52.806982 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-6e6a5d5f-3399-4eac-85ee-4407e6a401f4 tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:15:52.807385 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-6e6a5d5f-3399-4eac-85ee-4407e6a401f4 tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:15:52.821655 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.policy [None req-7fae20c6-52ea-4942-82c0-5c348ca7e2f1 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '471dc5c1db64411ab1d80ad6c038e519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb44f62fa62e46528712f24479cbb19f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120798) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:15:52.846294 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [None req-7fae20c6-52ea-4942-82c0-5c348ca7e2f1 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] 10.222.0.17 "GET /compute/v2.1/servers/057628ba-a74f-426e-ba25-a3b79c3b6339" status: 200 len: 1612 microversion: 2.1 time: 0.106570 Aug 23 07:15:52.847075 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 199/405] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:15:52 2022] GET /compute/v2.1/servers/057628ba-a74f-426e-ba25-a3b79c3b6339 => generated 1612 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:15:53.026645 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.policy [None req-6e6a5d5f-3399-4eac-85ee-4407e6a401f4 tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5e8c33634b246319de495d269c05124', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9466597900d4a3ca60a2ef8b7678c87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120799) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:15:53.041323 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [req-197e2295-c33f-47f1-994e-3195f40362db req-24cab676-91e4-4d6e-9621-f765d9116790 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "057628ba-a74f-426e-ba25-a3b79c3b6339", "name": "network-vif-deleted", "tag": "0d1372d3-3c3c-42c8-a793-154da2463304"}]} {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 07:15:53.044286 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-6e6a5d5f-3399-4eac-85ee-4407e6a401f4 tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] 10.222.0.17 "GET /compute/v2.1/servers/f7783f88-5770-4ca3-a5cf-294f044d21a8" status: 200 len: 1310 microversion: 2.1 time: 0.254659 Aug 23 07:15:53.044879 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 207/406] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:15:52 2022] GET /compute/v2.1/servers/f7783f88-5770-4ca3-a5cf-294f044d21a8 => generated 1310 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:15:53.065933 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [req-197e2295-c33f-47f1-994e-3195f40362db req-24cab676-91e4-4d6e-9621-f765d9116790 service nova] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:15:53.069272 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [req-197e2295-c33f-47f1-994e-3195f40362db req-24cab676-91e4-4d6e-9621-f765d9116790 service nova] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:15:53.069272 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [req-197e2295-c33f-47f1-994e-3195f40362db req-24cab676-91e4-4d6e-9621-f765d9116790 service nova] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:15:53.128835 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.compute.server_external_events [req-197e2295-c33f-47f1-994e-3195f40362db req-24cab676-91e4-4d6e-9621-f765d9116790 service nova] Creating event network-vif-deleted:0d1372d3-3c3c-42c8-a793-154da2463304 for instance 057628ba-a74f-426e-ba25-a3b79c3b6339 on hv-cinder-85409 Aug 23 07:15:53.144558 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [req-197e2295-c33f-47f1-994e-3195f40362db req-24cab676-91e4-4d6e-9621-f765d9116790 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.108050 Aug 23 07:15:53.147501 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 200/407] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Aug 23 07:15:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 07:15:53.671757 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-ab70c103-a15e-41a8-bc5d-df5dcdfdfec0 tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] Calling method '>' {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:15:53.673064 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.compute.api [None req-ab70c103-a15e-41a8-bc5d-df5dcdfdfec0 tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] [instance: 0c761eab-49ac-4396-9907-70845ad75c64] Fetching instance by UUID {{(pid=120799) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:15:53.690330 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-ab70c103-a15e-41a8-bc5d-df5dcdfdfec0 tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:15:53.691436 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-ab70c103-a15e-41a8-bc5d-df5dcdfdfec0 tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:15:53.692172 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-ab70c103-a15e-41a8-bc5d-df5dcdfdfec0 tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:15:53.693140 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-ab70c103-a15e-41a8-bc5d-df5dcdfdfec0 tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:15:53.693779 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-ab70c103-a15e-41a8-bc5d-df5dcdfdfec0 tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:15:53.694453 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-ab70c103-a15e-41a8-bc5d-df5dcdfdfec0 tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:15:53.838956 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.policy [None req-ab70c103-a15e-41a8-bc5d-df5dcdfdfec0 tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c26232f042844a898c19d1f63152b428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd004facbaed41a7a54a3ed6a6a44305', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120799) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:15:53.847248 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-ab70c103-a15e-41a8-bc5d-df5dcdfdfec0 tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] 10.222.0.17 "GET /compute/v2.1/servers/0c761eab-49ac-4396-9907-70845ad75c64" status: 200 len: 1191 microversion: 2.1 time: 0.179521 Aug 23 07:15:53.847852 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 208/408] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:15:53 2022] GET /compute/v2.1/servers/0c761eab-49ac-4396-9907-70845ad75c64 => generated 1191 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:15:53.879726 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-19d694e7-d5a4-49c9-8ca4-bc21bd1db5cc tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Calling method '>' {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:15:53.885861 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.compute.api [None req-19d694e7-d5a4-49c9-8ca4-bc21bd1db5cc tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] [instance: 057628ba-a74f-426e-ba25-a3b79c3b6339] Fetching instance by UUID {{(pid=120798) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:15:53.902816 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-19d694e7-d5a4-49c9-8ca4-bc21bd1db5cc tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:15:53.906216 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-19d694e7-d5a4-49c9-8ca4-bc21bd1db5cc tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:15:53.907566 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-19d694e7-d5a4-49c9-8ca4-bc21bd1db5cc tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:15:53.908557 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-19d694e7-d5a4-49c9-8ca4-bc21bd1db5cc tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:15:53.909205 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-19d694e7-d5a4-49c9-8ca4-bc21bd1db5cc tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:15:53.912374 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-19d694e7-d5a4-49c9-8ca4-bc21bd1db5cc tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:15:54.020310 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-19d694e7-d5a4-49c9-8ca4-bc21bd1db5cc tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:15:54.022240 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-19d694e7-d5a4-49c9-8ca4-bc21bd1db5cc tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:15:54.022856 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-19d694e7-d5a4-49c9-8ca4-bc21bd1db5cc tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:15:54.024435 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.objects.instance [None req-19d694e7-d5a4-49c9-8ca4-bc21bd1db5cc tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lazy-loading 'fault' on Instance uuid 057628ba-a74f-426e-ba25-a3b79c3b6339 {{(pid=120798) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 07:15:54.066488 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-3631abf9-0e06-4b68-8605-a96816ffd9f9 tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] Calling method '>' {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:15:54.067384 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.compute.api [None req-3631abf9-0e06-4b68-8605-a96816ffd9f9 tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] [instance: f7783f88-5770-4ca3-a5cf-294f044d21a8] Fetching instance by UUID {{(pid=120799) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:15:54.077747 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-3631abf9-0e06-4b68-8605-a96816ffd9f9 tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:15:54.078446 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-3631abf9-0e06-4b68-8605-a96816ffd9f9 tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:15:54.079019 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-3631abf9-0e06-4b68-8605-a96816ffd9f9 tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:15:54.080086 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-3631abf9-0e06-4b68-8605-a96816ffd9f9 tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:15:54.080695 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-3631abf9-0e06-4b68-8605-a96816ffd9f9 tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:15:54.081557 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-3631abf9-0e06-4b68-8605-a96816ffd9f9 tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:15:54.135427 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.policy [None req-19d694e7-d5a4-49c9-8ca4-bc21bd1db5cc tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '471dc5c1db64411ab1d80ad6c038e519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb44f62fa62e46528712f24479cbb19f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120798) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:15:54.146210 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [None req-19d694e7-d5a4-49c9-8ca4-bc21bd1db5cc tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] 10.222.0.17 "GET /compute/v2.1/servers/057628ba-a74f-426e-ba25-a3b79c3b6339" status: 200 len: 1330 microversion: 2.1 time: 0.279459 Aug 23 07:15:54.149023 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 201/409] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:15:53 2022] GET /compute/v2.1/servers/057628ba-a74f-426e-ba25-a3b79c3b6339 => generated 1330 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:15:54.395622 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.policy [None req-3631abf9-0e06-4b68-8605-a96816ffd9f9 tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5e8c33634b246319de495d269c05124', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9466597900d4a3ca60a2ef8b7678c87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120799) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:15:54.405610 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-3631abf9-0e06-4b68-8605-a96816ffd9f9 tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] 10.222.0.17 "GET /compute/v2.1/servers/f7783f88-5770-4ca3-a5cf-294f044d21a8" status: 200 len: 1358 microversion: 2.1 time: 0.343351 Aug 23 07:15:54.408894 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 209/410] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:15:54 2022] GET /compute/v2.1/servers/f7783f88-5770-4ca3-a5cf-294f044d21a8 => generated 1358 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:15:54.870366 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-2e3bab23-e1cc-4128-8694-0c9bde5dbedf tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] Calling method '>' {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:15:54.871825 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.compute.api [None req-2e3bab23-e1cc-4128-8694-0c9bde5dbedf tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] [instance: 0c761eab-49ac-4396-9907-70845ad75c64] Fetching instance by UUID {{(pid=120798) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:15:54.889926 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-2e3bab23-e1cc-4128-8694-0c9bde5dbedf tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:15:54.891032 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-2e3bab23-e1cc-4128-8694-0c9bde5dbedf tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:15:54.893834 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-2e3bab23-e1cc-4128-8694-0c9bde5dbedf tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:15:54.894657 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-2e3bab23-e1cc-4128-8694-0c9bde5dbedf tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:15:54.896557 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-2e3bab23-e1cc-4128-8694-0c9bde5dbedf tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:15:54.900779 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-2e3bab23-e1cc-4128-8694-0c9bde5dbedf tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:15:55.174965 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-cf05ac49-ffba-4ef4-aeef-6412cde1666e tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Calling method '>' {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:15:55.179501 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.compute.api [None req-cf05ac49-ffba-4ef4-aeef-6412cde1666e tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] [instance: 057628ba-a74f-426e-ba25-a3b79c3b6339] Fetching instance by UUID {{(pid=120799) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:15:55.183621 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-cf05ac49-ffba-4ef4-aeef-6412cde1666e tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:15:55.189986 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-cf05ac49-ffba-4ef4-aeef-6412cde1666e tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:15:55.190940 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-cf05ac49-ffba-4ef4-aeef-6412cde1666e tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:15:55.193323 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-cf05ac49-ffba-4ef4-aeef-6412cde1666e tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:15:55.195250 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-cf05ac49-ffba-4ef4-aeef-6412cde1666e tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:15:55.197236 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-cf05ac49-ffba-4ef4-aeef-6412cde1666e tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:15:55.230567 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.wsgi [None req-cf05ac49-ffba-4ef4-aeef-6412cde1666e tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] HTTP exception thrown: Instance 057628ba-a74f-426e-ba25-a3b79c3b6339 could not be found. Aug 23 07:15:55.233774 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-cf05ac49-ffba-4ef4-aeef-6412cde1666e tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Request method failure captured: Aug 23 07:15:55.233774 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: request: GET /compute/v2.1/servers/057628ba-a74f-426e-ba25-a3b79c3b6339 HTTP/1.1 Aug 23 07:15:55.233774 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: Accept: application/json Aug 23 07:15:55.233774 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: Accept-Encoding: identity Aug 23 07:15:55.233774 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: Connection: close Aug 23 07:15:55.233774 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: Content-Length: 0 Aug 23 07:15:55.233774 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: Content-Type: application/json Aug 23 07:15:55.233774 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: Host: 10.222.0.17 Aug 23 07:15:55.233774 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: Openstack-System-Scope: None Aug 23 07:15:55.233774 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: User-Agent: python-urllib3/1.26.11 Aug 23 07:15:55.233774 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-Auth-Token: gAAAAABjBH3ZHMVVLXoXwNDfQQNusO5G5GN02PnHIiEEKbUNElvY7Grlo8u229xKVdQ1mmEwia_EWu2jEutb1fyYPOf6jNbBH41b4mzr6zipvsQ6BtbbjaOUpVuAli-fuxu6YJZFtXM3RMEYq-CLnj1C8WH54zH3cmVnSq_F2KlyAaedAUE420Q Aug 23 07:15:55.233774 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-Domain-Id: None Aug 23 07:15:55.233774 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-Domain-Name: None Aug 23 07:15:55.233774 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-Identity-Status: Confirmed Aug 23 07:15:55.233774 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-Is-Admin-Project: True Aug 23 07:15:55.233774 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-Project-Domain-Id: default Aug 23 07:15:55.233774 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-Project-Domain-Name: Default Aug 23 07:15:55.233774 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-Project-Id: eb44f62fa62e46528712f24479cbb19f Aug 23 07:15:55.233774 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-Project-Name: tempest-AttachVolumeNegativeTest-880454297 Aug 23 07:15:55.233774 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-Role: reader,member Aug 23 07:15:55.233774 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-Roles: reader,member Aug 23 07:15:55.235428 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/eb44f62fa62e46528712f24479cbb19f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/eb44f62fa62e46528712f24479cbb19f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_eb44f62fa62e46528712f24479cbb19f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/eb44f62fa62e46528712f24479cbb19f"}]}] Aug 23 07:15:55.235428 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-Tenant: tempest-AttachVolumeNegativeTest-880454297 Aug 23 07:15:55.235428 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-Tenant-Id: eb44f62fa62e46528712f24479cbb19f Aug 23 07:15:55.235428 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-880454297 Aug 23 07:15:55.235428 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-User: tempest-AttachVolumeNegativeTest-880454297-project Aug 23 07:15:55.235428 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-User-Domain-Id: default Aug 23 07:15:55.235428 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-User-Domain-Name: Default Aug 23 07:15:55.235428 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-User-Id: 471dc5c1db64411ab1d80ad6c038e519 Aug 23 07:15:55.235428 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-User-Name: tempest-AttachVolumeNegativeTest-880454297-project Aug 23 07:15:55.235428 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: method: > Aug 23 07:15:55.235428 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: exception: Instance 057628ba-a74f-426e-ba25-a3b79c3b6339 could not be found. Aug 23 07:15:55.235428 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: action_args: {'id': '057628ba-a74f-426e-ba25-a3b79c3b6339'} Aug 23 07:15:55.236366 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 07:15:55.236366 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 07:15:55.236366 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 07:15:55.236366 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 07:15:55.236366 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 07:15:55.236366 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 07:15:55.236366 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 07:15:55.236366 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 07:15:55.236366 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 07:15:55.236366 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 07:15:55.236366 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 057628ba-a74f-426e-ba25-a3b79c3b6339 could not be found. Aug 23 07:15:55.236366 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi Aug 23 07:15:55.236366 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 07:15:55.236366 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi Aug 23 07:15:55.236366 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 07:15:55.236366 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 07:15:55.236366 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 07:15:55.236366 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 07:15:55.236366 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 07:15:55.236366 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 07:15:55.237968 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 07:15:55.237968 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 07:15:55.237968 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 07:15:55.237968 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 07:15:55.237968 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 07:15:55.237968 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 07:15:55.237968 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 07:15:55.237968 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 057628ba-a74f-426e-ba25-a3b79c3b6339 could not be found. Aug 23 07:15:55.237968 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi Aug 23 07:15:55.237968 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 07:15:55.237968 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi Aug 23 07:15:55.237968 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 07:15:55.237968 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 07:15:55.237968 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 07:15:55.237968 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 07:15:55.237968 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 07:15:55.237968 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 057628ba-a74f-426e-ba25-a3b79c3b6339 could not be found. Aug 23 07:15:55.237968 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi Aug 23 07:15:55.241978 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-cf05ac49-ffba-4ef4-aeef-6412cde1666e tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Returning 404 to user: Instance 057628ba-a74f-426e-ba25-a3b79c3b6339 could not be found. {{(pid=120799) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 07:15:55.244983 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-cf05ac49-ffba-4ef4-aeef-6412cde1666e tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] 10.222.0.17 "GET /compute/v2.1/servers/057628ba-a74f-426e-ba25-a3b79c3b6339" status: 404 len: 111 microversion: 2.1 time: 0.075031 Aug 23 07:15:55.248258 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 210/411] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:15:55 2022] GET /compute/v2.1/servers/057628ba-a74f-426e-ba25-a3b79c3b6339 => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 07:15:55.256159 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [req-2de2929b-07e5-40b2-a8c5-ac07afbf6102 req-47bea6a8-15c5-4887-b48f-4b5063a070d2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f7783f88-5770-4ca3-a5cf-294f044d21a8", "tag": "7ccdc22f-1e2b-4dd9-8ea3-858bf0e435cf"}]} {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 07:15:55.283805 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [req-2de2929b-07e5-40b2-a8c5-ac07afbf6102 req-47bea6a8-15c5-4887-b48f-4b5063a070d2 service nova] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:15:55.284854 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [req-2de2929b-07e5-40b2-a8c5-ac07afbf6102 req-47bea6a8-15c5-4887-b48f-4b5063a070d2 service nova] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:15:55.287686 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [req-2de2929b-07e5-40b2-a8c5-ac07afbf6102 req-47bea6a8-15c5-4887-b48f-4b5063a070d2 service nova] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:15:55.299787 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.policy [None req-2e3bab23-e1cc-4128-8694-0c9bde5dbedf tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c26232f042844a898c19d1f63152b428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd004facbaed41a7a54a3ed6a6a44305', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120798) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:15:55.315115 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.compute.server_external_events [req-2de2929b-07e5-40b2-a8c5-ac07afbf6102 req-47bea6a8-15c5-4887-b48f-4b5063a070d2 service nova] Creating event network-changed:7ccdc22f-1e2b-4dd9-8ea3-858bf0e435cf for instance f7783f88-5770-4ca3-a5cf-294f044d21a8 on hv-cinder-85409 Aug 23 07:15:55.323247 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [req-2de2929b-07e5-40b2-a8c5-ac07afbf6102 req-47bea6a8-15c5-4887-b48f-4b5063a070d2 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073472 Aug 23 07:15:55.326251 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 211/412] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Aug 23 07:15:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 07:15:55.332309 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-45236765-3739-4552-8938-1ad39372e63e tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Calling method '.version_select at 0x7fe3c591d160>' {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:15:55.332538 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [None req-2e3bab23-e1cc-4128-8694-0c9bde5dbedf tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] 10.222.0.17 "GET /compute/v2.1/servers/0c761eab-49ac-4396-9907-70845ad75c64" status: 200 len: 1258 microversion: 2.1 time: 0.466080 Aug 23 07:15:55.333162 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 202/413] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:15:54 2022] GET /compute/v2.1/servers/0c761eab-49ac-4396-9907-70845ad75c64 => generated 1258 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:15:55.384725 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-45236765-3739-4552-8938-1ad39372e63e tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-479729521" status: 202 len: 0 microversion: 2.1 time: 0.056875 Aug 23 07:15:55.386862 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 212/414] 10.222.0.17 () {58 vars in 1218 bytes} [Tue Aug 23 07:15:55 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-479729521 => generated 0 bytes in 60 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 07:15:55.433960 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-9c639f76-8494-4e07-bbeb-8a57ee92c7ae tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] Calling method '>' {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:15:55.435016 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.compute.api [None req-9c639f76-8494-4e07-bbeb-8a57ee92c7ae tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] [instance: f7783f88-5770-4ca3-a5cf-294f044d21a8] Fetching instance by UUID {{(pid=120798) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:15:55.442947 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-9c639f76-8494-4e07-bbeb-8a57ee92c7ae tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:15:55.444547 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-9c639f76-8494-4e07-bbeb-8a57ee92c7ae tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:15:55.445221 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-9c639f76-8494-4e07-bbeb-8a57ee92c7ae tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:15:55.446216 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-9c639f76-8494-4e07-bbeb-8a57ee92c7ae tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:15:55.447044 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-9c639f76-8494-4e07-bbeb-8a57ee92c7ae tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:15:55.447717 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-9c639f76-8494-4e07-bbeb-8a57ee92c7ae tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:15:55.734674 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.policy [None req-9c639f76-8494-4e07-bbeb-8a57ee92c7ae tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5e8c33634b246319de495d269c05124', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9466597900d4a3ca60a2ef8b7678c87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120798) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:15:55.744311 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [None req-9c639f76-8494-4e07-bbeb-8a57ee92c7ae tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] 10.222.0.17 "GET /compute/v2.1/servers/f7783f88-5770-4ca3-a5cf-294f044d21a8" status: 200 len: 1358 microversion: 2.1 time: 0.317443 Aug 23 07:15:55.745599 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 203/415] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:15:55 2022] GET /compute/v2.1/servers/f7783f88-5770-4ca3-a5cf-294f044d21a8 => generated 1358 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:15:56.309095 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-98090fa3-ba20-4221-8d85-7326c1b2de45 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Action: 'create', calling method: .version_select at 0x7fe3c592b820>, body: {"keypair": {"name": "tempest-keypair-909959701", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEpTii/BTk/d3l7fUkk9neV1LMIVOAn4a56vrIClrP4qtN7cmSlMW1TIfTX8bSwE8jbca6bVsSRoMKKFlvWfXftMK7SDIO5Gmi+s0IcIZ0fg88/5Y9wj72uldijOzXCbxQ=="}} {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 07:15:56.326584 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.quota [None req-98090fa3-ba20-4221-8d85-7326c1b2de45 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Getting quotas for project eb44f62fa62e46528712f24479cbb19f. Resources: {'key_pairs'} {{(pid=120799) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 07:15:56.331492 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.quota [None req-98090fa3-ba20-4221-8d85-7326c1b2de45 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Getting quotas for user 471dc5c1db64411ab1d80ad6c038e519 and project eb44f62fa62e46528712f24479cbb19f. Resources: {'key_pairs'} {{(pid=120799) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 07:15:56.354573 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-059b703d-6c4b-4ea6-b430-2fcbdab1de92 tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] Calling method '>' {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:15:56.356222 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.compute.api [None req-059b703d-6c4b-4ea6-b430-2fcbdab1de92 tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] [instance: 0c761eab-49ac-4396-9907-70845ad75c64] Fetching instance by UUID {{(pid=120798) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:15:56.363429 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-059b703d-6c4b-4ea6-b430-2fcbdab1de92 tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:15:56.364119 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-059b703d-6c4b-4ea6-b430-2fcbdab1de92 tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:15:56.364288 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-98090fa3-ba20-4221-8d85-7326c1b2de45 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.058853 Aug 23 07:15:56.367471 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-059b703d-6c4b-4ea6-b430-2fcbdab1de92 tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:15:56.367600 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 213/416] 10.222.0.17 () {60 vars in 1159 bytes} [Tue Aug 23 07:15:56 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 07:15:56.367731 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-059b703d-6c4b-4ea6-b430-2fcbdab1de92 tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:15:56.367731 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-059b703d-6c4b-4ea6-b430-2fcbdab1de92 tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:15:56.367731 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-059b703d-6c4b-4ea6-b430-2fcbdab1de92 tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:15:56.641761 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.policy [None req-059b703d-6c4b-4ea6-b430-2fcbdab1de92 tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c26232f042844a898c19d1f63152b428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd004facbaed41a7a54a3ed6a6a44305', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120798) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:15:56.654030 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [None req-059b703d-6c4b-4ea6-b430-2fcbdab1de92 tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] 10.222.0.17 "GET /compute/v2.1/servers/0c761eab-49ac-4396-9907-70845ad75c64" status: 200 len: 1258 microversion: 2.1 time: 0.303195 Aug 23 07:15:56.670305 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 204/417] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:15:56 2022] GET /compute/v2.1/servers/0c761eab-49ac-4396-9907-70845ad75c64 => generated 1258 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:15:56.772315 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-df4f9a57-8f41-49f4-bfe7-24f13b40fe93 tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] Calling method '>' {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:15:56.773226 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.compute.api [None req-df4f9a57-8f41-49f4-bfe7-24f13b40fe93 tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] [instance: f7783f88-5770-4ca3-a5cf-294f044d21a8] Fetching instance by UUID {{(pid=120799) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:15:56.781619 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-df4f9a57-8f41-49f4-bfe7-24f13b40fe93 tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:15:56.782513 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-df4f9a57-8f41-49f4-bfe7-24f13b40fe93 tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:15:56.783234 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-df4f9a57-8f41-49f4-bfe7-24f13b40fe93 tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:15:56.784202 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-df4f9a57-8f41-49f4-bfe7-24f13b40fe93 tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:15:56.784872 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-df4f9a57-8f41-49f4-bfe7-24f13b40fe93 tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:15:56.785510 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-df4f9a57-8f41-49f4-bfe7-24f13b40fe93 tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:15:56.966178 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.policy [None req-df4f9a57-8f41-49f4-bfe7-24f13b40fe93 tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5e8c33634b246319de495d269c05124', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9466597900d4a3ca60a2ef8b7678c87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120799) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:15:56.980520 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-df4f9a57-8f41-49f4-bfe7-24f13b40fe93 tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] 10.222.0.17 "GET /compute/v2.1/servers/f7783f88-5770-4ca3-a5cf-294f044d21a8" status: 200 len: 1358 microversion: 2.1 time: 0.214850 Aug 23 07:15:56.981960 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 214/418] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:15:56 2022] GET /compute/v2.1/servers/f7783f88-5770-4ca3-a5cf-294f044d21a8 => generated 1358 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:15:57.560725 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-70534119-ca1f-47c7-b6e1-878cd7483e1a tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "add11750-9e29-4afe-a3ac-ef016ecf7161"}} {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 07:15:57.563450 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.compute.api [None req-70534119-ca1f-47c7-b6e1-878cd7483e1a tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] [instance: b9418fe6-a57e-4a99-becb-19a4d3a52da1] Fetching instance by UUID {{(pid=120798) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:15:57.586426 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-70534119-ca1f-47c7-b6e1-878cd7483e1a tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:15:57.587671 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-70534119-ca1f-47c7-b6e1-878cd7483e1a tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:15:57.590061 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-70534119-ca1f-47c7-b6e1-878cd7483e1a tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:15:57.591661 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-70534119-ca1f-47c7-b6e1-878cd7483e1a tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:15:57.592964 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-70534119-ca1f-47c7-b6e1-878cd7483e1a tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:15:57.594865 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-70534119-ca1f-47c7-b6e1-878cd7483e1a tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:15:57.680358 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-a4cba791-de54-4f5a-a01f-13c0ae7b367d tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] Calling method '>' {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:15:57.690026 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.compute.api [None req-a4cba791-de54-4f5a-a01f-13c0ae7b367d tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] [instance: 0c761eab-49ac-4396-9907-70845ad75c64] Fetching instance by UUID {{(pid=120799) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:15:57.696977 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-a4cba791-de54-4f5a-a01f-13c0ae7b367d tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:15:57.697758 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-a4cba791-de54-4f5a-a01f-13c0ae7b367d tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:15:57.698360 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-a4cba791-de54-4f5a-a01f-13c0ae7b367d tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:15:57.700491 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-a4cba791-de54-4f5a-a01f-13c0ae7b367d tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:15:57.701116 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-a4cba791-de54-4f5a-a01f-13c0ae7b367d tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:15:57.701683 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-a4cba791-de54-4f5a-a01f-13c0ae7b367d tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:15:57.922411 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.policy [None req-a4cba791-de54-4f5a-a01f-13c0ae7b367d tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c26232f042844a898c19d1f63152b428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd004facbaed41a7a54a3ed6a6a44305', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120799) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:15:57.934418 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-a4cba791-de54-4f5a-a01f-13c0ae7b367d tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] 10.222.0.17 "GET /compute/v2.1/servers/0c761eab-49ac-4396-9907-70845ad75c64" status: 200 len: 1258 microversion: 2.1 time: 0.261600 Aug 23 07:15:57.935467 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 215/419] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:15:57 2022] GET /compute/v2.1/servers/0c761eab-49ac-4396-9907-70845ad75c64 => generated 1258 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:15:58.003218 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-e203f388-afbc-4af5-aca4-3f5a4339818b tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] Calling method '>' {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:15:58.004559 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.compute.api [None req-e203f388-afbc-4af5-aca4-3f5a4339818b tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] [instance: f7783f88-5770-4ca3-a5cf-294f044d21a8] Fetching instance by UUID {{(pid=120799) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:15:58.012723 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-e203f388-afbc-4af5-aca4-3f5a4339818b tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:15:58.013600 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-e203f388-afbc-4af5-aca4-3f5a4339818b tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:15:58.014979 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-e203f388-afbc-4af5-aca4-3f5a4339818b tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:15:58.016113 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-e203f388-afbc-4af5-aca4-3f5a4339818b tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:15:58.016815 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-e203f388-afbc-4af5-aca4-3f5a4339818b tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:15:58.017700 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-e203f388-afbc-4af5-aca4-3f5a4339818b tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:15:58.206037 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.policy [None req-e203f388-afbc-4af5-aca4-3f5a4339818b tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5e8c33634b246319de495d269c05124', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9466597900d4a3ca60a2ef8b7678c87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120799) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:15:58.211958 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG dbcounter [-] [120799] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=120799) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:15:58.222244 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-e203f388-afbc-4af5-aca4-3f5a4339818b tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] 10.222.0.17 "GET /compute/v2.1/servers/f7783f88-5770-4ca3-a5cf-294f044d21a8" status: 200 len: 1358 microversion: 2.1 time: 0.223482 Aug 23 07:15:58.223818 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 216/420] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:15:57 2022] GET /compute/v2.1/servers/f7783f88-5770-4ca3-a5cf-294f044d21a8 => generated 1358 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 07:15:58.234117 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-3b3cd922-b9db-43c1-b74c-9371bba0d287 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-755054030", "imageRef": "b899fd65-02ae-4b43-bac7-86f38fc3f224", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "5ee97029-6237-4f87-a16d-878d9597a1a6"}], "security_groups": [{"name": "tempest-securitygroup--512141485"}], "key_name": "tempest-keypair-909959701", "user_data": "}} {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 07:15:58.516832 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.network.neutron [None req-3b3cd922-b9db-43c1-b74c-9371bba0d287 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] validate_networks() for [('5ee97029-6237-4f87-a16d-878d9597a1a6', None, None, None, None, None)] {{(pid=120799) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 23 07:15:58.958566 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.virt.hardware [None req-3b3cd922-b9db-43c1-b74c-9371bba0d287 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Flavor limits 0:0:0 {{(pid=120799) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 07:15:58.959605 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.virt.hardware [None req-3b3cd922-b9db-43c1-b74c-9371bba0d287 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Image limits 0:0:0 {{(pid=120799) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 07:15:58.959800 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.virt.hardware [None req-3b3cd922-b9db-43c1-b74c-9371bba0d287 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Flavor pref 0:0:0 {{(pid=120799) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 07:15:58.960197 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.virt.hardware [None req-3b3cd922-b9db-43c1-b74c-9371bba0d287 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Image pref 0:0:0 {{(pid=120799) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 07:15:58.960593 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.virt.hardware [None req-3b3cd922-b9db-43c1-b74c-9371bba0d287 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120799) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 07:15:58.980626 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-3b3cd922-b9db-43c1-b74c-9371bba0d287 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:15:58.981134 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-3b3cd922-b9db-43c1-b74c-9371bba0d287 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:15:58.981608 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-3b3cd922-b9db-43c1-b74c-9371bba0d287 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:15:58.982328 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-3b3cd922-b9db-43c1-b74c-9371bba0d287 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:15:58.982771 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-3b3cd922-b9db-43c1-b74c-9371bba0d287 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:15:58.983184 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-3b3cd922-b9db-43c1-b74c-9371bba0d287 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:15:59.000235 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.quota [None req-3b3cd922-b9db-43c1-b74c-9371bba0d287 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Getting quotas for project eb44f62fa62e46528712f24479cbb19f. Resources: {'ram', 'instances', 'cores'} {{(pid=120799) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 07:15:59.004720 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.quota [None req-3b3cd922-b9db-43c1-b74c-9371bba0d287 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Getting quotas for user 471dc5c1db64411ab1d80ad6c038e519 and project eb44f62fa62e46528712f24479cbb19f. Resources: {'ram', 'instances', 'cores'} {{(pid=120799) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 07:15:59.018284 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.compute.api [None req-3b3cd922-b9db-43c1-b74c-9371bba0d287 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Going to run 1 instances... {{(pid=120799) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 23 07:15:59.021061 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.compute.api [None req-3b3cd922-b9db-43c1-b74c-9371bba0d287 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] [instance: 2276f5b3-e71c-42f5-b540-5535a8aa1d48] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b899fd65-02ae-4b43-bac7-86f38fc3f224',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120799) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 07:15:59.073705 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-3b3cd922-b9db-43c1-b74c-9371bba0d287 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.844684 Aug 23 07:15:59.074445 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 217/421] 10.222.0.17 () {60 vars in 1147 bytes} [Tue Aug 23 07:15:58 2022] POST /compute/v2.1/servers => generated 401 bytes in 850 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 23 07:15:59.079018 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-baa88c3e-1b9c-4201-9ba8-45c7fb6a10bc tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] Calling method '>' {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:15:59.079649 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.compute.api [None req-baa88c3e-1b9c-4201-9ba8-45c7fb6a10bc tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] [instance: 0c761eab-49ac-4396-9907-70845ad75c64] Fetching instance by UUID {{(pid=120799) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:15:59.086136 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-baa88c3e-1b9c-4201-9ba8-45c7fb6a10bc tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:15:59.086608 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-baa88c3e-1b9c-4201-9ba8-45c7fb6a10bc tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:15:59.087033 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-baa88c3e-1b9c-4201-9ba8-45c7fb6a10bc tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:15:59.087739 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-baa88c3e-1b9c-4201-9ba8-45c7fb6a10bc tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:15:59.088187 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-baa88c3e-1b9c-4201-9ba8-45c7fb6a10bc tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:15:59.088598 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-baa88c3e-1b9c-4201-9ba8-45c7fb6a10bc tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:15:59.266426 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.policy [None req-baa88c3e-1b9c-4201-9ba8-45c7fb6a10bc tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c26232f042844a898c19d1f63152b428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd004facbaed41a7a54a3ed6a6a44305', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120799) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:15:59.279039 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-baa88c3e-1b9c-4201-9ba8-45c7fb6a10bc tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] 10.222.0.17 "GET /compute/v2.1/servers/0c761eab-49ac-4396-9907-70845ad75c64" status: 200 len: 1258 microversion: 2.1 time: 0.203533 Aug 23 07:15:59.280179 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 218/422] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:15:59 2022] GET /compute/v2.1/servers/0c761eab-49ac-4396-9907-70845ad75c64 => generated 1258 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:15:59.284824 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-2a9a96ce-b394-44d7-9405-507f30eb2a1b tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Calling method '>' {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:15:59.285419 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.compute.api [None req-2a9a96ce-b394-44d7-9405-507f30eb2a1b tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] [instance: 2276f5b3-e71c-42f5-b540-5535a8aa1d48] Fetching instance by UUID {{(pid=120799) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:15:59.290674 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG dbcounter [-] [120799] Writing DB stats nova_api:SELECT=91,nova_api:UPDATE=1,nova_api:INSERT=7,nova_api:DELETE=1 {{(pid=120799) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:15:59.396817 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.policy [None req-2a9a96ce-b394-44d7-9405-507f30eb2a1b tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '471dc5c1db64411ab1d80ad6c038e519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb44f62fa62e46528712f24479cbb19f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120799) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:15:59.406315 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-2a9a96ce-b394-44d7-9405-507f30eb2a1b tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] 10.222.0.17 "GET /compute/v2.1/servers/2276f5b3-e71c-42f5-b540-5535a8aa1d48" status: 200 len: 1240 microversion: 2.1 time: 0.124741 Aug 23 07:15:59.407033 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 219/423] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:15:59 2022] GET /compute/v2.1/servers/2276f5b3-e71c-42f5-b540-5535a8aa1d48 => generated 1240 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:15:59.413043 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-88edcd80-c46e-4528-b602-083ada47be03 tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] Calling method '>' {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:15:59.413043 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.compute.api [None req-88edcd80-c46e-4528-b602-083ada47be03 tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] [instance: f7783f88-5770-4ca3-a5cf-294f044d21a8] Fetching instance by UUID {{(pid=120799) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:15:59.429852 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-88edcd80-c46e-4528-b602-083ada47be03 tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:15:59.430336 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-88edcd80-c46e-4528-b602-083ada47be03 tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:15:59.430766 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-88edcd80-c46e-4528-b602-083ada47be03 tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:15:59.431710 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-88edcd80-c46e-4528-b602-083ada47be03 tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:15:59.432156 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-88edcd80-c46e-4528-b602-083ada47be03 tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:15:59.432572 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-88edcd80-c46e-4528-b602-083ada47be03 tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:15:59.590347 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.policy [None req-88edcd80-c46e-4528-b602-083ada47be03 tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5e8c33634b246319de495d269c05124', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9466597900d4a3ca60a2ef8b7678c87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120799) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:15:59.602865 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-88edcd80-c46e-4528-b602-083ada47be03 tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] 10.222.0.17 "GET /compute/v2.1/servers/f7783f88-5770-4ca3-a5cf-294f044d21a8" status: 200 len: 1358 microversion: 2.1 time: 0.194878 Aug 23 07:15:59.603685 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 220/424] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:15:59 2022] GET /compute/v2.1/servers/f7783f88-5770-4ca3-a5cf-294f044d21a8 => generated 1358 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:16:00.301275 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-5301b206-c2f2-4bb5-9d4f-4b182b9ab741 tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] Calling method '>' {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:16:00.302030 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.compute.api [None req-5301b206-c2f2-4bb5-9d4f-4b182b9ab741 tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] [instance: 0c761eab-49ac-4396-9907-70845ad75c64] Fetching instance by UUID {{(pid=120799) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:16:00.309554 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-5301b206-c2f2-4bb5-9d4f-4b182b9ab741 tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:16:00.310338 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-5301b206-c2f2-4bb5-9d4f-4b182b9ab741 tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:16:00.310934 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-5301b206-c2f2-4bb5-9d4f-4b182b9ab741 tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:16:00.311873 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-5301b206-c2f2-4bb5-9d4f-4b182b9ab741 tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:16:00.312662 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-5301b206-c2f2-4bb5-9d4f-4b182b9ab741 tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:16:00.313237 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-5301b206-c2f2-4bb5-9d4f-4b182b9ab741 tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:16:00.469234 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.policy [None req-5301b206-c2f2-4bb5-9d4f-4b182b9ab741 tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c26232f042844a898c19d1f63152b428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd004facbaed41a7a54a3ed6a6a44305', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120799) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:16:00.479140 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-5301b206-c2f2-4bb5-9d4f-4b182b9ab741 tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] 10.222.0.17 "GET /compute/v2.1/servers/0c761eab-49ac-4396-9907-70845ad75c64" status: 200 len: 1258 microversion: 2.1 time: 0.181891 Aug 23 07:16:00.479761 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 221/425] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:16:00 2022] GET /compute/v2.1/servers/0c761eab-49ac-4396-9907-70845ad75c64 => generated 1258 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 07:16:00.484750 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-d41c280e-c28f-43e7-96e8-8321f724d837 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Calling method '>' {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:16:00.485329 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.compute.api [None req-d41c280e-c28f-43e7-96e8-8321f724d837 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] [instance: 2276f5b3-e71c-42f5-b540-5535a8aa1d48] Fetching instance by UUID {{(pid=120799) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:16:00.491302 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-d41c280e-c28f-43e7-96e8-8321f724d837 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:16:00.491824 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-d41c280e-c28f-43e7-96e8-8321f724d837 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:16:00.492250 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-d41c280e-c28f-43e7-96e8-8321f724d837 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:16:00.492925 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-d41c280e-c28f-43e7-96e8-8321f724d837 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:16:00.493402 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-d41c280e-c28f-43e7-96e8-8321f724d837 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:16:00.493810 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-d41c280e-c28f-43e7-96e8-8321f724d837 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:16:00.559820 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.policy [None req-d41c280e-c28f-43e7-96e8-8321f724d837 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '471dc5c1db64411ab1d80ad6c038e519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb44f62fa62e46528712f24479cbb19f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120799) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:16:00.571868 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-d41c280e-c28f-43e7-96e8-8321f724d837 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] 10.222.0.17 "GET /compute/v2.1/servers/2276f5b3-e71c-42f5-b540-5535a8aa1d48" status: 200 len: 1244 microversion: 2.1 time: 0.090828 Aug 23 07:16:00.572478 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 222/426] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:16:00 2022] GET /compute/v2.1/servers/2276f5b3-e71c-42f5-b540-5535a8aa1d48 => generated 1244 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:16:00.624935 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-a35adb95-4aeb-4b42-be6b-2a6f07596041 tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] Calling method '>' {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:16:00.625542 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.compute.api [None req-a35adb95-4aeb-4b42-be6b-2a6f07596041 tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] [instance: f7783f88-5770-4ca3-a5cf-294f044d21a8] Fetching instance by UUID {{(pid=120799) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:16:00.631711 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-a35adb95-4aeb-4b42-be6b-2a6f07596041 tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:16:00.632197 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-a35adb95-4aeb-4b42-be6b-2a6f07596041 tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:16:00.632680 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-a35adb95-4aeb-4b42-be6b-2a6f07596041 tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:16:00.633337 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-a35adb95-4aeb-4b42-be6b-2a6f07596041 tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:16:00.633780 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-a35adb95-4aeb-4b42-be6b-2a6f07596041 tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:16:00.634247 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-a35adb95-4aeb-4b42-be6b-2a6f07596041 tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:16:00.805040 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.policy [None req-a35adb95-4aeb-4b42-be6b-2a6f07596041 tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5e8c33634b246319de495d269c05124', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9466597900d4a3ca60a2ef8b7678c87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120799) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:16:00.813419 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-a35adb95-4aeb-4b42-be6b-2a6f07596041 tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] 10.222.0.17 "GET /compute/v2.1/servers/f7783f88-5770-4ca3-a5cf-294f044d21a8" status: 200 len: 1358 microversion: 2.1 time: 0.192850 Aug 23 07:16:00.813917 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 223/427] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:16:00 2022] GET /compute/v2.1/servers/f7783f88-5770-4ca3-a5cf-294f044d21a8 => generated 1358 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:16:01.501791 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-b346d985-03e6-4bb5-9f1e-14338bd7e4fb tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] Calling method '>' {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:16:01.502557 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.compute.api [None req-b346d985-03e6-4bb5-9f1e-14338bd7e4fb tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] [instance: 0c761eab-49ac-4396-9907-70845ad75c64] Fetching instance by UUID {{(pid=120799) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:16:01.510082 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-b346d985-03e6-4bb5-9f1e-14338bd7e4fb tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:16:01.510684 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-b346d985-03e6-4bb5-9f1e-14338bd7e4fb tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:16:01.511190 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-b346d985-03e6-4bb5-9f1e-14338bd7e4fb tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:16:01.512024 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-b346d985-03e6-4bb5-9f1e-14338bd7e4fb tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:16:01.512653 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-b346d985-03e6-4bb5-9f1e-14338bd7e4fb tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:16:01.513268 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-b346d985-03e6-4bb5-9f1e-14338bd7e4fb tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:16:01.568202 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG dbcounter [-] [120798] Writing DB stats nova_cell0:SELECT=2 {{(pid=120798) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:16:01.659477 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.policy [None req-b346d985-03e6-4bb5-9f1e-14338bd7e4fb tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c26232f042844a898c19d1f63152b428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd004facbaed41a7a54a3ed6a6a44305', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120799) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:16:01.669580 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-b346d985-03e6-4bb5-9f1e-14338bd7e4fb tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] 10.222.0.17 "GET /compute/v2.1/servers/0c761eab-49ac-4396-9907-70845ad75c64" status: 200 len: 1258 microversion: 2.1 time: 0.171818 Aug 23 07:16:01.670158 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 224/428] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:16:01 2022] GET /compute/v2.1/servers/0c761eab-49ac-4396-9907-70845ad75c64 => generated 1258 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:16:01.674787 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-161c640f-f79b-4083-a4e7-b439bae4b4a2 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Calling method '>' {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:16:01.675386 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.compute.api [None req-161c640f-f79b-4083-a4e7-b439bae4b4a2 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] [instance: 2276f5b3-e71c-42f5-b540-5535a8aa1d48] Fetching instance by UUID {{(pid=120799) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:16:01.681529 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-161c640f-f79b-4083-a4e7-b439bae4b4a2 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:16:01.682347 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-161c640f-f79b-4083-a4e7-b439bae4b4a2 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:16:01.682778 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-161c640f-f79b-4083-a4e7-b439bae4b4a2 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:16:01.683641 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-161c640f-f79b-4083-a4e7-b439bae4b4a2 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:16:01.684088 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-161c640f-f79b-4083-a4e7-b439bae4b4a2 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:16:01.684506 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-161c640f-f79b-4083-a4e7-b439bae4b4a2 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:16:01.752982 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.policy [None req-161c640f-f79b-4083-a4e7-b439bae4b4a2 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '471dc5c1db64411ab1d80ad6c038e519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb44f62fa62e46528712f24479cbb19f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120799) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:16:01.760677 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-161c640f-f79b-4083-a4e7-b439bae4b4a2 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] 10.222.0.17 "GET /compute/v2.1/servers/2276f5b3-e71c-42f5-b540-5535a8aa1d48" status: 200 len: 1244 microversion: 2.1 time: 0.089568 Aug 23 07:16:01.761552 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 225/429] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:16:01 2022] GET /compute/v2.1/servers/2276f5b3-e71c-42f5-b540-5535a8aa1d48 => generated 1244 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:16:01.767884 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG dbcounter [-] [120798] Writing DB stats nova_cell0:SELECT=12 {{(pid=120798) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:16:01.836619 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-0c1f04f2-0385-4ce2-9872-6cb47d02e9cb tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] Calling method '>' {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:16:01.837161 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.compute.api [None req-0c1f04f2-0385-4ce2-9872-6cb47d02e9cb tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] [instance: f7783f88-5770-4ca3-a5cf-294f044d21a8] Fetching instance by UUID {{(pid=120799) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:16:01.843739 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-0c1f04f2-0385-4ce2-9872-6cb47d02e9cb tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:16:01.844221 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-0c1f04f2-0385-4ce2-9872-6cb47d02e9cb tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:16:01.844650 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-0c1f04f2-0385-4ce2-9872-6cb47d02e9cb tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:16:01.845337 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-0c1f04f2-0385-4ce2-9872-6cb47d02e9cb tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:16:01.845778 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-0c1f04f2-0385-4ce2-9872-6cb47d02e9cb tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:16:01.846193 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-0c1f04f2-0385-4ce2-9872-6cb47d02e9cb tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:16:01.983621 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.policy [None req-0c1f04f2-0385-4ce2-9872-6cb47d02e9cb tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5e8c33634b246319de495d269c05124', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9466597900d4a3ca60a2ef8b7678c87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120799) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:16:01.993225 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-0c1f04f2-0385-4ce2-9872-6cb47d02e9cb tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] 10.222.0.17 "GET /compute/v2.1/servers/f7783f88-5770-4ca3-a5cf-294f044d21a8" status: 200 len: 1358 microversion: 2.1 time: 0.160655 Aug 23 07:16:02.000656 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 226/430] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:16:01 2022] GET /compute/v2.1/servers/f7783f88-5770-4ca3-a5cf-294f044d21a8 => generated 1358 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:16:02.690532 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-be1b5e0f-4017-42b0-90e0-0a98d0805c47 tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] Calling method '>' {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:16:02.691277 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.compute.api [None req-be1b5e0f-4017-42b0-90e0-0a98d0805c47 tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] [instance: 0c761eab-49ac-4396-9907-70845ad75c64] Fetching instance by UUID {{(pid=120799) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:16:02.698784 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-be1b5e0f-4017-42b0-90e0-0a98d0805c47 tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:16:02.699496 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-be1b5e0f-4017-42b0-90e0-0a98d0805c47 tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:16:02.700175 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-be1b5e0f-4017-42b0-90e0-0a98d0805c47 tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:16:02.700974 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-be1b5e0f-4017-42b0-90e0-0a98d0805c47 tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:16:02.701423 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-be1b5e0f-4017-42b0-90e0-0a98d0805c47 tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:16:02.701903 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-be1b5e0f-4017-42b0-90e0-0a98d0805c47 tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:16:02.865121 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.policy [None req-be1b5e0f-4017-42b0-90e0-0a98d0805c47 tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c26232f042844a898c19d1f63152b428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd004facbaed41a7a54a3ed6a6a44305', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120799) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:16:02.873231 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-be1b5e0f-4017-42b0-90e0-0a98d0805c47 tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] 10.222.0.17 "GET /compute/v2.1/servers/0c761eab-49ac-4396-9907-70845ad75c64" status: 200 len: 1258 microversion: 2.1 time: 0.186676 Aug 23 07:16:02.873800 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 227/431] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:16:02 2022] GET /compute/v2.1/servers/0c761eab-49ac-4396-9907-70845ad75c64 => generated 1258 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 07:16:02.878295 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-9d4300f9-bd49-4e0c-8432-89f9a8756578 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Calling method '>' {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:16:02.878894 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.compute.api [None req-9d4300f9-bd49-4e0c-8432-89f9a8756578 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] [instance: 2276f5b3-e71c-42f5-b540-5535a8aa1d48] Fetching instance by UUID {{(pid=120799) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:16:02.884564 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-9d4300f9-bd49-4e0c-8432-89f9a8756578 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:16:02.885039 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-9d4300f9-bd49-4e0c-8432-89f9a8756578 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:16:02.885468 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-9d4300f9-bd49-4e0c-8432-89f9a8756578 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:16:02.886146 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-9d4300f9-bd49-4e0c-8432-89f9a8756578 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:16:02.886730 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-9d4300f9-bd49-4e0c-8432-89f9a8756578 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:16:02.887297 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-9d4300f9-bd49-4e0c-8432-89f9a8756578 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:16:02.962648 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.policy [None req-9d4300f9-bd49-4e0c-8432-89f9a8756578 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '471dc5c1db64411ab1d80ad6c038e519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb44f62fa62e46528712f24479cbb19f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120799) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:16:02.971148 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-9d4300f9-bd49-4e0c-8432-89f9a8756578 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] 10.222.0.17 "GET /compute/v2.1/servers/2276f5b3-e71c-42f5-b540-5535a8aa1d48" status: 200 len: 1244 microversion: 2.1 time: 0.096360 Aug 23 07:16:02.971757 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 228/432] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:16:02 2022] GET /compute/v2.1/servers/2276f5b3-e71c-42f5-b540-5535a8aa1d48 => generated 1244 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:16:03.014546 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-07684cd8-fac6-4028-b550-c9cd0912a165 tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] Calling method '>' {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:16:03.015150 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.compute.api [None req-07684cd8-fac6-4028-b550-c9cd0912a165 tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] [instance: f7783f88-5770-4ca3-a5cf-294f044d21a8] Fetching instance by UUID {{(pid=120799) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:16:03.021629 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-07684cd8-fac6-4028-b550-c9cd0912a165 tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:16:03.022104 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-07684cd8-fac6-4028-b550-c9cd0912a165 tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:16:03.022525 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-07684cd8-fac6-4028-b550-c9cd0912a165 tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:16:03.023212 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-07684cd8-fac6-4028-b550-c9cd0912a165 tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:16:03.023678 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-07684cd8-fac6-4028-b550-c9cd0912a165 tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:16:03.024097 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-07684cd8-fac6-4028-b550-c9cd0912a165 tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:16:03.156037 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.policy [None req-07684cd8-fac6-4028-b550-c9cd0912a165 tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5e8c33634b246319de495d269c05124', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9466597900d4a3ca60a2ef8b7678c87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120799) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:16:03.166797 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-07684cd8-fac6-4028-b550-c9cd0912a165 tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] 10.222.0.17 "GET /compute/v2.1/servers/f7783f88-5770-4ca3-a5cf-294f044d21a8" status: 200 len: 1358 microversion: 2.1 time: 0.155987 Aug 23 07:16:03.167467 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 229/433] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:16:03 2022] GET /compute/v2.1/servers/f7783f88-5770-4ca3-a5cf-294f044d21a8 => generated 1358 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:16:03.812201 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG dbcounter [-] [120798] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120798) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:16:03.846842 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [None req-70534119-ca1f-47c7-b6e1-878cd7483e1a tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] 10.222.0.17 "POST /compute/v2.1/servers/b9418fe6-a57e-4a99-becb-19a4d3a52da1/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 6.296248 Aug 23 07:16:03.848575 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 205/434] 10.222.0.17 () {60 vars in 1323 bytes} [Tue Aug 23 07:15:57 2022] POST /compute/v2.1/servers/b9418fe6-a57e-4a99-becb-19a4d3a52da1/os-volume_attachments => generated 194 bytes in 6298 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 07:16:03.894559 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-1ab3eb2f-8ef5-4b8c-b402-9da324eacb1b tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] Calling method '>' {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:16:03.895345 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.compute.api [None req-1ab3eb2f-8ef5-4b8c-b402-9da324eacb1b tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] [instance: 0c761eab-49ac-4396-9907-70845ad75c64] Fetching instance by UUID {{(pid=120799) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:16:03.904223 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-1ab3eb2f-8ef5-4b8c-b402-9da324eacb1b tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:16:03.905099 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-1ab3eb2f-8ef5-4b8c-b402-9da324eacb1b tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:16:03.905774 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-1ab3eb2f-8ef5-4b8c-b402-9da324eacb1b tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:16:03.906829 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-1ab3eb2f-8ef5-4b8c-b402-9da324eacb1b tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:16:03.907393 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-1ab3eb2f-8ef5-4b8c-b402-9da324eacb1b tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:16:03.907975 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-1ab3eb2f-8ef5-4b8c-b402-9da324eacb1b tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:16:04.001045 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-cef13add-584b-4d9c-bcf5-7e75ca4e54b1 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Calling method '>' {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:16:04.001890 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.compute.api [None req-cef13add-584b-4d9c-bcf5-7e75ca4e54b1 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] [instance: 2276f5b3-e71c-42f5-b540-5535a8aa1d48] Fetching instance by UUID {{(pid=120798) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:16:04.009293 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-cef13add-584b-4d9c-bcf5-7e75ca4e54b1 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:16:04.009896 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-cef13add-584b-4d9c-bcf5-7e75ca4e54b1 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:16:04.010725 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-cef13add-584b-4d9c-bcf5-7e75ca4e54b1 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:16:04.011541 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-cef13add-584b-4d9c-bcf5-7e75ca4e54b1 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:16:04.012117 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-cef13add-584b-4d9c-bcf5-7e75ca4e54b1 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:16:04.016850 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-cef13add-584b-4d9c-bcf5-7e75ca4e54b1 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:16:04.111632 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.policy [None req-cef13add-584b-4d9c-bcf5-7e75ca4e54b1 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '471dc5c1db64411ab1d80ad6c038e519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb44f62fa62e46528712f24479cbb19f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120798) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:16:04.134505 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [None req-cef13add-584b-4d9c-bcf5-7e75ca4e54b1 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] 10.222.0.17 "GET /compute/v2.1/servers/2276f5b3-e71c-42f5-b540-5535a8aa1d48" status: 200 len: 1292 microversion: 2.1 time: 0.144917 Aug 23 07:16:04.148491 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 206/435] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:16:03 2022] GET /compute/v2.1/servers/2276f5b3-e71c-42f5-b540-5535a8aa1d48 => generated 1292 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 07:16:04.159728 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-3481803a-bd16-4dc4-96b7-c68bc3766dd6 tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-867356196", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1565151740", "security_groups": [{"name": "tempest-secgroup-smoke-1052235560"}], "block_device_mapping_v2": [{"uuid": "d4aaf0ae-c4ba-4b81-85c9-e14f1875f049", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "6a0a58c3-07f3-4091-814d-8e4792f5ba82"}]}} {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 07:16:04.170897 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.policy [None req-1ab3eb2f-8ef5-4b8c-b402-9da324eacb1b tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c26232f042844a898c19d1f63152b428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd004facbaed41a7a54a3ed6a6a44305', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120799) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:16:04.185818 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-1ab3eb2f-8ef5-4b8c-b402-9da324eacb1b tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] 10.222.0.17 "GET /compute/v2.1/servers/0c761eab-49ac-4396-9907-70845ad75c64" status: 200 len: 1258 microversion: 2.1 time: 0.295476 Aug 23 07:16:04.188507 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 230/436] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:16:03 2022] GET /compute/v2.1/servers/0c761eab-49ac-4396-9907-70845ad75c64 => generated 1258 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:16:04.197243 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-ffc3cb24-f4fa-42ac-94c8-121f67dc047e tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] Calling method '>' {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:16:04.198516 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.compute.api [None req-ffc3cb24-f4fa-42ac-94c8-121f67dc047e tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] [instance: f7783f88-5770-4ca3-a5cf-294f044d21a8] Fetching instance by UUID {{(pid=120799) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:16:04.234190 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-ffc3cb24-f4fa-42ac-94c8-121f67dc047e tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:16:04.234739 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-ffc3cb24-f4fa-42ac-94c8-121f67dc047e tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:16:04.235171 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-ffc3cb24-f4fa-42ac-94c8-121f67dc047e tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:16:04.235894 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-ffc3cb24-f4fa-42ac-94c8-121f67dc047e tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:16:04.236345 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-ffc3cb24-f4fa-42ac-94c8-121f67dc047e tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:16:04.236757 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-ffc3cb24-f4fa-42ac-94c8-121f67dc047e tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:16:04.449893 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.network.neutron [None req-3481803a-bd16-4dc4-96b7-c68bc3766dd6 tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] validate_networks() for [('6a0a58c3-07f3-4091-814d-8e4792f5ba82', None, None, None, None, None)] {{(pid=120798) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 23 07:16:04.719361 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.policy [None req-ffc3cb24-f4fa-42ac-94c8-121f67dc047e tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5e8c33634b246319de495d269c05124', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9466597900d4a3ca60a2ef8b7678c87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120799) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:16:04.727478 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-ffc3cb24-f4fa-42ac-94c8-121f67dc047e tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] 10.222.0.17 "GET /compute/v2.1/servers/f7783f88-5770-4ca3-a5cf-294f044d21a8" status: 200 len: 1358 microversion: 2.1 time: 0.535845 Aug 23 07:16:04.728067 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 231/437] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:16:04 2022] GET /compute/v2.1/servers/f7783f88-5770-4ca3-a5cf-294f044d21a8 => generated 1358 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:16:04.746477 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [req-98795acf-f418-4584-930e-699e8efc58cf req-89cdf8fb-43e2-4cfe-aa24-d3435a179a5e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0c761eab-49ac-4396-9907-70845ad75c64", "tag": "bb18fb15-817d-4f8a-9e7c-652d111e0cd7"}]} {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 07:16:04.756533 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [req-98795acf-f418-4584-930e-699e8efc58cf req-89cdf8fb-43e2-4cfe-aa24-d3435a179a5e service nova] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:16:04.757078 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [req-98795acf-f418-4584-930e-699e8efc58cf req-89cdf8fb-43e2-4cfe-aa24-d3435a179a5e service nova] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:16:04.757597 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [req-98795acf-f418-4584-930e-699e8efc58cf req-89cdf8fb-43e2-4cfe-aa24-d3435a179a5e service nova] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:16:04.769627 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.compute.server_external_events [req-98795acf-f418-4584-930e-699e8efc58cf req-89cdf8fb-43e2-4cfe-aa24-d3435a179a5e service nova] Creating event network-changed:bb18fb15-817d-4f8a-9e7c-652d111e0cd7 for instance 0c761eab-49ac-4396-9907-70845ad75c64 on hv-cinder-85409 Aug 23 07:16:04.774750 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [req-98795acf-f418-4584-930e-699e8efc58cf req-89cdf8fb-43e2-4cfe-aa24-d3435a179a5e service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032049 Aug 23 07:16:04.775461 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 232/438] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Aug 23 07:16:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 07:16:05.157952 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-b5acc64e-3fa7-4cf9-99fe-39ee0f622571 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Calling method '>' {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:16:05.158849 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.compute.api [None req-b5acc64e-3fa7-4cf9-99fe-39ee0f622571 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] [instance: 2276f5b3-e71c-42f5-b540-5535a8aa1d48] Fetching instance by UUID {{(pid=120799) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:16:05.168091 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-b5acc64e-3fa7-4cf9-99fe-39ee0f622571 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:16:05.169990 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-b5acc64e-3fa7-4cf9-99fe-39ee0f622571 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:16:05.170733 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-b5acc64e-3fa7-4cf9-99fe-39ee0f622571 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:16:05.171625 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-b5acc64e-3fa7-4cf9-99fe-39ee0f622571 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:16:05.174309 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-b5acc64e-3fa7-4cf9-99fe-39ee0f622571 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:16:05.174877 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-b5acc64e-3fa7-4cf9-99fe-39ee0f622571 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:16:05.291454 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.policy [None req-b5acc64e-3fa7-4cf9-99fe-39ee0f622571 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '471dc5c1db64411ab1d80ad6c038e519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb44f62fa62e46528712f24479cbb19f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120799) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:16:05.299621 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-b5acc64e-3fa7-4cf9-99fe-39ee0f622571 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] 10.222.0.17 "GET /compute/v2.1/servers/2276f5b3-e71c-42f5-b540-5535a8aa1d48" status: 200 len: 1298 microversion: 2.1 time: 0.146365 Aug 23 07:16:05.300171 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 233/439] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:16:05 2022] GET /compute/v2.1/servers/2276f5b3-e71c-42f5-b540-5535a8aa1d48 => generated 1298 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:16:05.304947 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-2406731f-c06d-4c6a-a853-50c59725e907 tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] Calling method '>' {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:16:05.305733 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.compute.api [None req-2406731f-c06d-4c6a-a853-50c59725e907 tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] [instance: 0c761eab-49ac-4396-9907-70845ad75c64] Fetching instance by UUID {{(pid=120799) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:16:05.311718 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-2406731f-c06d-4c6a-a853-50c59725e907 tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:16:05.312202 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-2406731f-c06d-4c6a-a853-50c59725e907 tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:16:05.312631 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-2406731f-c06d-4c6a-a853-50c59725e907 tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:16:05.313300 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-2406731f-c06d-4c6a-a853-50c59725e907 tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:16:05.313951 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-2406731f-c06d-4c6a-a853-50c59725e907 tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:16:05.314367 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-2406731f-c06d-4c6a-a853-50c59725e907 tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:16:05.604619 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.policy [None req-2406731f-c06d-4c6a-a853-50c59725e907 tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c26232f042844a898c19d1f63152b428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd004facbaed41a7a54a3ed6a6a44305', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120799) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:16:05.613009 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-2406731f-c06d-4c6a-a853-50c59725e907 tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] 10.222.0.17 "GET /compute/v2.1/servers/0c761eab-49ac-4396-9907-70845ad75c64" status: 200 len: 1258 microversion: 2.1 time: 0.311635 Aug 23 07:16:05.613628 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 234/440] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:16:05 2022] GET /compute/v2.1/servers/0c761eab-49ac-4396-9907-70845ad75c64 => generated 1258 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:16:05.633973 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.virt.hardware [None req-3481803a-bd16-4dc4-96b7-c68bc3766dd6 tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Flavor limits 0:0:0 {{(pid=120798) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 07:16:05.634480 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.virt.hardware [None req-3481803a-bd16-4dc4-96b7-c68bc3766dd6 tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Image limits 0:0:0 {{(pid=120798) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 07:16:05.634924 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.virt.hardware [None req-3481803a-bd16-4dc4-96b7-c68bc3766dd6 tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Flavor pref 0:0:0 {{(pid=120798) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 07:16:05.635327 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.virt.hardware [None req-3481803a-bd16-4dc4-96b7-c68bc3766dd6 tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Image pref 0:0:0 {{(pid=120798) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 07:16:05.635751 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.virt.hardware [None req-3481803a-bd16-4dc4-96b7-c68bc3766dd6 tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120798) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 07:16:05.647550 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-3481803a-bd16-4dc4-96b7-c68bc3766dd6 tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:16:05.648020 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-3481803a-bd16-4dc4-96b7-c68bc3766dd6 tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:16:05.648450 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-3481803a-bd16-4dc4-96b7-c68bc3766dd6 tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:16:05.649176 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-3481803a-bd16-4dc4-96b7-c68bc3766dd6 tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:16:05.649622 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-3481803a-bd16-4dc4-96b7-c68bc3766dd6 tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:16:05.650039 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-3481803a-bd16-4dc4-96b7-c68bc3766dd6 tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:16:05.670874 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.quota [None req-3481803a-bd16-4dc4-96b7-c68bc3766dd6 tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Getting quotas for project f43b271d00f74eb7aa3d0719315c5a99. Resources: {'ram', 'instances', 'cores'} {{(pid=120798) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 07:16:05.673214 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG dbcounter [-] [120798] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=5,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=120798) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:16:05.675715 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.quota [None req-3481803a-bd16-4dc4-96b7-c68bc3766dd6 tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Getting quotas for user ffd12f09606b4e6ba12f63b976df1884 and project f43b271d00f74eb7aa3d0719315c5a99. Resources: {'ram', 'instances', 'cores'} {{(pid=120798) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 07:16:05.741817 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.compute.api [None req-3481803a-bd16-4dc4-96b7-c68bc3766dd6 tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Going to run 1 instances... {{(pid=120798) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 23 07:16:05.744696 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.compute.api [None req-3481803a-bd16-4dc4-96b7-c68bc3766dd6 tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] [instance: 74919866-69a0-460a-999a-b344d1cbc336] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='d4aaf0ae-c4ba-4b81-85c9-e14f1875f049',volume_size=None,volume_type=None)] {{(pid=120798) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 07:16:05.748585 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-2240adfc-f704-459c-8cb4-eee3d94fcea5 tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] Calling method '>' {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:16:05.749437 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.compute.api [None req-2240adfc-f704-459c-8cb4-eee3d94fcea5 tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] [instance: f7783f88-5770-4ca3-a5cf-294f044d21a8] Fetching instance by UUID {{(pid=120799) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:16:05.755587 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-2240adfc-f704-459c-8cb4-eee3d94fcea5 tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:16:05.756081 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-2240adfc-f704-459c-8cb4-eee3d94fcea5 tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:16:05.756518 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-2240adfc-f704-459c-8cb4-eee3d94fcea5 tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:16:05.757218 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-2240adfc-f704-459c-8cb4-eee3d94fcea5 tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:16:05.757665 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-2240adfc-f704-459c-8cb4-eee3d94fcea5 tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:16:05.758084 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-2240adfc-f704-459c-8cb4-eee3d94fcea5 tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:16:05.900383 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [None req-3481803a-bd16-4dc4-96b7-c68bc3766dd6 tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.750417 Aug 23 07:16:05.901043 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 207/441] 10.222.0.17 () {60 vars in 1147 bytes} [Tue Aug 23 07:16:04 2022] POST /compute/v2.1/servers => generated 406 bytes in 1752 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 23 07:16:05.912262 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-b08ec35c-7089-4497-9033-08a745f888e4 tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Calling method '>' {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:16:05.913985 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.compute.api [None req-b08ec35c-7089-4497-9033-08a745f888e4 tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] [instance: 74919866-69a0-460a-999a-b344d1cbc336] Fetching instance by UUID {{(pid=120798) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:16:06.023090 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.policy [None req-b08ec35c-7089-4497-9033-08a745f888e4 tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffd12f09606b4e6ba12f63b976df1884', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43b271d00f74eb7aa3d0719315c5a99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120798) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:16:06.031867 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [None req-b08ec35c-7089-4497-9033-08a745f888e4 tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] 10.222.0.17 "GET /compute/v2.1/servers/74919866-69a0-460a-999a-b344d1cbc336" status: 200 len: 1094 microversion: 2.1 time: 0.123462 Aug 23 07:16:06.032444 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 208/442] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:16:05 2022] GET /compute/v2.1/servers/74919866-69a0-460a-999a-b344d1cbc336 => generated 1094 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 07:16:06.113674 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.policy [None req-2240adfc-f704-459c-8cb4-eee3d94fcea5 tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5e8c33634b246319de495d269c05124', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9466597900d4a3ca60a2ef8b7678c87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120799) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:16:06.117851 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG dbcounter [-] [120799] Writing DB stats nova_cell1:SELECT=100 {{(pid=120799) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:16:06.124106 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-2240adfc-f704-459c-8cb4-eee3d94fcea5 tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] 10.222.0.17 "GET /compute/v2.1/servers/f7783f88-5770-4ca3-a5cf-294f044d21a8" status: 200 len: 1358 microversion: 2.1 time: 0.378962 Aug 23 07:16:06.133135 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 235/443] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:16:05 2022] GET /compute/v2.1/servers/f7783f88-5770-4ca3-a5cf-294f044d21a8 => generated 1358 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:16:06.322221 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-cb03ffd5-535f-4fb8-a71c-d8aee137ee52 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Calling method '>' {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:16:06.324454 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.compute.api [None req-cb03ffd5-535f-4fb8-a71c-d8aee137ee52 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] [instance: 2276f5b3-e71c-42f5-b540-5535a8aa1d48] Fetching instance by UUID {{(pid=120798) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:16:06.337111 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-cb03ffd5-535f-4fb8-a71c-d8aee137ee52 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:16:06.337957 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-cb03ffd5-535f-4fb8-a71c-d8aee137ee52 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:16:06.338674 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-cb03ffd5-535f-4fb8-a71c-d8aee137ee52 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:16:06.340208 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-cb03ffd5-535f-4fb8-a71c-d8aee137ee52 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:16:06.340882 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-cb03ffd5-535f-4fb8-a71c-d8aee137ee52 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:16:06.341900 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-cb03ffd5-535f-4fb8-a71c-d8aee137ee52 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:16:06.538935 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.policy [None req-cb03ffd5-535f-4fb8-a71c-d8aee137ee52 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '471dc5c1db64411ab1d80ad6c038e519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb44f62fa62e46528712f24479cbb19f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120798) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:16:06.548922 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [None req-cb03ffd5-535f-4fb8-a71c-d8aee137ee52 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] 10.222.0.17 "GET /compute/v2.1/servers/2276f5b3-e71c-42f5-b540-5535a8aa1d48" status: 200 len: 1365 microversion: 2.1 time: 0.230940 Aug 23 07:16:06.548922 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 209/444] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:16:06 2022] GET /compute/v2.1/servers/2276f5b3-e71c-42f5-b540-5535a8aa1d48 => generated 1365 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:16:06.633894 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-d53ebca4-6c46-4fae-a4d7-7f33327f89d2 tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] Calling method '>' {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:16:06.635271 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.compute.api [None req-d53ebca4-6c46-4fae-a4d7-7f33327f89d2 tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] [instance: 0c761eab-49ac-4396-9907-70845ad75c64] Fetching instance by UUID {{(pid=120799) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:16:06.643888 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-d53ebca4-6c46-4fae-a4d7-7f33327f89d2 tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:16:06.644719 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-d53ebca4-6c46-4fae-a4d7-7f33327f89d2 tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:16:06.645425 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-d53ebca4-6c46-4fae-a4d7-7f33327f89d2 tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:16:06.646368 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-d53ebca4-6c46-4fae-a4d7-7f33327f89d2 tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:16:06.647067 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-d53ebca4-6c46-4fae-a4d7-7f33327f89d2 tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:16:06.647908 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-d53ebca4-6c46-4fae-a4d7-7f33327f89d2 tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:16:06.975707 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.policy [None req-d53ebca4-6c46-4fae-a4d7-7f33327f89d2 tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c26232f042844a898c19d1f63152b428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd004facbaed41a7a54a3ed6a6a44305', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120799) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:16:06.984665 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-d53ebca4-6c46-4fae-a4d7-7f33327f89d2 tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] 10.222.0.17 "GET /compute/v2.1/servers/0c761eab-49ac-4396-9907-70845ad75c64" status: 200 len: 1258 microversion: 2.1 time: 0.354676 Aug 23 07:16:06.985623 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 236/445] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:16:06 2022] GET /compute/v2.1/servers/0c761eab-49ac-4396-9907-70845ad75c64 => generated 1258 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:16:07.053957 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-a7209936-1348-493b-8f49-6ad469c79f3e tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Calling method '>' {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:16:07.054657 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.compute.api [None req-a7209936-1348-493b-8f49-6ad469c79f3e tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] [instance: 74919866-69a0-460a-999a-b344d1cbc336] Fetching instance by UUID {{(pid=120798) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:16:07.071870 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-a7209936-1348-493b-8f49-6ad469c79f3e tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:16:07.075371 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-a7209936-1348-493b-8f49-6ad469c79f3e tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:16:07.075838 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-a7209936-1348-493b-8f49-6ad469c79f3e tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:16:07.087608 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-a7209936-1348-493b-8f49-6ad469c79f3e tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:16:07.088367 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-a7209936-1348-493b-8f49-6ad469c79f3e tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:16:07.088776 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-a7209936-1348-493b-8f49-6ad469c79f3e tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:16:07.146761 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-72b2ddd9-319e-48d3-b02e-baa946f44d61 tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] Calling method '>' {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:16:07.147365 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.compute.api [None req-72b2ddd9-319e-48d3-b02e-baa946f44d61 tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] [instance: f7783f88-5770-4ca3-a5cf-294f044d21a8] Fetching instance by UUID {{(pid=120799) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:16:07.158519 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-72b2ddd9-319e-48d3-b02e-baa946f44d61 tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:16:07.160371 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-72b2ddd9-319e-48d3-b02e-baa946f44d61 tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:16:07.161159 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-72b2ddd9-319e-48d3-b02e-baa946f44d61 tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:16:07.162128 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-72b2ddd9-319e-48d3-b02e-baa946f44d61 tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:16:07.162795 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-72b2ddd9-319e-48d3-b02e-baa946f44d61 tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:16:07.163459 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-72b2ddd9-319e-48d3-b02e-baa946f44d61 tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:16:07.244681 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.policy [None req-a7209936-1348-493b-8f49-6ad469c79f3e tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffd12f09606b4e6ba12f63b976df1884', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43b271d00f74eb7aa3d0719315c5a99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120798) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:16:07.256804 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [None req-a7209936-1348-493b-8f49-6ad469c79f3e tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] 10.222.0.17 "GET /compute/v2.1/servers/74919866-69a0-460a-999a-b344d1cbc336" status: 200 len: 1200 microversion: 2.1 time: 0.207169 Aug 23 07:16:07.272542 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 210/446] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:16:07 2022] GET /compute/v2.1/servers/74919866-69a0-460a-999a-b344d1cbc336 => generated 1200 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:16:07.492236 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.policy [None req-72b2ddd9-319e-48d3-b02e-baa946f44d61 tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5e8c33634b246319de495d269c05124', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9466597900d4a3ca60a2ef8b7678c87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120799) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:16:07.502553 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-72b2ddd9-319e-48d3-b02e-baa946f44d61 tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] 10.222.0.17 "GET /compute/v2.1/servers/f7783f88-5770-4ca3-a5cf-294f044d21a8" status: 200 len: 1358 microversion: 2.1 time: 0.359566 Aug 23 07:16:07.503476 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 237/447] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:16:07 2022] GET /compute/v2.1/servers/f7783f88-5770-4ca3-a5cf-294f044d21a8 => generated 1358 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:16:07.570226 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-7e73c3fe-0a35-4a50-a656-bbdd0ba0cda2 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Calling method '>' {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:16:07.571165 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.compute.api [None req-7e73c3fe-0a35-4a50-a656-bbdd0ba0cda2 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] [instance: 2276f5b3-e71c-42f5-b540-5535a8aa1d48] Fetching instance by UUID {{(pid=120798) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:16:07.577645 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-7e73c3fe-0a35-4a50-a656-bbdd0ba0cda2 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:16:07.578096 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-7e73c3fe-0a35-4a50-a656-bbdd0ba0cda2 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:16:07.578843 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-7e73c3fe-0a35-4a50-a656-bbdd0ba0cda2 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:16:07.579585 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-7e73c3fe-0a35-4a50-a656-bbdd0ba0cda2 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:16:07.580009 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-7e73c3fe-0a35-4a50-a656-bbdd0ba0cda2 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:16:07.580759 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-7e73c3fe-0a35-4a50-a656-bbdd0ba0cda2 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:16:07.793747 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.policy [None req-7e73c3fe-0a35-4a50-a656-bbdd0ba0cda2 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '471dc5c1db64411ab1d80ad6c038e519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb44f62fa62e46528712f24479cbb19f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120798) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:16:07.804380 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [None req-7e73c3fe-0a35-4a50-a656-bbdd0ba0cda2 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] 10.222.0.17 "GET /compute/v2.1/servers/2276f5b3-e71c-42f5-b540-5535a8aa1d48" status: 200 len: 1365 microversion: 2.1 time: 0.238533 Aug 23 07:16:07.805106 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 211/448] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:16:07 2022] GET /compute/v2.1/servers/2276f5b3-e71c-42f5-b540-5535a8aa1d48 => generated 1365 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:16:07.836543 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [req-218b4e86-8d9d-4227-83da-ab1714be3cab req-0fd4f910-f211-4b66-a2e4-e1a8a68e9c22 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2276f5b3-e71c-42f5-b540-5535a8aa1d48", "tag": "be3c90aa-cba5-4245-be28-bf2257dc5817"}]} {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 07:16:07.852029 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [req-218b4e86-8d9d-4227-83da-ab1714be3cab req-0fd4f910-f211-4b66-a2e4-e1a8a68e9c22 service nova] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:16:07.853356 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [req-218b4e86-8d9d-4227-83da-ab1714be3cab req-0fd4f910-f211-4b66-a2e4-e1a8a68e9c22 service nova] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:16:07.854148 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [req-218b4e86-8d9d-4227-83da-ab1714be3cab req-0fd4f910-f211-4b66-a2e4-e1a8a68e9c22 service nova] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:16:07.866454 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.compute.server_external_events [req-218b4e86-8d9d-4227-83da-ab1714be3cab req-0fd4f910-f211-4b66-a2e4-e1a8a68e9c22 service nova] Creating event network-changed:be3c90aa-cba5-4245-be28-bf2257dc5817 for instance 2276f5b3-e71c-42f5-b540-5535a8aa1d48 on hv-cinder-85409 Aug 23 07:16:07.872927 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [req-218b4e86-8d9d-4227-83da-ab1714be3cab req-0fd4f910-f211-4b66-a2e4-e1a8a68e9c22 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049158 Aug 23 07:16:07.873795 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 238/449] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Aug 23 07:16:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 07:16:08.005082 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-3021544e-38c9-4d81-97af-eec6540e19df tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] Calling method '>' {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:16:08.005741 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.compute.api [None req-3021544e-38c9-4d81-97af-eec6540e19df tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] [instance: 0c761eab-49ac-4396-9907-70845ad75c64] Fetching instance by UUID {{(pid=120798) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:16:08.012780 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-3021544e-38c9-4d81-97af-eec6540e19df tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:16:08.013425 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-3021544e-38c9-4d81-97af-eec6540e19df tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:16:08.013719 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-3021544e-38c9-4d81-97af-eec6540e19df tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:16:08.014640 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-3021544e-38c9-4d81-97af-eec6540e19df tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:16:08.015096 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-3021544e-38c9-4d81-97af-eec6540e19df tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:16:08.015546 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-3021544e-38c9-4d81-97af-eec6540e19df tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:16:08.284898 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-502d8692-4191-4376-9ee5-9e4eb97c979b tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Calling method '>' {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:16:08.285742 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.compute.api [None req-502d8692-4191-4376-9ee5-9e4eb97c979b tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] [instance: 74919866-69a0-460a-999a-b344d1cbc336] Fetching instance by UUID {{(pid=120799) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:16:08.303465 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-502d8692-4191-4376-9ee5-9e4eb97c979b tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:16:08.304267 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-502d8692-4191-4376-9ee5-9e4eb97c979b tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:16:08.304728 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-502d8692-4191-4376-9ee5-9e4eb97c979b tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:16:08.305643 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-502d8692-4191-4376-9ee5-9e4eb97c979b tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:16:08.306115 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-502d8692-4191-4376-9ee5-9e4eb97c979b tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:16:08.306568 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-502d8692-4191-4376-9ee5-9e4eb97c979b tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:16:08.555429 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.policy [None req-3021544e-38c9-4d81-97af-eec6540e19df tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c26232f042844a898c19d1f63152b428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd004facbaed41a7a54a3ed6a6a44305', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120798) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:16:08.564463 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [None req-3021544e-38c9-4d81-97af-eec6540e19df tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] 10.222.0.17 "GET /compute/v2.1/servers/0c761eab-49ac-4396-9907-70845ad75c64" status: 200 len: 1258 microversion: 2.1 time: 0.563139 Aug 23 07:16:08.565019 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 212/450] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:16:07 2022] GET /compute/v2.1/servers/0c761eab-49ac-4396-9907-70845ad75c64 => generated 1258 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:16:08.569712 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [req-fbec66a8-c446-4314-934f-20d38d9f693a req-f859fc1a-e632-4ce2-b7ab-50d22f9b8e03 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f7783f88-5770-4ca3-a5cf-294f044d21a8", "name": "network-vif-plugged", "status": "completed", "tag": "7ccdc22f-1e2b-4dd9-8ea3-858bf0e435cf"}]} {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 07:16:08.580479 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [req-fbec66a8-c446-4314-934f-20d38d9f693a req-f859fc1a-e632-4ce2-b7ab-50d22f9b8e03 service nova] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:16:08.581183 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [req-fbec66a8-c446-4314-934f-20d38d9f693a req-f859fc1a-e632-4ce2-b7ab-50d22f9b8e03 service nova] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:16:08.581615 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [req-fbec66a8-c446-4314-934f-20d38d9f693a req-f859fc1a-e632-4ce2-b7ab-50d22f9b8e03 service nova] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:16:08.594792 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.compute.server_external_events [req-fbec66a8-c446-4314-934f-20d38d9f693a req-f859fc1a-e632-4ce2-b7ab-50d22f9b8e03 service nova] Creating event network-vif-plugged:7ccdc22f-1e2b-4dd9-8ea3-858bf0e435cf for instance f7783f88-5770-4ca3-a5cf-294f044d21a8 on hv-cinder-85409 Aug 23 07:16:08.600331 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [req-fbec66a8-c446-4314-934f-20d38d9f693a req-f859fc1a-e632-4ce2-b7ab-50d22f9b8e03 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033775 Aug 23 07:16:08.600993 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 213/451] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Aug 23 07:16:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 07:16:08.606386 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-0bca9a19-bd87-4924-948e-b26fa4f99fc1 tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] Calling method '>' {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:16:08.607181 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.compute.api [None req-0bca9a19-bd87-4924-948e-b26fa4f99fc1 tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] [instance: f7783f88-5770-4ca3-a5cf-294f044d21a8] Fetching instance by UUID {{(pid=120798) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:16:08.625403 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-0bca9a19-bd87-4924-948e-b26fa4f99fc1 tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:16:08.626186 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-0bca9a19-bd87-4924-948e-b26fa4f99fc1 tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:16:08.626818 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-0bca9a19-bd87-4924-948e-b26fa4f99fc1 tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:16:08.627859 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-0bca9a19-bd87-4924-948e-b26fa4f99fc1 tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:16:08.628469 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-0bca9a19-bd87-4924-948e-b26fa4f99fc1 tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:16:08.629039 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-0bca9a19-bd87-4924-948e-b26fa4f99fc1 tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:16:08.632819 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.policy [None req-502d8692-4191-4376-9ee5-9e4eb97c979b tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffd12f09606b4e6ba12f63b976df1884', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43b271d00f74eb7aa3d0719315c5a99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120799) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:16:08.651443 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-502d8692-4191-4376-9ee5-9e4eb97c979b tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] 10.222.0.17 "GET /compute/v2.1/servers/74919866-69a0-460a-999a-b344d1cbc336" status: 200 len: 1278 microversion: 2.1 time: 0.373606 Aug 23 07:16:08.658771 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 239/452] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:16:08 2022] GET /compute/v2.1/servers/74919866-69a0-460a-999a-b344d1cbc336 => generated 1278 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:16:08.826300 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-a9349604-f9a3-44cf-aff3-239c57cce8f4 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Calling method '>' {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:16:08.827400 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.compute.api [None req-a9349604-f9a3-44cf-aff3-239c57cce8f4 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] [instance: 2276f5b3-e71c-42f5-b540-5535a8aa1d48] Fetching instance by UUID {{(pid=120799) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:16:08.835791 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-a9349604-f9a3-44cf-aff3-239c57cce8f4 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:16:08.836783 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-a9349604-f9a3-44cf-aff3-239c57cce8f4 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:16:08.838045 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-a9349604-f9a3-44cf-aff3-239c57cce8f4 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:16:08.839043 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-a9349604-f9a3-44cf-aff3-239c57cce8f4 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:16:08.839735 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-a9349604-f9a3-44cf-aff3-239c57cce8f4 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:16:08.840401 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-a9349604-f9a3-44cf-aff3-239c57cce8f4 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:16:08.951387 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.policy [None req-0bca9a19-bd87-4924-948e-b26fa4f99fc1 tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5e8c33634b246319de495d269c05124', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9466597900d4a3ca60a2ef8b7678c87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120798) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:16:08.959076 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [None req-0bca9a19-bd87-4924-948e-b26fa4f99fc1 tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] 10.222.0.17 "GET /compute/v2.1/servers/f7783f88-5770-4ca3-a5cf-294f044d21a8" status: 200 len: 1358 microversion: 2.1 time: 0.356743 Aug 23 07:16:08.971640 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 214/453] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:16:08 2022] GET /compute/v2.1/servers/f7783f88-5770-4ca3-a5cf-294f044d21a8 => generated 1358 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:16:08.971640 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [req-14fd4590-5c5e-4cb2-a20c-bb24d49c696e req-fe80e068-7402-4013-b0c8-7a8702d627e6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "74919866-69a0-460a-999a-b344d1cbc336", "tag": "4f3c189e-8afd-49e5-a4c7-60407c13730e"}]} {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 07:16:08.973860 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [req-14fd4590-5c5e-4cb2-a20c-bb24d49c696e req-fe80e068-7402-4013-b0c8-7a8702d627e6 service nova] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:16:08.974325 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [req-14fd4590-5c5e-4cb2-a20c-bb24d49c696e req-fe80e068-7402-4013-b0c8-7a8702d627e6 service nova] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:16:08.974739 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [req-14fd4590-5c5e-4cb2-a20c-bb24d49c696e req-fe80e068-7402-4013-b0c8-7a8702d627e6 service nova] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:16:08.986328 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.compute.server_external_events [req-14fd4590-5c5e-4cb2-a20c-bb24d49c696e req-fe80e068-7402-4013-b0c8-7a8702d627e6 service nova] Creating event network-changed:4f3c189e-8afd-49e5-a4c7-60407c13730e for instance 74919866-69a0-460a-999a-b344d1cbc336 on hv-cinder-85409 Aug 23 07:16:08.990877 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [req-14fd4590-5c5e-4cb2-a20c-bb24d49c696e req-fe80e068-7402-4013-b0c8-7a8702d627e6 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029777 Aug 23 07:16:08.991545 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 215/454] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Aug 23 07:16:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 07:16:08.991762 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG dbcounter [-] [120799] Writing DB stats nova_cell0:SELECT=4 {{(pid=120799) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:16:09.073868 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.policy [None req-a9349604-f9a3-44cf-aff3-239c57cce8f4 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '471dc5c1db64411ab1d80ad6c038e519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb44f62fa62e46528712f24479cbb19f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120799) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:16:09.081793 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-a9349604-f9a3-44cf-aff3-239c57cce8f4 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] 10.222.0.17 "GET /compute/v2.1/servers/2276f5b3-e71c-42f5-b540-5535a8aa1d48" status: 200 len: 1365 microversion: 2.1 time: 0.259460 Aug 23 07:16:09.082341 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 240/455] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:16:08 2022] GET /compute/v2.1/servers/2276f5b3-e71c-42f5-b540-5535a8aa1d48 => generated 1365 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:16:09.591033 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-22e0e65f-e1a5-472e-b470-3613db5101a7 tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] Calling method '>' {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:16:09.591701 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.compute.api [None req-22e0e65f-e1a5-472e-b470-3613db5101a7 tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] [instance: 0c761eab-49ac-4396-9907-70845ad75c64] Fetching instance by UUID {{(pid=120798) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:16:09.599324 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-22e0e65f-e1a5-472e-b470-3613db5101a7 tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:16:09.599915 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-22e0e65f-e1a5-472e-b470-3613db5101a7 tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:16:09.600344 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-22e0e65f-e1a5-472e-b470-3613db5101a7 tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:16:09.601029 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-22e0e65f-e1a5-472e-b470-3613db5101a7 tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:16:09.601467 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-22e0e65f-e1a5-472e-b470-3613db5101a7 tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:16:09.601886 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-22e0e65f-e1a5-472e-b470-3613db5101a7 tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:16:09.674433 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-7ebd7935-b41f-41bb-bcb5-59a061824f1f tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Calling method '>' {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:16:09.675079 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.compute.api [None req-7ebd7935-b41f-41bb-bcb5-59a061824f1f tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] [instance: 74919866-69a0-460a-999a-b344d1cbc336] Fetching instance by UUID {{(pid=120799) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:16:09.677384 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG dbcounter [-] [120799] Writing DB stats nova_cell0:SELECT=20 {{(pid=120799) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:16:09.683139 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-7ebd7935-b41f-41bb-bcb5-59a061824f1f tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:16:09.683665 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-7ebd7935-b41f-41bb-bcb5-59a061824f1f tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:16:09.684110 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-7ebd7935-b41f-41bb-bcb5-59a061824f1f tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:16:09.684805 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-7ebd7935-b41f-41bb-bcb5-59a061824f1f tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:16:09.685250 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-7ebd7935-b41f-41bb-bcb5-59a061824f1f tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:16:09.685679 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-7ebd7935-b41f-41bb-bcb5-59a061824f1f tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:16:09.767882 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.policy [None req-22e0e65f-e1a5-472e-b470-3613db5101a7 tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c26232f042844a898c19d1f63152b428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd004facbaed41a7a54a3ed6a6a44305', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120798) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:16:09.776194 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [None req-22e0e65f-e1a5-472e-b470-3613db5101a7 tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] 10.222.0.17 "GET /compute/v2.1/servers/0c761eab-49ac-4396-9907-70845ad75c64" status: 200 len: 1258 microversion: 2.1 time: 0.193030 Aug 23 07:16:09.776793 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 216/456] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:16:09 2022] GET /compute/v2.1/servers/0c761eab-49ac-4396-9907-70845ad75c64 => generated 1258 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:16:09.837097 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.policy [None req-7ebd7935-b41f-41bb-bcb5-59a061824f1f tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffd12f09606b4e6ba12f63b976df1884', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43b271d00f74eb7aa3d0719315c5a99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120799) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:16:09.845363 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-7ebd7935-b41f-41bb-bcb5-59a061824f1f tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] 10.222.0.17 "GET /compute/v2.1/servers/74919866-69a0-460a-999a-b344d1cbc336" status: 200 len: 1278 microversion: 2.1 time: 0.174796 Aug 23 07:16:09.845895 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 241/457] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:16:09 2022] GET /compute/v2.1/servers/74919866-69a0-460a-999a-b344d1cbc336 => generated 1278 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:16:09.982371 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-45518804-48aa-4866-9f86-e0137caa0ac9 tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] Calling method '>' {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:16:09.982971 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.compute.api [None req-45518804-48aa-4866-9f86-e0137caa0ac9 tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] [instance: f7783f88-5770-4ca3-a5cf-294f044d21a8] Fetching instance by UUID {{(pid=120798) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:16:09.991652 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-45518804-48aa-4866-9f86-e0137caa0ac9 tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:16:09.992131 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-45518804-48aa-4866-9f86-e0137caa0ac9 tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:16:09.992563 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-45518804-48aa-4866-9f86-e0137caa0ac9 tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:16:09.993248 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-45518804-48aa-4866-9f86-e0137caa0ac9 tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:16:09.993697 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-45518804-48aa-4866-9f86-e0137caa0ac9 tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:16:09.994119 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-45518804-48aa-4866-9f86-e0137caa0ac9 tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:16:10.104651 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-1a4a8ddb-6064-4551-844c-1e0507bc4cc0 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Calling method '>' {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:16:10.105245 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.compute.api [None req-1a4a8ddb-6064-4551-844c-1e0507bc4cc0 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] [instance: 2276f5b3-e71c-42f5-b540-5535a8aa1d48] Fetching instance by UUID {{(pid=120799) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:16:10.112485 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-1a4a8ddb-6064-4551-844c-1e0507bc4cc0 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:16:10.112978 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-1a4a8ddb-6064-4551-844c-1e0507bc4cc0 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:16:10.113441 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-1a4a8ddb-6064-4551-844c-1e0507bc4cc0 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:16:10.114143 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-1a4a8ddb-6064-4551-844c-1e0507bc4cc0 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:16:10.114557 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-1a4a8ddb-6064-4551-844c-1e0507bc4cc0 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:16:10.115196 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-1a4a8ddb-6064-4551-844c-1e0507bc4cc0 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:16:10.217466 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.policy [None req-45518804-48aa-4866-9f86-e0137caa0ac9 tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5e8c33634b246319de495d269c05124', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9466597900d4a3ca60a2ef8b7678c87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120798) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:16:10.228143 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [None req-45518804-48aa-4866-9f86-e0137caa0ac9 tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] 10.222.0.17 "GET /compute/v2.1/servers/f7783f88-5770-4ca3-a5cf-294f044d21a8" status: 200 len: 1358 microversion: 2.1 time: 0.250658 Aug 23 07:16:10.228737 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 217/458] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:16:09 2022] GET /compute/v2.1/servers/f7783f88-5770-4ca3-a5cf-294f044d21a8 => generated 1358 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 07:16:10.322223 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.policy [None req-1a4a8ddb-6064-4551-844c-1e0507bc4cc0 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '471dc5c1db64411ab1d80ad6c038e519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb44f62fa62e46528712f24479cbb19f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120799) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:16:10.331777 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-1a4a8ddb-6064-4551-844c-1e0507bc4cc0 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] 10.222.0.17 "GET /compute/v2.1/servers/2276f5b3-e71c-42f5-b540-5535a8aa1d48" status: 200 len: 1365 microversion: 2.1 time: 0.231445 Aug 23 07:16:10.332397 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 242/459] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:16:10 2022] GET /compute/v2.1/servers/2276f5b3-e71c-42f5-b540-5535a8aa1d48 => generated 1365 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:16:10.802154 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-67237b6e-da14-4188-b80b-1a11cf4ad92a tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] Calling method '>' {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:16:10.803161 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.compute.api [None req-67237b6e-da14-4188-b80b-1a11cf4ad92a tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] [instance: 0c761eab-49ac-4396-9907-70845ad75c64] Fetching instance by UUID {{(pid=120798) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:16:10.811675 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-67237b6e-da14-4188-b80b-1a11cf4ad92a tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:16:10.812160 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-67237b6e-da14-4188-b80b-1a11cf4ad92a tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:16:10.812588 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-67237b6e-da14-4188-b80b-1a11cf4ad92a tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:16:10.813288 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-67237b6e-da14-4188-b80b-1a11cf4ad92a tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:16:10.813718 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-67237b6e-da14-4188-b80b-1a11cf4ad92a tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:16:10.814127 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-67237b6e-da14-4188-b80b-1a11cf4ad92a tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:16:10.866346 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-8c08dbe6-b55d-449d-96ce-8bbb9fe618c5 tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Calling method '>' {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:16:10.870070 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.compute.api [None req-8c08dbe6-b55d-449d-96ce-8bbb9fe618c5 tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] [instance: 74919866-69a0-460a-999a-b344d1cbc336] Fetching instance by UUID {{(pid=120799) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:16:10.879001 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-8c08dbe6-b55d-449d-96ce-8bbb9fe618c5 tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:16:10.879859 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-8c08dbe6-b55d-449d-96ce-8bbb9fe618c5 tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:16:10.880300 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-8c08dbe6-b55d-449d-96ce-8bbb9fe618c5 tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:16:10.883775 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-8c08dbe6-b55d-449d-96ce-8bbb9fe618c5 tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:16:10.884514 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-8c08dbe6-b55d-449d-96ce-8bbb9fe618c5 tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:16:10.884946 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-8c08dbe6-b55d-449d-96ce-8bbb9fe618c5 tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:16:11.114338 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.policy [None req-67237b6e-da14-4188-b80b-1a11cf4ad92a tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c26232f042844a898c19d1f63152b428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd004facbaed41a7a54a3ed6a6a44305', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120798) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:16:11.119157 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.policy [None req-8c08dbe6-b55d-449d-96ce-8bbb9fe618c5 tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffd12f09606b4e6ba12f63b976df1884', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43b271d00f74eb7aa3d0719315c5a99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120799) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:16:11.124707 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [None req-67237b6e-da14-4188-b80b-1a11cf4ad92a tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] 10.222.0.17 "GET /compute/v2.1/servers/0c761eab-49ac-4396-9907-70845ad75c64" status: 200 len: 1258 microversion: 2.1 time: 0.328535 Aug 23 07:16:11.125597 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 218/460] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:16:10 2022] GET /compute/v2.1/servers/0c761eab-49ac-4396-9907-70845ad75c64 => generated 1258 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:16:11.129253 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-8c08dbe6-b55d-449d-96ce-8bbb9fe618c5 tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] 10.222.0.17 "GET /compute/v2.1/servers/74919866-69a0-460a-999a-b344d1cbc336" status: 200 len: 1278 microversion: 2.1 time: 0.266834 Aug 23 07:16:11.129970 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 243/461] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:16:10 2022] GET /compute/v2.1/servers/74919866-69a0-460a-999a-b344d1cbc336 => generated 1278 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:16:11.250429 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-9e47b451-1654-481d-898e-13b9dbb8a9c3 tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] Calling method '>' {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:16:11.251026 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.compute.api [None req-9e47b451-1654-481d-898e-13b9dbb8a9c3 tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] [instance: f7783f88-5770-4ca3-a5cf-294f044d21a8] Fetching instance by UUID {{(pid=120798) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:16:11.257524 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-9e47b451-1654-481d-898e-13b9dbb8a9c3 tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:16:11.258025 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-9e47b451-1654-481d-898e-13b9dbb8a9c3 tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:16:11.258445 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-9e47b451-1654-481d-898e-13b9dbb8a9c3 tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:16:11.259129 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-9e47b451-1654-481d-898e-13b9dbb8a9c3 tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:16:11.259599 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-9e47b451-1654-481d-898e-13b9dbb8a9c3 tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:16:11.260021 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-9e47b451-1654-481d-898e-13b9dbb8a9c3 tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:16:11.352807 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-6f624e27-40d3-4245-8b13-9d7752a16c9c tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Calling method '>' {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:16:11.353513 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.compute.api [None req-6f624e27-40d3-4245-8b13-9d7752a16c9c tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] [instance: 2276f5b3-e71c-42f5-b540-5535a8aa1d48] Fetching instance by UUID {{(pid=120799) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:16:11.362684 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-6f624e27-40d3-4245-8b13-9d7752a16c9c tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:16:11.363264 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-6f624e27-40d3-4245-8b13-9d7752a16c9c tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:16:11.363779 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-6f624e27-40d3-4245-8b13-9d7752a16c9c tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:16:11.364558 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-6f624e27-40d3-4245-8b13-9d7752a16c9c tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:16:11.365058 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-6f624e27-40d3-4245-8b13-9d7752a16c9c tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:16:11.365747 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-6f624e27-40d3-4245-8b13-9d7752a16c9c tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:16:11.474154 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.policy [None req-9e47b451-1654-481d-898e-13b9dbb8a9c3 tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5e8c33634b246319de495d269c05124', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9466597900d4a3ca60a2ef8b7678c87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120798) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:16:11.482690 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [None req-9e47b451-1654-481d-898e-13b9dbb8a9c3 tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] 10.222.0.17 "GET /compute/v2.1/servers/f7783f88-5770-4ca3-a5cf-294f044d21a8" status: 200 len: 1358 microversion: 2.1 time: 0.236415 Aug 23 07:16:11.483332 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 219/462] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:16:11 2022] GET /compute/v2.1/servers/f7783f88-5770-4ca3-a5cf-294f044d21a8 => generated 1358 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:16:11.531141 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.policy [None req-6f624e27-40d3-4245-8b13-9d7752a16c9c tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '471dc5c1db64411ab1d80ad6c038e519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb44f62fa62e46528712f24479cbb19f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120799) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:16:11.542978 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-6f624e27-40d3-4245-8b13-9d7752a16c9c tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] 10.222.0.17 "GET /compute/v2.1/servers/2276f5b3-e71c-42f5-b540-5535a8aa1d48" status: 200 len: 1365 microversion: 2.1 time: 0.194149 Aug 23 07:16:11.543983 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 244/463] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:16:11 2022] GET /compute/v2.1/servers/2276f5b3-e71c-42f5-b540-5535a8aa1d48 => generated 1365 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:16:12.148566 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-f07badfc-da21-487b-bf49-6658c16f705f tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] Calling method '>' {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:16:12.149323 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.compute.api [None req-f07badfc-da21-487b-bf49-6658c16f705f tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] [instance: 0c761eab-49ac-4396-9907-70845ad75c64] Fetching instance by UUID {{(pid=120798) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:16:12.151077 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-2b328a46-9d79-4f78-bed9-5a834736d0a8 tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Calling method '>' {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:16:12.151817 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.compute.api [None req-2b328a46-9d79-4f78-bed9-5a834736d0a8 tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] [instance: 74919866-69a0-460a-999a-b344d1cbc336] Fetching instance by UUID {{(pid=120799) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:16:12.157168 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-f07badfc-da21-487b-bf49-6658c16f705f tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:16:12.157932 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-f07badfc-da21-487b-bf49-6658c16f705f tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:16:12.158346 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-f07badfc-da21-487b-bf49-6658c16f705f tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:16:12.158902 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-2b328a46-9d79-4f78-bed9-5a834736d0a8 tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:16:12.159209 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-f07badfc-da21-487b-bf49-6658c16f705f tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:16:12.159347 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-2b328a46-9d79-4f78-bed9-5a834736d0a8 tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:16:12.159679 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-f07badfc-da21-487b-bf49-6658c16f705f tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:16:12.160117 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-f07badfc-da21-487b-bf49-6658c16f705f tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:16:12.160228 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-2b328a46-9d79-4f78-bed9-5a834736d0a8 tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:16:12.160892 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-2b328a46-9d79-4f78-bed9-5a834736d0a8 tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:16:12.161313 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-2b328a46-9d79-4f78-bed9-5a834736d0a8 tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:16:12.161904 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-2b328a46-9d79-4f78-bed9-5a834736d0a8 tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:16:12.377265 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.policy [None req-f07badfc-da21-487b-bf49-6658c16f705f tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c26232f042844a898c19d1f63152b428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd004facbaed41a7a54a3ed6a6a44305', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120798) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:16:12.380708 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.policy [None req-2b328a46-9d79-4f78-bed9-5a834736d0a8 tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffd12f09606b4e6ba12f63b976df1884', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43b271d00f74eb7aa3d0719315c5a99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120799) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:16:12.385300 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [None req-f07badfc-da21-487b-bf49-6658c16f705f tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] 10.222.0.17 "GET /compute/v2.1/servers/0c761eab-49ac-4396-9907-70845ad75c64" status: 200 len: 1258 microversion: 2.1 time: 0.242886 Aug 23 07:16:12.385885 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 220/464] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:16:12 2022] GET /compute/v2.1/servers/0c761eab-49ac-4396-9907-70845ad75c64 => generated 1258 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:16:12.389511 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-2b328a46-9d79-4f78-bed9-5a834736d0a8 tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] 10.222.0.17 "GET /compute/v2.1/servers/74919866-69a0-460a-999a-b344d1cbc336" status: 200 len: 1278 microversion: 2.1 time: 0.243104 Aug 23 07:16:12.390160 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 245/465] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:16:12 2022] GET /compute/v2.1/servers/74919866-69a0-460a-999a-b344d1cbc336 => generated 1278 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:16:12.390406 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [req-417b86e9-ce6b-4f0e-85ad-9da0f5261397 req-abd49f9f-a2f8-4590-b193-69584803f101 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2276f5b3-e71c-42f5-b540-5535a8aa1d48", "name": "network-vif-plugged", "status": "completed", "tag": "be3c90aa-cba5-4245-be28-bf2257dc5817"}]} {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 07:16:12.400195 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [req-417b86e9-ce6b-4f0e-85ad-9da0f5261397 req-abd49f9f-a2f8-4590-b193-69584803f101 service nova] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:16:12.400657 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [req-417b86e9-ce6b-4f0e-85ad-9da0f5261397 req-abd49f9f-a2f8-4590-b193-69584803f101 service nova] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:16:12.401071 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [req-417b86e9-ce6b-4f0e-85ad-9da0f5261397 req-abd49f9f-a2f8-4590-b193-69584803f101 service nova] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:16:12.412258 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.compute.server_external_events [req-417b86e9-ce6b-4f0e-85ad-9da0f5261397 req-abd49f9f-a2f8-4590-b193-69584803f101 service nova] Creating event network-vif-plugged:be3c90aa-cba5-4245-be28-bf2257dc5817 for instance 2276f5b3-e71c-42f5-b540-5535a8aa1d48 on hv-cinder-85409 Aug 23 07:16:12.417832 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [req-417b86e9-ce6b-4f0e-85ad-9da0f5261397 req-abd49f9f-a2f8-4590-b193-69584803f101 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030476 Aug 23 07:16:12.418688 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 221/466] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Aug 23 07:16:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 07:16:12.507157 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-c161f736-af5a-44cf-8e2b-01256ec23145 tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] Calling method '>' {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:16:12.508240 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.compute.api [None req-c161f736-af5a-44cf-8e2b-01256ec23145 tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] [instance: f7783f88-5770-4ca3-a5cf-294f044d21a8] Fetching instance by UUID {{(pid=120799) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:16:12.516505 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-c161f736-af5a-44cf-8e2b-01256ec23145 tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:16:12.517000 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-c161f736-af5a-44cf-8e2b-01256ec23145 tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:16:12.517429 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-c161f736-af5a-44cf-8e2b-01256ec23145 tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:16:12.518132 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-c161f736-af5a-44cf-8e2b-01256ec23145 tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:16:12.518578 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-c161f736-af5a-44cf-8e2b-01256ec23145 tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:16:12.518995 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-c161f736-af5a-44cf-8e2b-01256ec23145 tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:16:12.571125 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-988fb82c-6396-4b82-9946-b8bf512b0e09 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Calling method '>' {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:16:12.572415 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.compute.api [None req-988fb82c-6396-4b82-9946-b8bf512b0e09 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] [instance: 2276f5b3-e71c-42f5-b540-5535a8aa1d48] Fetching instance by UUID {{(pid=120798) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:16:12.589589 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-988fb82c-6396-4b82-9946-b8bf512b0e09 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:16:12.590362 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-988fb82c-6396-4b82-9946-b8bf512b0e09 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:16:12.591881 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-988fb82c-6396-4b82-9946-b8bf512b0e09 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:16:12.592896 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-988fb82c-6396-4b82-9946-b8bf512b0e09 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:16:12.593565 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-988fb82c-6396-4b82-9946-b8bf512b0e09 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:16:12.595448 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-988fb82c-6396-4b82-9946-b8bf512b0e09 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:16:12.822129 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.policy [None req-c161f736-af5a-44cf-8e2b-01256ec23145 tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5e8c33634b246319de495d269c05124', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9466597900d4a3ca60a2ef8b7678c87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120799) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:16:12.830414 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-c161f736-af5a-44cf-8e2b-01256ec23145 tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] 10.222.0.17 "GET /compute/v2.1/servers/f7783f88-5770-4ca3-a5cf-294f044d21a8" status: 200 len: 1548 microversion: 2.1 time: 0.330197 Aug 23 07:16:12.830990 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 246/467] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:16:12 2022] GET /compute/v2.1/servers/f7783f88-5770-4ca3-a5cf-294f044d21a8 => generated 1548 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:16:12.836852 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-9560c881-7ca6-4e6b-891f-9a44ee6cf900 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 07:16:12.839313 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.compute.api [None req-9560c881-7ca6-4e6b-891f-9a44ee6cf900 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] [instance: b9418fe6-a57e-4a99-becb-19a4d3a52da1] Fetching instance by UUID {{(pid=120799) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:16:12.847352 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-9560c881-7ca6-4e6b-891f-9a44ee6cf900 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:16:12.847943 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-9560c881-7ca6-4e6b-891f-9a44ee6cf900 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:16:12.848405 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-9560c881-7ca6-4e6b-891f-9a44ee6cf900 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:16:12.849099 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-9560c881-7ca6-4e6b-891f-9a44ee6cf900 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:16:12.849539 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-9560c881-7ca6-4e6b-891f-9a44ee6cf900 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:16:12.849944 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-9560c881-7ca6-4e6b-891f-9a44ee6cf900 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:16:12.874890 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.objects.instance [None req-9560c881-7ca6-4e6b-891f-9a44ee6cf900 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lazy-loading 'flavor' on Instance uuid b9418fe6-a57e-4a99-becb-19a4d3a52da1 {{(pid=120799) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 07:16:12.928813 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.policy [None req-988fb82c-6396-4b82-9946-b8bf512b0e09 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '471dc5c1db64411ab1d80ad6c038e519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb44f62fa62e46528712f24479cbb19f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120798) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:16:12.938855 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [None req-988fb82c-6396-4b82-9946-b8bf512b0e09 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] 10.222.0.17 "GET /compute/v2.1/servers/2276f5b3-e71c-42f5-b540-5535a8aa1d48" status: 200 len: 1365 microversion: 2.1 time: 0.373606 Aug 23 07:16:12.952674 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 222/468] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:16:12 2022] GET /compute/v2.1/servers/2276f5b3-e71c-42f5-b540-5535a8aa1d48 => generated 1365 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 07:16:12.957538 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-467b3e9a-5b59-4711-8bbb-c9fa29627aeb tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] Calling method '>' {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:16:12.958166 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.compute.api [None req-467b3e9a-5b59-4711-8bbb-c9fa29627aeb tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] [instance: f7783f88-5770-4ca3-a5cf-294f044d21a8] Fetching instance by UUID {{(pid=120798) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:16:12.964965 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-467b3e9a-5b59-4711-8bbb-c9fa29627aeb tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:16:12.965533 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-467b3e9a-5b59-4711-8bbb-c9fa29627aeb tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:16:12.965986 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-467b3e9a-5b59-4711-8bbb-c9fa29627aeb tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:16:12.966692 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-467b3e9a-5b59-4711-8bbb-c9fa29627aeb tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:16:12.967146 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-467b3e9a-5b59-4711-8bbb-c9fa29627aeb tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:16:12.967620 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-467b3e9a-5b59-4711-8bbb-c9fa29627aeb tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:16:13.067652 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-9560c881-7ca6-4e6b-891f-9a44ee6cf900 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] 10.222.0.17 "POST /compute/v2.1/servers/b9418fe6-a57e-4a99-becb-19a4d3a52da1/action" status: 200 len: 32 microversion: 2.1 time: 0.235098 Aug 23 07:16:13.068489 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 247/469] 10.222.0.17 () {60 vars in 1278 bytes} [Tue Aug 23 07:16:12 2022] POST /compute/v2.1/servers/b9418fe6-a57e-4a99-becb-19a4d3a52da1/action => generated 32 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 23 07:16:13.077995 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-8eb8b070-8468-44b7-b22a-67baa774b818 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Calling method '>' {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:16:13.078682 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.compute.api [None req-8eb8b070-8468-44b7-b22a-67baa774b818 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] [instance: b9418fe6-a57e-4a99-becb-19a4d3a52da1] Fetching instance by UUID {{(pid=120799) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:16:13.085061 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-8eb8b070-8468-44b7-b22a-67baa774b818 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:16:13.085566 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-8eb8b070-8468-44b7-b22a-67baa774b818 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:16:13.085995 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-8eb8b070-8468-44b7-b22a-67baa774b818 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:16:13.086646 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-8eb8b070-8468-44b7-b22a-67baa774b818 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:16:13.087090 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-8eb8b070-8468-44b7-b22a-67baa774b818 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:16:13.087537 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-8eb8b070-8468-44b7-b22a-67baa774b818 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:16:13.107975 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.policy [None req-467b3e9a-5b59-4711-8bbb-c9fa29627aeb tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5e8c33634b246319de495d269c05124', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9466597900d4a3ca60a2ef8b7678c87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120798) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:16:13.115924 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [None req-467b3e9a-5b59-4711-8bbb-c9fa29627aeb tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] 10.222.0.17 "GET /compute/v2.1/servers/f7783f88-5770-4ca3-a5cf-294f044d21a8" status: 200 len: 1548 microversion: 2.1 time: 0.162122 Aug 23 07:16:13.116717 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 223/470] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:16:12 2022] GET /compute/v2.1/servers/f7783f88-5770-4ca3-a5cf-294f044d21a8 => generated 1548 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:16:13.135514 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-ff655159-8988-4199-8e45-2b744ea178c8 tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] Calling method '>' {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:16:13.140525 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.policy [None req-ff655159-8988-4199-8e45-2b744ea178c8 tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'a5e8c33634b246319de495d269c05124', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9466597900d4a3ca60a2ef8b7678c87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120798) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:16:13.141272 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.compute.api [None req-ff655159-8988-4199-8e45-2b744ea178c8 tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] Searching by: {'deleted': False, 'project_id': 'f9466597900d4a3ca60a2ef8b7678c87'} {{(pid=120798) get_all /opt/stack/nova/nova/compute/api.py:3004}} Aug 23 07:16:13.149127 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-ff655159-8988-4199-8e45-2b744ea178c8 tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:16:13.149779 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-ff655159-8988-4199-8e45-2b744ea178c8 tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:16:13.150004 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-ff655159-8988-4199-8e45-2b744ea178c8 tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:16:13.150713 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-ff655159-8988-4199-8e45-2b744ea178c8 tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:16:13.151142 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-ff655159-8988-4199-8e45-2b744ea178c8 tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:16:13.151605 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-ff655159-8988-4199-8e45-2b744ea178c8 tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:16:13.252552 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.compute.multi_cell_list [None req-ff655159-8988-4199-8e45-2b744ea178c8 tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120798) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 23 07:16:13.253461 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.policy [None req-8eb8b070-8468-44b7-b22a-67baa774b818 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64d54cb95b264c18b45d90822507fae1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135367be6e3f4b3d965ee0d99fdca524', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120799) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:16:13.264290 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-8eb8b070-8468-44b7-b22a-67baa774b818 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] 10.222.0.17 "GET /compute/v2.1/servers/b9418fe6-a57e-4a99-becb-19a4d3a52da1" status: 200 len: 1736 microversion: 2.1 time: 0.189297 Aug 23 07:16:13.268998 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 248/471] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:16:13 2022] GET /compute/v2.1/servers/b9418fe6-a57e-4a99-becb-19a4d3a52da1 => generated 1736 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:16:13.366077 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [None req-ff655159-8988-4199-8e45-2b744ea178c8 tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] 10.222.0.17 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.234273 Aug 23 07:16:13.367342 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 224/472] 10.222.0.17 () {58 vars in 1125 bytes} [Tue Aug 23 07:16:13 2022] GET /compute/v2.1/servers => generated 343 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 07:16:13.379392 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-74a611ab-59a6-4240-a1be-711dcb8add34 tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] Calling method '>' {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:16:13.380297 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.compute.api [None req-74a611ab-59a6-4240-a1be-711dcb8add34 tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] [instance: f7783f88-5770-4ca3-a5cf-294f044d21a8] Fetching instance by UUID {{(pid=120799) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:16:13.386708 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-74a611ab-59a6-4240-a1be-711dcb8add34 tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:16:13.387178 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-74a611ab-59a6-4240-a1be-711dcb8add34 tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:16:13.388202 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-74a611ab-59a6-4240-a1be-711dcb8add34 tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:16:13.388996 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-74a611ab-59a6-4240-a1be-711dcb8add34 tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:16:13.389612 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-74a611ab-59a6-4240-a1be-711dcb8add34 tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:16:13.390028 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-74a611ab-59a6-4240-a1be-711dcb8add34 tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:16:13.406427 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-54ae76fa-81af-44e3-b3aa-ba5774302271 tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] Calling method '>' {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:16:13.407045 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.compute.api [None req-54ae76fa-81af-44e3-b3aa-ba5774302271 tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] [instance: 0c761eab-49ac-4396-9907-70845ad75c64] Fetching instance by UUID {{(pid=120798) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:16:13.413177 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-54ae76fa-81af-44e3-b3aa-ba5774302271 tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:16:13.413649 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-54ae76fa-81af-44e3-b3aa-ba5774302271 tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:16:13.414071 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-54ae76fa-81af-44e3-b3aa-ba5774302271 tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:16:13.414754 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-54ae76fa-81af-44e3-b3aa-ba5774302271 tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:16:13.415199 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-54ae76fa-81af-44e3-b3aa-ba5774302271 tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:16:13.415640 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-54ae76fa-81af-44e3-b3aa-ba5774302271 tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:16:13.420191 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG dbcounter [-] [120798] Writing DB stats nova_cell1:UPDATE=1,nova_cell1:SELECT=98,nova_cell1:INSERT=1 {{(pid=120798) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:16:13.617688 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.policy [None req-74a611ab-59a6-4240-a1be-711dcb8add34 tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5e8c33634b246319de495d269c05124', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9466597900d4a3ca60a2ef8b7678c87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120799) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:16:13.626114 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-74a611ab-59a6-4240-a1be-711dcb8add34 tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] 10.222.0.17 "GET /compute/v2.1/servers/f7783f88-5770-4ca3-a5cf-294f044d21a8" status: 200 len: 1548 microversion: 2.1 time: 0.251308 Aug 23 07:16:13.626700 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 249/473] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:16:13 2022] GET /compute/v2.1/servers/f7783f88-5770-4ca3-a5cf-294f044d21a8 => generated 1548 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:16:13.631522 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.policy [None req-54ae76fa-81af-44e3-b3aa-ba5774302271 tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c26232f042844a898c19d1f63152b428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd004facbaed41a7a54a3ed6a6a44305', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120798) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:16:13.631655 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-f1c0e7a5-e03e-4d97-9779-caaa4304b99e tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Calling method '>' {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:16:13.631851 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.compute.api [None req-f1c0e7a5-e03e-4d97-9779-caaa4304b99e tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] [instance: 74919866-69a0-460a-999a-b344d1cbc336] Fetching instance by UUID {{(pid=120799) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:16:13.635474 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [None req-54ae76fa-81af-44e3-b3aa-ba5774302271 tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] 10.222.0.17 "GET /compute/v2.1/servers/0c761eab-49ac-4396-9907-70845ad75c64" status: 200 len: 1258 microversion: 2.1 time: 0.233223 Aug 23 07:16:13.636118 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 225/474] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:16:13 2022] GET /compute/v2.1/servers/0c761eab-49ac-4396-9907-70845ad75c64 => generated 1258 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 07:16:13.643160 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-f1c0e7a5-e03e-4d97-9779-caaa4304b99e tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:16:13.643761 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-f1c0e7a5-e03e-4d97-9779-caaa4304b99e tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:16:13.644292 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-f1c0e7a5-e03e-4d97-9779-caaa4304b99e tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:16:13.646425 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-f1c0e7a5-e03e-4d97-9779-caaa4304b99e tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:16:13.646975 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-f1c0e7a5-e03e-4d97-9779-caaa4304b99e tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:16:13.648447 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-f1c0e7a5-e03e-4d97-9779-caaa4304b99e tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:16:13.786773 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.policy [None req-f1c0e7a5-e03e-4d97-9779-caaa4304b99e tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffd12f09606b4e6ba12f63b976df1884', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43b271d00f74eb7aa3d0719315c5a99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120799) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:16:13.794734 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-f1c0e7a5-e03e-4d97-9779-caaa4304b99e tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] 10.222.0.17 "GET /compute/v2.1/servers/74919866-69a0-460a-999a-b344d1cbc336" status: 200 len: 1266 microversion: 2.1 time: 0.167061 Aug 23 07:16:13.795298 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 250/475] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:16:13 2022] GET /compute/v2.1/servers/74919866-69a0-460a-999a-b344d1cbc336 => generated 1266 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:16:13.960702 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-686c524d-0159-4e8d-9e53-6b2a5c98e361 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Calling method '>' {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:16:13.961336 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.compute.api [None req-686c524d-0159-4e8d-9e53-6b2a5c98e361 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] [instance: 2276f5b3-e71c-42f5-b540-5535a8aa1d48] Fetching instance by UUID {{(pid=120798) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:16:13.968217 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-686c524d-0159-4e8d-9e53-6b2a5c98e361 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:16:13.968652 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-686c524d-0159-4e8d-9e53-6b2a5c98e361 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:16:13.969108 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-686c524d-0159-4e8d-9e53-6b2a5c98e361 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:16:13.969832 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-686c524d-0159-4e8d-9e53-6b2a5c98e361 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:16:13.970264 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-686c524d-0159-4e8d-9e53-6b2a5c98e361 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:16:13.970717 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-686c524d-0159-4e8d-9e53-6b2a5c98e361 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:16:14.160291 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.policy [None req-686c524d-0159-4e8d-9e53-6b2a5c98e361 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '471dc5c1db64411ab1d80ad6c038e519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb44f62fa62e46528712f24479cbb19f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120798) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:16:14.168194 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [None req-686c524d-0159-4e8d-9e53-6b2a5c98e361 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] 10.222.0.17 "GET /compute/v2.1/servers/2276f5b3-e71c-42f5-b540-5535a8aa1d48" status: 200 len: 1365 microversion: 2.1 time: 0.212164 Aug 23 07:16:14.168822 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 226/476] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:16:13 2022] GET /compute/v2.1/servers/2276f5b3-e71c-42f5-b540-5535a8aa1d48 => generated 1365 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:16:14.289526 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-416468c0-a37d-4821-a784-a027ba930ec1 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Calling method '>' {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:16:14.290132 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.compute.api [None req-416468c0-a37d-4821-a784-a027ba930ec1 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] [instance: b9418fe6-a57e-4a99-becb-19a4d3a52da1] Fetching instance by UUID {{(pid=120799) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:16:14.297541 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-416468c0-a37d-4821-a784-a027ba930ec1 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:16:14.298011 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-416468c0-a37d-4821-a784-a027ba930ec1 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:16:14.298436 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-416468c0-a37d-4821-a784-a027ba930ec1 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:16:14.299110 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-416468c0-a37d-4821-a784-a027ba930ec1 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:16:14.299576 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-416468c0-a37d-4821-a784-a027ba930ec1 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:16:14.299987 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-416468c0-a37d-4821-a784-a027ba930ec1 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:16:14.304253 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG dbcounter [-] [120799] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120799) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:16:14.430893 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.policy [None req-416468c0-a37d-4821-a784-a027ba930ec1 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64d54cb95b264c18b45d90822507fae1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135367be6e3f4b3d965ee0d99fdca524', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120799) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:16:14.439055 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-416468c0-a37d-4821-a784-a027ba930ec1 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] 10.222.0.17 "GET /compute/v2.1/servers/b9418fe6-a57e-4a99-becb-19a4d3a52da1" status: 200 len: 1736 microversion: 2.1 time: 0.153522 Aug 23 07:16:14.439635 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 251/477] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:16:14 2022] GET /compute/v2.1/servers/b9418fe6-a57e-4a99-becb-19a4d3a52da1 => generated 1736 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:16:14.657967 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-718879cb-acb9-419f-ba66-e9fdf29cd581 tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] Calling method '>' {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:16:14.658945 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.compute.api [None req-718879cb-acb9-419f-ba66-e9fdf29cd581 tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] [instance: 0c761eab-49ac-4396-9907-70845ad75c64] Fetching instance by UUID {{(pid=120798) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:16:14.665160 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-718879cb-acb9-419f-ba66-e9fdf29cd581 tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:16:14.665735 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-718879cb-acb9-419f-ba66-e9fdf29cd581 tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:16:14.666230 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-718879cb-acb9-419f-ba66-e9fdf29cd581 tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:16:14.667021 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-718879cb-acb9-419f-ba66-e9fdf29cd581 tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:16:14.667553 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-718879cb-acb9-419f-ba66-e9fdf29cd581 tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:16:14.668084 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-718879cb-acb9-419f-ba66-e9fdf29cd581 tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:16:14.816737 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-d67afcae-e8c4-4261-bb9d-21a484d2cc92 tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Calling method '>' {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:16:14.817516 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.compute.api [None req-d67afcae-e8c4-4261-bb9d-21a484d2cc92 tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] [instance: 74919866-69a0-460a-999a-b344d1cbc336] Fetching instance by UUID {{(pid=120799) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:16:14.824327 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-d67afcae-e8c4-4261-bb9d-21a484d2cc92 tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:16:14.825047 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-d67afcae-e8c4-4261-bb9d-21a484d2cc92 tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:16:14.825573 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-d67afcae-e8c4-4261-bb9d-21a484d2cc92 tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:16:14.826397 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-d67afcae-e8c4-4261-bb9d-21a484d2cc92 tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:16:14.826918 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-d67afcae-e8c4-4261-bb9d-21a484d2cc92 tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:16:14.827602 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-d67afcae-e8c4-4261-bb9d-21a484d2cc92 tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:16:14.897032 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.policy [None req-718879cb-acb9-419f-ba66-e9fdf29cd581 tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c26232f042844a898c19d1f63152b428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd004facbaed41a7a54a3ed6a6a44305', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120798) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:16:14.906037 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [None req-718879cb-acb9-419f-ba66-e9fdf29cd581 tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] 10.222.0.17 "GET /compute/v2.1/servers/0c761eab-49ac-4396-9907-70845ad75c64" status: 200 len: 1258 microversion: 2.1 time: 0.253770 Aug 23 07:16:14.906616 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 227/478] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:16:14 2022] GET /compute/v2.1/servers/0c761eab-49ac-4396-9907-70845ad75c64 => generated 1258 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:16:14.996145 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.policy [None req-d67afcae-e8c4-4261-bb9d-21a484d2cc92 tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffd12f09606b4e6ba12f63b976df1884', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43b271d00f74eb7aa3d0719315c5a99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120799) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:16:15.009704 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-d67afcae-e8c4-4261-bb9d-21a484d2cc92 tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] 10.222.0.17 "GET /compute/v2.1/servers/74919866-69a0-460a-999a-b344d1cbc336" status: 200 len: 1266 microversion: 2.1 time: 0.191287 Aug 23 07:16:15.009704 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 252/479] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:16:14 2022] GET /compute/v2.1/servers/74919866-69a0-460a-999a-b344d1cbc336 => generated 1266 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:16:15.190316 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-f7350f66-d474-4fbe-a502-0e9ac61c109c tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Calling method '>' {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:16:15.190954 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.compute.api [None req-f7350f66-d474-4fbe-a502-0e9ac61c109c tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] [instance: 2276f5b3-e71c-42f5-b540-5535a8aa1d48] Fetching instance by UUID {{(pid=120798) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:16:15.191955 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-30e0b8fb-1d5e-49af-b419-49e84175ee57 tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a0f9f5e2-9af5-45c4-b20b-c692a2eb6e2d"}} {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 07:16:15.194337 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.compute.api [None req-30e0b8fb-1d5e-49af-b419-49e84175ee57 tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] [instance: f7783f88-5770-4ca3-a5cf-294f044d21a8] Fetching instance by UUID {{(pid=120799) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:16:15.197838 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-f7350f66-d474-4fbe-a502-0e9ac61c109c tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:16:15.198352 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-f7350f66-d474-4fbe-a502-0e9ac61c109c tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:16:15.198780 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-f7350f66-d474-4fbe-a502-0e9ac61c109c tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:16:15.199511 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-f7350f66-d474-4fbe-a502-0e9ac61c109c tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:16:15.199942 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-f7350f66-d474-4fbe-a502-0e9ac61c109c tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:16:15.200360 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-f7350f66-d474-4fbe-a502-0e9ac61c109c tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:16:15.200462 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-30e0b8fb-1d5e-49af-b419-49e84175ee57 tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:16:15.200948 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-30e0b8fb-1d5e-49af-b419-49e84175ee57 tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:16:15.201370 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-30e0b8fb-1d5e-49af-b419-49e84175ee57 tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:16:15.202038 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-30e0b8fb-1d5e-49af-b419-49e84175ee57 tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:16:15.202472 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-30e0b8fb-1d5e-49af-b419-49e84175ee57 tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:16:15.202882 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-30e0b8fb-1d5e-49af-b419-49e84175ee57 tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:16:15.337173 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.policy [None req-f7350f66-d474-4fbe-a502-0e9ac61c109c tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '471dc5c1db64411ab1d80ad6c038e519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb44f62fa62e46528712f24479cbb19f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120798) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:16:15.346227 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [None req-f7350f66-d474-4fbe-a502-0e9ac61c109c tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] 10.222.0.17 "GET /compute/v2.1/servers/2276f5b3-e71c-42f5-b540-5535a8aa1d48" status: 200 len: 1555 microversion: 2.1 time: 0.159496 Aug 23 07:16:15.346969 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 228/480] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:16:15 2022] GET /compute/v2.1/servers/2276f5b3-e71c-42f5-b540-5535a8aa1d48 => generated 1555 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:16:15.366298 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-4036817d-d91e-49b9-beb5-e3f1c074e072 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Calling method '>' {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:16:15.366788 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.compute.api [None req-4036817d-d91e-49b9-beb5-e3f1c074e072 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] [instance: 2276f5b3-e71c-42f5-b540-5535a8aa1d48] Fetching instance by UUID {{(pid=120798) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:16:15.373026 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-4036817d-d91e-49b9-beb5-e3f1c074e072 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:16:15.373506 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-4036817d-d91e-49b9-beb5-e3f1c074e072 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:16:15.373932 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-4036817d-d91e-49b9-beb5-e3f1c074e072 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:16:15.374613 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-4036817d-d91e-49b9-beb5-e3f1c074e072 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:16:15.375057 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-4036817d-d91e-49b9-beb5-e3f1c074e072 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:16:15.375559 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-4036817d-d91e-49b9-beb5-e3f1c074e072 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:16:15.455149 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [None req-4036817d-d91e-49b9-beb5-e3f1c074e072 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] 10.222.0.17 "GET /compute/v2.1/servers/2276f5b3-e71c-42f5-b540-5535a8aa1d48/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.092716 Aug 23 07:16:15.455781 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 229/481] 10.222.0.17 () {58 vars in 1275 bytes} [Tue Aug 23 07:16:15 2022] GET /compute/v2.1/servers/2276f5b3-e71c-42f5-b540-5535a8aa1d48/os-interface => generated 284 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 07:16:15.459040 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-30e0b8fb-1d5e-49af-b419-49e84175ee57 tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] 10.222.0.17 "POST /compute/v2.1/servers/f7783f88-5770-4ca3-a5cf-294f044d21a8/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.270833 Aug 23 07:16:15.460696 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-3f2f6943-34db-40df-b723-cf82b1212585 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Calling method '>' {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:16:15.461286 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.compute.api [None req-3f2f6943-34db-40df-b723-cf82b1212585 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] [instance: b9418fe6-a57e-4a99-becb-19a4d3a52da1] Fetching instance by UUID {{(pid=120798) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:16:15.467936 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-3f2f6943-34db-40df-b723-cf82b1212585 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:16:15.468472 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-3f2f6943-34db-40df-b723-cf82b1212585 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:16:15.468837 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-3f2f6943-34db-40df-b723-cf82b1212585 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:16:15.469527 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-3f2f6943-34db-40df-b723-cf82b1212585 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:16:15.470044 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-3f2f6943-34db-40df-b723-cf82b1212585 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:16:15.470468 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-3f2f6943-34db-40df-b723-cf82b1212585 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:16:15.474845 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 253/482] 10.222.0.17 () {60 vars in 1323 bytes} [Tue Aug 23 07:16:15 2022] POST /compute/v2.1/servers/f7783f88-5770-4ca3-a5cf-294f044d21a8/os-volume_attachments => generated 194 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 07:16:15.611404 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.policy [None req-3f2f6943-34db-40df-b723-cf82b1212585 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64d54cb95b264c18b45d90822507fae1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135367be6e3f4b3d965ee0d99fdca524', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120798) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:16:15.619999 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [None req-3f2f6943-34db-40df-b723-cf82b1212585 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] 10.222.0.17 "GET /compute/v2.1/servers/b9418fe6-a57e-4a99-becb-19a4d3a52da1" status: 200 len: 1736 microversion: 2.1 time: 0.163256 Aug 23 07:16:15.620686 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 230/483] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:16:15 2022] GET /compute/v2.1/servers/b9418fe6-a57e-4a99-becb-19a4d3a52da1 => generated 1736 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:16:15.927176 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-3ba77d63-5758-49f7-8232-7d155522b2d9 tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] Calling method '>' {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:16:15.928182 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.compute.api [None req-3ba77d63-5758-49f7-8232-7d155522b2d9 tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] [instance: 0c761eab-49ac-4396-9907-70845ad75c64] Fetching instance by UUID {{(pid=120799) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:16:15.935517 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-3ba77d63-5758-49f7-8232-7d155522b2d9 tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:16:15.936082 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-3ba77d63-5758-49f7-8232-7d155522b2d9 tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:16:15.937949 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-3ba77d63-5758-49f7-8232-7d155522b2d9 tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:16:15.938910 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-3ba77d63-5758-49f7-8232-7d155522b2d9 tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:16:15.939602 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-3ba77d63-5758-49f7-8232-7d155522b2d9 tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:16:15.940025 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-3ba77d63-5758-49f7-8232-7d155522b2d9 tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:16:16.024302 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-d2373676-f8f8-48ec-929e-950ca153f173 tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Calling method '>' {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:16:16.025016 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.compute.api [None req-d2373676-f8f8-48ec-929e-950ca153f173 tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] [instance: 74919866-69a0-460a-999a-b344d1cbc336] Fetching instance by UUID {{(pid=120798) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:16:16.028273 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG dbcounter [-] [120798] Writing DB stats nova_cell0:SELECT=8 {{(pid=120798) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:16:16.032912 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-d2373676-f8f8-48ec-929e-950ca153f173 tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:16:16.033510 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-d2373676-f8f8-48ec-929e-950ca153f173 tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:16:16.034040 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-d2373676-f8f8-48ec-929e-950ca153f173 tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:16:16.034983 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-d2373676-f8f8-48ec-929e-950ca153f173 tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:16:16.035547 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-d2373676-f8f8-48ec-929e-950ca153f173 tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:16:16.036164 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-d2373676-f8f8-48ec-929e-950ca153f173 tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:16:16.091973 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.policy [None req-3ba77d63-5758-49f7-8232-7d155522b2d9 tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c26232f042844a898c19d1f63152b428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd004facbaed41a7a54a3ed6a6a44305', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120799) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:16:16.099985 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-3ba77d63-5758-49f7-8232-7d155522b2d9 tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] 10.222.0.17 "GET /compute/v2.1/servers/0c761eab-49ac-4396-9907-70845ad75c64" status: 200 len: 1258 microversion: 2.1 time: 0.177444 Aug 23 07:16:16.100545 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 254/484] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:16:15 2022] GET /compute/v2.1/servers/0c761eab-49ac-4396-9907-70845ad75c64 => generated 1258 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:16:16.191004 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.policy [None req-d2373676-f8f8-48ec-929e-950ca153f173 tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffd12f09606b4e6ba12f63b976df1884', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43b271d00f74eb7aa3d0719315c5a99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120798) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:16:16.201187 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [None req-d2373676-f8f8-48ec-929e-950ca153f173 tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] 10.222.0.17 "GET /compute/v2.1/servers/74919866-69a0-460a-999a-b344d1cbc336" status: 200 len: 1266 microversion: 2.1 time: 0.181020 Aug 23 07:16:16.201865 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 231/485] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:16:16 2022] GET /compute/v2.1/servers/74919866-69a0-460a-999a-b344d1cbc336 => generated 1266 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:16:16.296055 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [req-0ba7eb47-cc8f-4408-a7e8-2e5f62354460 req-1eda77ee-1023-4afa-8144-da3d113f7ebf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0c761eab-49ac-4396-9907-70845ad75c64", "name": "network-vif-plugged", "status": "completed", "tag": "bb18fb15-817d-4f8a-9e7c-652d111e0cd7"}]} {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 07:16:16.308635 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [req-0ba7eb47-cc8f-4408-a7e8-2e5f62354460 req-1eda77ee-1023-4afa-8144-da3d113f7ebf service nova] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:16:16.309426 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [req-0ba7eb47-cc8f-4408-a7e8-2e5f62354460 req-1eda77ee-1023-4afa-8144-da3d113f7ebf service nova] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:16:16.310845 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [req-0ba7eb47-cc8f-4408-a7e8-2e5f62354460 req-1eda77ee-1023-4afa-8144-da3d113f7ebf service nova] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:16:16.323951 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.compute.server_external_events [req-0ba7eb47-cc8f-4408-a7e8-2e5f62354460 req-1eda77ee-1023-4afa-8144-da3d113f7ebf service nova] Creating event network-vif-plugged:bb18fb15-817d-4f8a-9e7c-652d111e0cd7 for instance 0c761eab-49ac-4396-9907-70845ad75c64 on hv-cinder-85409 Aug 23 07:16:16.329611 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [req-0ba7eb47-cc8f-4408-a7e8-2e5f62354460 req-1eda77ee-1023-4afa-8144-da3d113f7ebf service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039320 Aug 23 07:16:16.330258 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 255/486] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Aug 23 07:16:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 07:16:16.444853 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [req-23db803f-b3dc-47f1-b31c-9600ccb91626 req-f7fda39e-edda-4e8d-bc75-5d67e7a6a0c5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2276f5b3-e71c-42f5-b540-5535a8aa1d48", "tag": "be3c90aa-cba5-4245-be28-bf2257dc5817"}]} {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 07:16:16.454989 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [req-23db803f-b3dc-47f1-b31c-9600ccb91626 req-f7fda39e-edda-4e8d-bc75-5d67e7a6a0c5 service nova] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:16:16.457545 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [req-23db803f-b3dc-47f1-b31c-9600ccb91626 req-f7fda39e-edda-4e8d-bc75-5d67e7a6a0c5 service nova] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:16:16.457545 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [req-23db803f-b3dc-47f1-b31c-9600ccb91626 req-f7fda39e-edda-4e8d-bc75-5d67e7a6a0c5 service nova] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:16:16.468273 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.compute.server_external_events [req-23db803f-b3dc-47f1-b31c-9600ccb91626 req-f7fda39e-edda-4e8d-bc75-5d67e7a6a0c5 service nova] Creating event network-changed:be3c90aa-cba5-4245-be28-bf2257dc5817 for instance 2276f5b3-e71c-42f5-b540-5535a8aa1d48 on hv-cinder-85409 Aug 23 07:16:16.473377 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [req-23db803f-b3dc-47f1-b31c-9600ccb91626 req-f7fda39e-edda-4e8d-bc75-5d67e7a6a0c5 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032243 Aug 23 07:16:16.474285 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 232/487] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Aug 23 07:16:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 07:16:16.642492 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-21ecd57f-65d3-4f58-b871-add00a2a36de tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Calling method '>' {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:16:16.643335 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.compute.api [None req-21ecd57f-65d3-4f58-b871-add00a2a36de tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] [instance: b9418fe6-a57e-4a99-becb-19a4d3a52da1] Fetching instance by UUID {{(pid=120799) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:16:16.650372 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-21ecd57f-65d3-4f58-b871-add00a2a36de tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:16:16.657735 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-21ecd57f-65d3-4f58-b871-add00a2a36de tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:16:16.658959 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-21ecd57f-65d3-4f58-b871-add00a2a36de tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:16:16.660356 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-21ecd57f-65d3-4f58-b871-add00a2a36de tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:16:16.660826 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-21ecd57f-65d3-4f58-b871-add00a2a36de tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:16:16.661251 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-21ecd57f-65d3-4f58-b871-add00a2a36de tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:16:16.796935 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.policy [None req-21ecd57f-65d3-4f58-b871-add00a2a36de tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64d54cb95b264c18b45d90822507fae1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135367be6e3f4b3d965ee0d99fdca524', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120799) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:16:16.805534 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-21ecd57f-65d3-4f58-b871-add00a2a36de tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] 10.222.0.17 "GET /compute/v2.1/servers/b9418fe6-a57e-4a99-becb-19a4d3a52da1" status: 200 len: 1736 microversion: 2.1 time: 0.168683 Aug 23 07:16:16.806509 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 256/488] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:16:16 2022] GET /compute/v2.1/servers/b9418fe6-a57e-4a99-becb-19a4d3a52da1 => generated 1736 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:16:17.120786 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-d4bb7453-13a5-42b2-9745-7f41231da021 tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] Calling method '>' {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:16:17.121493 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.compute.api [None req-d4bb7453-13a5-42b2-9745-7f41231da021 tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] [instance: 0c761eab-49ac-4396-9907-70845ad75c64] Fetching instance by UUID {{(pid=120798) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:16:17.128191 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-d4bb7453-13a5-42b2-9745-7f41231da021 tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:16:17.128671 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-d4bb7453-13a5-42b2-9745-7f41231da021 tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:16:17.129103 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-d4bb7453-13a5-42b2-9745-7f41231da021 tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:16:17.129791 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-d4bb7453-13a5-42b2-9745-7f41231da021 tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:16:17.130231 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-d4bb7453-13a5-42b2-9745-7f41231da021 tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:16:17.130647 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-d4bb7453-13a5-42b2-9745-7f41231da021 tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:16:17.222389 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-9974a7b6-0e01-4e4b-bc1e-984d87692382 tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Calling method '>' {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:16:17.223101 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.compute.api [None req-9974a7b6-0e01-4e4b-bc1e-984d87692382 tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] [instance: 74919866-69a0-460a-999a-b344d1cbc336] Fetching instance by UUID {{(pid=120799) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:16:17.229648 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-9974a7b6-0e01-4e4b-bc1e-984d87692382 tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:16:17.230427 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-9974a7b6-0e01-4e4b-bc1e-984d87692382 tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:16:17.231001 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-9974a7b6-0e01-4e4b-bc1e-984d87692382 tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:16:17.231980 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-9974a7b6-0e01-4e4b-bc1e-984d87692382 tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:16:17.232436 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-9974a7b6-0e01-4e4b-bc1e-984d87692382 tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:16:17.232851 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-9974a7b6-0e01-4e4b-bc1e-984d87692382 tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:16:17.268064 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.policy [None req-d4bb7453-13a5-42b2-9745-7f41231da021 tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c26232f042844a898c19d1f63152b428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd004facbaed41a7a54a3ed6a6a44305', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120798) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:16:17.276427 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [None req-d4bb7453-13a5-42b2-9745-7f41231da021 tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] 10.222.0.17 "GET /compute/v2.1/servers/0c761eab-49ac-4396-9907-70845ad75c64" status: 200 len: 1258 microversion: 2.1 time: 0.159888 Aug 23 07:16:17.277071 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 233/489] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:16:17 2022] GET /compute/v2.1/servers/0c761eab-49ac-4396-9907-70845ad75c64 => generated 1258 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 07:16:17.385369 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.policy [None req-9974a7b6-0e01-4e4b-bc1e-984d87692382 tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffd12f09606b4e6ba12f63b976df1884', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43b271d00f74eb7aa3d0719315c5a99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120799) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:16:17.393901 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-9974a7b6-0e01-4e4b-bc1e-984d87692382 tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] 10.222.0.17 "GET /compute/v2.1/servers/74919866-69a0-460a-999a-b344d1cbc336" status: 200 len: 1266 microversion: 2.1 time: 0.175570 Aug 23 07:16:17.394471 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 257/490] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:16:17 2022] GET /compute/v2.1/servers/74919866-69a0-460a-999a-b344d1cbc336 => generated 1266 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 07:16:17.830032 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-bb1caeb8-3269-4512-92f0-2a2f195f9bda tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Calling method '>' {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:16:17.830769 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.compute.api [None req-bb1caeb8-3269-4512-92f0-2a2f195f9bda tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] [instance: b9418fe6-a57e-4a99-becb-19a4d3a52da1] Fetching instance by UUID {{(pid=120798) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:16:17.837332 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-bb1caeb8-3269-4512-92f0-2a2f195f9bda tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:16:17.837818 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-bb1caeb8-3269-4512-92f0-2a2f195f9bda tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:16:17.838259 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-bb1caeb8-3269-4512-92f0-2a2f195f9bda tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:16:17.838950 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-bb1caeb8-3269-4512-92f0-2a2f195f9bda tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:16:17.839404 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-bb1caeb8-3269-4512-92f0-2a2f195f9bda tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:16:17.839856 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-bb1caeb8-3269-4512-92f0-2a2f195f9bda tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:16:17.972811 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.policy [None req-bb1caeb8-3269-4512-92f0-2a2f195f9bda tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64d54cb95b264c18b45d90822507fae1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135367be6e3f4b3d965ee0d99fdca524', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120798) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:16:17.981136 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [None req-bb1caeb8-3269-4512-92f0-2a2f195f9bda tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] 10.222.0.17 "GET /compute/v2.1/servers/b9418fe6-a57e-4a99-becb-19a4d3a52da1" status: 200 len: 1736 microversion: 2.1 time: 0.155915 Aug 23 07:16:17.981738 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 234/491] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:16:17 2022] GET /compute/v2.1/servers/b9418fe6-a57e-4a99-becb-19a4d3a52da1 => generated 1736 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:16:18.297930 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-3974133f-5503-41ee-9592-f254afd4dfd9 tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] Calling method '>' {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:16:18.298542 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.compute.api [None req-3974133f-5503-41ee-9592-f254afd4dfd9 tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] [instance: 0c761eab-49ac-4396-9907-70845ad75c64] Fetching instance by UUID {{(pid=120799) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:16:18.306335 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-3974133f-5503-41ee-9592-f254afd4dfd9 tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:16:18.306811 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-3974133f-5503-41ee-9592-f254afd4dfd9 tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:16:18.307236 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-3974133f-5503-41ee-9592-f254afd4dfd9 tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:16:18.307949 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-3974133f-5503-41ee-9592-f254afd4dfd9 tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:16:18.308376 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-3974133f-5503-41ee-9592-f254afd4dfd9 tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:16:18.308789 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-3974133f-5503-41ee-9592-f254afd4dfd9 tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:16:18.414305 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-ed18270a-81f8-4731-9b4f-d1def6a81f75 tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Calling method '>' {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:16:18.414895 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.compute.api [None req-ed18270a-81f8-4731-9b4f-d1def6a81f75 tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] [instance: 74919866-69a0-460a-999a-b344d1cbc336] Fetching instance by UUID {{(pid=120798) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:16:18.422040 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-ed18270a-81f8-4731-9b4f-d1def6a81f75 tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:16:18.422642 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-ed18270a-81f8-4731-9b4f-d1def6a81f75 tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:16:18.423294 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-ed18270a-81f8-4731-9b4f-d1def6a81f75 tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:16:18.424087 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-ed18270a-81f8-4731-9b4f-d1def6a81f75 tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:16:18.424599 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-ed18270a-81f8-4731-9b4f-d1def6a81f75 tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:16:18.425014 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-ed18270a-81f8-4731-9b4f-d1def6a81f75 tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:16:18.445664 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.policy [None req-3974133f-5503-41ee-9592-f254afd4dfd9 tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c26232f042844a898c19d1f63152b428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd004facbaed41a7a54a3ed6a6a44305', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120799) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:16:18.453753 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-3974133f-5503-41ee-9592-f254afd4dfd9 tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] 10.222.0.17 "GET /compute/v2.1/servers/0c761eab-49ac-4396-9907-70845ad75c64" status: 200 len: 1258 microversion: 2.1 time: 0.159850 Aug 23 07:16:18.454306 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 258/492] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:16:18 2022] GET /compute/v2.1/servers/0c761eab-49ac-4396-9907-70845ad75c64 => generated 1258 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:16:18.563821 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.policy [None req-ed18270a-81f8-4731-9b4f-d1def6a81f75 tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffd12f09606b4e6ba12f63b976df1884', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43b271d00f74eb7aa3d0719315c5a99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120798) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:16:18.571978 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [None req-ed18270a-81f8-4731-9b4f-d1def6a81f75 tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] 10.222.0.17 "GET /compute/v2.1/servers/74919866-69a0-460a-999a-b344d1cbc336" status: 200 len: 1266 microversion: 2.1 time: 0.161608 Aug 23 07:16:18.572550 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 235/493] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:16:18 2022] GET /compute/v2.1/servers/74919866-69a0-460a-999a-b344d1cbc336 => generated 1266 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 07:16:19.012512 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-dc47e490-0a90-4cc4-93cf-1d9a8e82fae4 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Calling method '>' {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:16:19.013985 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.compute.api [None req-dc47e490-0a90-4cc4-93cf-1d9a8e82fae4 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] [instance: b9418fe6-a57e-4a99-becb-19a4d3a52da1] Fetching instance by UUID {{(pid=120799) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:16:19.020961 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-dc47e490-0a90-4cc4-93cf-1d9a8e82fae4 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:16:19.021438 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-dc47e490-0a90-4cc4-93cf-1d9a8e82fae4 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:16:19.021866 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-dc47e490-0a90-4cc4-93cf-1d9a8e82fae4 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:16:19.022538 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-dc47e490-0a90-4cc4-93cf-1d9a8e82fae4 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:16:19.022982 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-dc47e490-0a90-4cc4-93cf-1d9a8e82fae4 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:16:19.023447 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-dc47e490-0a90-4cc4-93cf-1d9a8e82fae4 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:16:19.154803 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.policy [None req-dc47e490-0a90-4cc4-93cf-1d9a8e82fae4 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64d54cb95b264c18b45d90822507fae1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135367be6e3f4b3d965ee0d99fdca524', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120799) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:16:19.164443 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-dc47e490-0a90-4cc4-93cf-1d9a8e82fae4 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] 10.222.0.17 "GET /compute/v2.1/servers/b9418fe6-a57e-4a99-becb-19a4d3a52da1" status: 200 len: 1736 microversion: 2.1 time: 0.158998 Aug 23 07:16:19.165030 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 259/494] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:16:19 2022] GET /compute/v2.1/servers/b9418fe6-a57e-4a99-becb-19a4d3a52da1 => generated 1736 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:16:19.475643 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-6bc12764-4692-4cf9-96f4-1529da8ef19e tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] Calling method '>' {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:16:19.476255 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.compute.api [None req-6bc12764-4692-4cf9-96f4-1529da8ef19e tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] [instance: 0c761eab-49ac-4396-9907-70845ad75c64] Fetching instance by UUID {{(pid=120798) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:16:19.483651 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-6bc12764-4692-4cf9-96f4-1529da8ef19e tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:16:19.484132 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-6bc12764-4692-4cf9-96f4-1529da8ef19e tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:16:19.484558 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-6bc12764-4692-4cf9-96f4-1529da8ef19e tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:16:19.485239 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-6bc12764-4692-4cf9-96f4-1529da8ef19e tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:16:19.485684 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-6bc12764-4692-4cf9-96f4-1529da8ef19e tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:16:19.486107 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-6bc12764-4692-4cf9-96f4-1529da8ef19e tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:16:19.596623 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-198fad28-cc46-44b3-b04b-5740865becab tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Calling method '>' {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:16:19.597233 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.compute.api [None req-198fad28-cc46-44b3-b04b-5740865becab tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] [instance: 74919866-69a0-460a-999a-b344d1cbc336] Fetching instance by UUID {{(pid=120799) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:16:19.603915 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-198fad28-cc46-44b3-b04b-5740865becab tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:16:19.604429 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-198fad28-cc46-44b3-b04b-5740865becab tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:16:19.604859 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-198fad28-cc46-44b3-b04b-5740865becab tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:16:19.605548 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-198fad28-cc46-44b3-b04b-5740865becab tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:16:19.606059 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-198fad28-cc46-44b3-b04b-5740865becab tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:16:19.606480 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-198fad28-cc46-44b3-b04b-5740865becab tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:16:19.629778 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.policy [None req-6bc12764-4692-4cf9-96f4-1529da8ef19e tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c26232f042844a898c19d1f63152b428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd004facbaed41a7a54a3ed6a6a44305', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120798) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:16:19.637662 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [None req-6bc12764-4692-4cf9-96f4-1529da8ef19e tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] 10.222.0.17 "GET /compute/v2.1/servers/0c761eab-49ac-4396-9907-70845ad75c64" status: 200 len: 1442 microversion: 2.1 time: 0.165987 Aug 23 07:16:19.638438 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 236/495] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:16:19 2022] GET /compute/v2.1/servers/0c761eab-49ac-4396-9907-70845ad75c64 => generated 1442 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:16:19.658357 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-d7984177-b457-4697-9967-082e9c7dfdda tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] Calling method '>' {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:16:19.658959 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.compute.api [None req-d7984177-b457-4697-9967-082e9c7dfdda tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] [instance: 0c761eab-49ac-4396-9907-70845ad75c64] Fetching instance by UUID {{(pid=120798) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:16:19.665273 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-d7984177-b457-4697-9967-082e9c7dfdda tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:16:19.665730 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-d7984177-b457-4697-9967-082e9c7dfdda tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:16:19.666158 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-d7984177-b457-4697-9967-082e9c7dfdda tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:16:19.666831 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-d7984177-b457-4697-9967-082e9c7dfdda tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:16:19.667273 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-d7984177-b457-4697-9967-082e9c7dfdda tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:16:19.667741 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-d7984177-b457-4697-9967-082e9c7dfdda tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:16:19.784163 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.policy [None req-198fad28-cc46-44b3-b04b-5740865becab tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffd12f09606b4e6ba12f63b976df1884', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43b271d00f74eb7aa3d0719315c5a99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120799) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:16:19.792666 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-198fad28-cc46-44b3-b04b-5740865becab tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] 10.222.0.17 "GET /compute/v2.1/servers/74919866-69a0-460a-999a-b344d1cbc336" status: 200 len: 1266 microversion: 2.1 time: 0.199935 Aug 23 07:16:19.793283 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 260/496] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:16:19 2022] GET /compute/v2.1/servers/74919866-69a0-460a-999a-b344d1cbc336 => generated 1266 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:16:19.831126 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.policy [None req-d7984177-b457-4697-9967-082e9c7dfdda tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c26232f042844a898c19d1f63152b428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd004facbaed41a7a54a3ed6a6a44305', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120798) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:16:19.839315 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [None req-d7984177-b457-4697-9967-082e9c7dfdda tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] 10.222.0.17 "GET /compute/v2.1/servers/0c761eab-49ac-4396-9907-70845ad75c64" status: 200 len: 1442 microversion: 2.1 time: 0.184839 Aug 23 07:16:19.839907 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 237/497] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:16:19 2022] GET /compute/v2.1/servers/0c761eab-49ac-4396-9907-70845ad75c64 => generated 1442 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 07:16:20.186852 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-b025edde-26a8-4421-b10c-cb10422d5c06 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Calling method '>' {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:16:20.187490 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.compute.api [None req-b025edde-26a8-4421-b10c-cb10422d5c06 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] [instance: b9418fe6-a57e-4a99-becb-19a4d3a52da1] Fetching instance by UUID {{(pid=120799) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:16:20.193584 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-b025edde-26a8-4421-b10c-cb10422d5c06 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:16:20.194063 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-b025edde-26a8-4421-b10c-cb10422d5c06 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:16:20.194489 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-b025edde-26a8-4421-b10c-cb10422d5c06 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:16:20.195171 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-b025edde-26a8-4421-b10c-cb10422d5c06 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:16:20.195659 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-b025edde-26a8-4421-b10c-cb10422d5c06 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:16:20.196078 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-b025edde-26a8-4421-b10c-cb10422d5c06 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:16:20.587892 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.policy [None req-b025edde-26a8-4421-b10c-cb10422d5c06 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64d54cb95b264c18b45d90822507fae1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135367be6e3f4b3d965ee0d99fdca524', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120799) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:16:20.599329 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-b025edde-26a8-4421-b10c-cb10422d5c06 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] 10.222.0.17 "GET /compute/v2.1/servers/b9418fe6-a57e-4a99-becb-19a4d3a52da1" status: 200 len: 1736 microversion: 2.1 time: 0.415235 Aug 23 07:16:20.611736 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 261/498] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:16:20 2022] GET /compute/v2.1/servers/b9418fe6-a57e-4a99-becb-19a4d3a52da1 => generated 1736 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:16:20.813688 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-260a9e33-100a-4a9e-9190-f1514b3ca97b tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Calling method '>' {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:16:20.814529 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.compute.api [None req-260a9e33-100a-4a9e-9190-f1514b3ca97b tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] [instance: 74919866-69a0-460a-999a-b344d1cbc336] Fetching instance by UUID {{(pid=120798) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:16:20.820882 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-260a9e33-100a-4a9e-9190-f1514b3ca97b tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:16:20.821479 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-260a9e33-100a-4a9e-9190-f1514b3ca97b tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:16:20.822047 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-260a9e33-100a-4a9e-9190-f1514b3ca97b tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:16:20.822834 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-260a9e33-100a-4a9e-9190-f1514b3ca97b tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:16:20.823450 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-260a9e33-100a-4a9e-9190-f1514b3ca97b tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:16:20.823965 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-260a9e33-100a-4a9e-9190-f1514b3ca97b tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:16:20.957511 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.policy [None req-260a9e33-100a-4a9e-9190-f1514b3ca97b tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffd12f09606b4e6ba12f63b976df1884', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43b271d00f74eb7aa3d0719315c5a99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120798) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:16:20.965869 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [None req-260a9e33-100a-4a9e-9190-f1514b3ca97b tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] 10.222.0.17 "GET /compute/v2.1/servers/74919866-69a0-460a-999a-b344d1cbc336" status: 200 len: 1266 microversion: 2.1 time: 0.156159 Aug 23 07:16:20.966480 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 238/499] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:16:20 2022] GET /compute/v2.1/servers/74919866-69a0-460a-999a-b344d1cbc336 => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:16:21.618154 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-e92612cc-f0dd-46d7-b605-dbb81862e6a3 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Calling method '>' {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:16:21.618743 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.compute.api [None req-e92612cc-f0dd-46d7-b605-dbb81862e6a3 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] [instance: b9418fe6-a57e-4a99-becb-19a4d3a52da1] Fetching instance by UUID {{(pid=120799) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:16:21.625960 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-e92612cc-f0dd-46d7-b605-dbb81862e6a3 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:16:21.626437 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-e92612cc-f0dd-46d7-b605-dbb81862e6a3 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:16:21.626883 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-e92612cc-f0dd-46d7-b605-dbb81862e6a3 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:16:21.627570 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-e92612cc-f0dd-46d7-b605-dbb81862e6a3 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:16:21.628061 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-e92612cc-f0dd-46d7-b605-dbb81862e6a3 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:16:21.628472 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-e92612cc-f0dd-46d7-b605-dbb81862e6a3 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:16:21.765653 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.policy [None req-e92612cc-f0dd-46d7-b605-dbb81862e6a3 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64d54cb95b264c18b45d90822507fae1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135367be6e3f4b3d965ee0d99fdca524', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120799) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:16:21.776630 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-e92612cc-f0dd-46d7-b605-dbb81862e6a3 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] 10.222.0.17 "GET /compute/v2.1/servers/b9418fe6-a57e-4a99-becb-19a4d3a52da1" status: 200 len: 1736 microversion: 2.1 time: 0.162230 Aug 23 07:16:21.777201 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 262/500] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:16:21 2022] GET /compute/v2.1/servers/b9418fe6-a57e-4a99-becb-19a4d3a52da1 => generated 1736 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:16:21.898255 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [req-173a3dc9-acd4-4970-8398-d7534724a5b1 req-2cf97799-bf15-42ab-bf2b-d7918878b799 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0c761eab-49ac-4396-9907-70845ad75c64", "tag": "bb18fb15-817d-4f8a-9e7c-652d111e0cd7"}]} {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 07:16:21.909051 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [req-173a3dc9-acd4-4970-8398-d7534724a5b1 req-2cf97799-bf15-42ab-bf2b-d7918878b799 service nova] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:16:21.909524 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [req-173a3dc9-acd4-4970-8398-d7534724a5b1 req-2cf97799-bf15-42ab-bf2b-d7918878b799 service nova] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:16:21.909938 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [req-173a3dc9-acd4-4970-8398-d7534724a5b1 req-2cf97799-bf15-42ab-bf2b-d7918878b799 service nova] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:16:21.928005 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.compute.server_external_events [req-173a3dc9-acd4-4970-8398-d7534724a5b1 req-2cf97799-bf15-42ab-bf2b-d7918878b799 service nova] Creating event network-changed:bb18fb15-817d-4f8a-9e7c-652d111e0cd7 for instance 0c761eab-49ac-4396-9907-70845ad75c64 on hv-cinder-85409 Aug 23 07:16:21.932914 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [req-173a3dc9-acd4-4970-8398-d7534724a5b1 req-2cf97799-bf15-42ab-bf2b-d7918878b799 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038445 Aug 23 07:16:21.933499 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 239/501] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Aug 23 07:16:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 07:16:21.986572 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-8bd59429-1c99-430d-b373-97a8aa1c35a1 tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Calling method '>' {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:16:21.987318 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.compute.api [None req-8bd59429-1c99-430d-b373-97a8aa1c35a1 tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] [instance: 74919866-69a0-460a-999a-b344d1cbc336] Fetching instance by UUID {{(pid=120799) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:16:21.993579 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-8bd59429-1c99-430d-b373-97a8aa1c35a1 tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:16:21.994058 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-8bd59429-1c99-430d-b373-97a8aa1c35a1 tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:16:21.994517 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-8bd59429-1c99-430d-b373-97a8aa1c35a1 tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:16:21.995400 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-8bd59429-1c99-430d-b373-97a8aa1c35a1 tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:16:21.995876 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-8bd59429-1c99-430d-b373-97a8aa1c35a1 tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:16:21.996441 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-8bd59429-1c99-430d-b373-97a8aa1c35a1 tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:16:22.244677 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.policy [None req-8bd59429-1c99-430d-b373-97a8aa1c35a1 tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffd12f09606b4e6ba12f63b976df1884', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43b271d00f74eb7aa3d0719315c5a99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120799) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:16:22.252891 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-8bd59429-1c99-430d-b373-97a8aa1c35a1 tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] 10.222.0.17 "GET /compute/v2.1/servers/74919866-69a0-460a-999a-b344d1cbc336" status: 200 len: 1266 microversion: 2.1 time: 0.270427 Aug 23 07:16:22.266262 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 263/502] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:16:21 2022] GET /compute/v2.1/servers/74919866-69a0-460a-999a-b344d1cbc336 => generated 1266 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:16:22.799095 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-d92cf96f-5376-4556-82a9-3767ba194521 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Calling method '>' {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:16:22.799862 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.compute.api [None req-d92cf96f-5376-4556-82a9-3767ba194521 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] [instance: b9418fe6-a57e-4a99-becb-19a4d3a52da1] Fetching instance by UUID {{(pid=120798) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:16:22.806192 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-d92cf96f-5376-4556-82a9-3767ba194521 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:16:22.806742 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-d92cf96f-5376-4556-82a9-3767ba194521 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:16:22.807238 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-d92cf96f-5376-4556-82a9-3767ba194521 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:16:22.808010 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-d92cf96f-5376-4556-82a9-3767ba194521 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:16:22.808524 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-d92cf96f-5376-4556-82a9-3767ba194521 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:16:22.809133 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-d92cf96f-5376-4556-82a9-3767ba194521 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:16:22.952956 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.policy [None req-d92cf96f-5376-4556-82a9-3767ba194521 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64d54cb95b264c18b45d90822507fae1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135367be6e3f4b3d965ee0d99fdca524', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120798) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:16:22.962900 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [None req-d92cf96f-5376-4556-82a9-3767ba194521 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] 10.222.0.17 "GET /compute/v2.1/servers/b9418fe6-a57e-4a99-becb-19a4d3a52da1" status: 200 len: 1736 microversion: 2.1 time: 0.168253 Aug 23 07:16:22.963837 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 240/503] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:16:22 2022] GET /compute/v2.1/servers/b9418fe6-a57e-4a99-becb-19a4d3a52da1 => generated 1736 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:16:23.130450 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-9b5d8bde-66d8-4eb5-9c20-1f20ca75dae4 tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] Calling method '>' {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:16:23.131055 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.compute.api [None req-9b5d8bde-66d8-4eb5-9c20-1f20ca75dae4 tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] [instance: f7783f88-5770-4ca3-a5cf-294f044d21a8] Fetching instance by UUID {{(pid=120799) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:16:23.138052 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-9b5d8bde-66d8-4eb5-9c20-1f20ca75dae4 tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:16:23.139091 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-9b5d8bde-66d8-4eb5-9c20-1f20ca75dae4 tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:16:23.139091 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-9b5d8bde-66d8-4eb5-9c20-1f20ca75dae4 tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:16:23.139700 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-9b5d8bde-66d8-4eb5-9c20-1f20ca75dae4 tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:16:23.140189 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-9b5d8bde-66d8-4eb5-9c20-1f20ca75dae4 tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:16:23.140602 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-9b5d8bde-66d8-4eb5-9c20-1f20ca75dae4 tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:16:23.273972 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-3946a5de-864d-4d26-8f12-d5ebeba6b000 tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Calling method '>' {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:16:23.274686 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.compute.api [None req-3946a5de-864d-4d26-8f12-d5ebeba6b000 tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] [instance: 74919866-69a0-460a-999a-b344d1cbc336] Fetching instance by UUID {{(pid=120798) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:16:23.276808 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG dbcounter [-] [120798] Writing DB stats nova_cell0:SELECT=4 {{(pid=120798) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:16:23.278046 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.policy [None req-9b5d8bde-66d8-4eb5-9c20-1f20ca75dae4 tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5e8c33634b246319de495d269c05124', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9466597900d4a3ca60a2ef8b7678c87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120799) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:16:23.283644 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-3946a5de-864d-4d26-8f12-d5ebeba6b000 tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:16:23.288901 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-9b5d8bde-66d8-4eb5-9c20-1f20ca75dae4 tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] 10.222.0.17 "GET /compute/v2.1/servers/f7783f88-5770-4ca3-a5cf-294f044d21a8" status: 200 len: 1594 microversion: 2.1 time: 0.162451 Aug 23 07:16:23.290021 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 264/504] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:16:23 2022] GET /compute/v2.1/servers/f7783f88-5770-4ca3-a5cf-294f044d21a8 => generated 1594 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:16:23.292937 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-3946a5de-864d-4d26-8f12-d5ebeba6b000 tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:16:23.293592 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-3946a5de-864d-4d26-8f12-d5ebeba6b000 tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:16:23.294512 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-3946a5de-864d-4d26-8f12-d5ebeba6b000 tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:16:23.295277 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-3946a5de-864d-4d26-8f12-d5ebeba6b000 tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:16:23.295923 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-3946a5de-864d-4d26-8f12-d5ebeba6b000 tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:16:23.431967 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.policy [None req-3946a5de-864d-4d26-8f12-d5ebeba6b000 tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffd12f09606b4e6ba12f63b976df1884', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43b271d00f74eb7aa3d0719315c5a99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120798) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:16:23.439931 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [None req-3946a5de-864d-4d26-8f12-d5ebeba6b000 tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] 10.222.0.17 "GET /compute/v2.1/servers/74919866-69a0-460a-999a-b344d1cbc336" status: 200 len: 1266 microversion: 2.1 time: 0.169891 Aug 23 07:16:23.441404 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 241/505] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:16:23 2022] GET /compute/v2.1/servers/74919866-69a0-460a-999a-b344d1cbc336 => generated 1266 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 07:16:23.984404 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-e49e25b1-6312-4556-b28b-b387d4e0043d tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Calling method '>' {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:16:23.985326 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.compute.api [None req-e49e25b1-6312-4556-b28b-b387d4e0043d tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] [instance: b9418fe6-a57e-4a99-becb-19a4d3a52da1] Fetching instance by UUID {{(pid=120799) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:16:23.991525 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-e49e25b1-6312-4556-b28b-b387d4e0043d tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:16:23.992219 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-e49e25b1-6312-4556-b28b-b387d4e0043d tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:16:23.992651 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-e49e25b1-6312-4556-b28b-b387d4e0043d tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:16:23.993336 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-e49e25b1-6312-4556-b28b-b387d4e0043d tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:16:23.993787 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-e49e25b1-6312-4556-b28b-b387d4e0043d tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:16:23.994203 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-e49e25b1-6312-4556-b28b-b387d4e0043d tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:16:24.322112 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [req-09e3568e-8292-44e9-bad0-a2f2930b346a req-10eccaf1-2cde-4a55-ba8a-eed8a84bedd8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "74919866-69a0-460a-999a-b344d1cbc336", "name": "network-vif-plugged", "status": "completed", "tag": "4f3c189e-8afd-49e5-a4c7-60407c13730e"}]} {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 07:16:24.333621 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [req-09e3568e-8292-44e9-bad0-a2f2930b346a req-10eccaf1-2cde-4a55-ba8a-eed8a84bedd8 service nova] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:16:24.334238 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [req-09e3568e-8292-44e9-bad0-a2f2930b346a req-10eccaf1-2cde-4a55-ba8a-eed8a84bedd8 service nova] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:16:24.335191 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [req-09e3568e-8292-44e9-bad0-a2f2930b346a req-10eccaf1-2cde-4a55-ba8a-eed8a84bedd8 service nova] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:16:24.346469 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.policy [None req-e49e25b1-6312-4556-b28b-b387d4e0043d tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64d54cb95b264c18b45d90822507fae1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135367be6e3f4b3d965ee0d99fdca524', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120799) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:16:24.348759 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.compute.server_external_events [req-09e3568e-8292-44e9-bad0-a2f2930b346a req-10eccaf1-2cde-4a55-ba8a-eed8a84bedd8 service nova] Creating event network-vif-plugged:4f3c189e-8afd-49e5-a4c7-60407c13730e for instance 74919866-69a0-460a-999a-b344d1cbc336 on hv-cinder-85409 Aug 23 07:16:24.354583 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [req-09e3568e-8292-44e9-bad0-a2f2930b346a req-10eccaf1-2cde-4a55-ba8a-eed8a84bedd8 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036424 Aug 23 07:16:24.355778 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 242/506] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Aug 23 07:16:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 07:16:24.359876 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-e49e25b1-6312-4556-b28b-b387d4e0043d tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] 10.222.0.17 "GET /compute/v2.1/servers/b9418fe6-a57e-4a99-becb-19a4d3a52da1" status: 200 len: 1736 microversion: 2.1 time: 0.379403 Aug 23 07:16:24.360407 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 265/507] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:16:23 2022] GET /compute/v2.1/servers/b9418fe6-a57e-4a99-becb-19a4d3a52da1 => generated 1736 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:16:24.461103 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-095a1d9c-ed36-4ccc-86c3-e810555972b2 tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Calling method '>' {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:16:24.461768 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.compute.api [None req-095a1d9c-ed36-4ccc-86c3-e810555972b2 tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] [instance: 74919866-69a0-460a-999a-b344d1cbc336] Fetching instance by UUID {{(pid=120798) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:16:24.468495 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-095a1d9c-ed36-4ccc-86c3-e810555972b2 tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:16:24.468978 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-095a1d9c-ed36-4ccc-86c3-e810555972b2 tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:16:24.469408 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-095a1d9c-ed36-4ccc-86c3-e810555972b2 tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:16:24.470112 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-095a1d9c-ed36-4ccc-86c3-e810555972b2 tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:16:24.470543 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-095a1d9c-ed36-4ccc-86c3-e810555972b2 tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:16:24.470962 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-095a1d9c-ed36-4ccc-86c3-e810555972b2 tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:16:24.728432 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.policy [None req-095a1d9c-ed36-4ccc-86c3-e810555972b2 tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffd12f09606b4e6ba12f63b976df1884', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43b271d00f74eb7aa3d0719315c5a99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120798) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:16:24.736318 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [None req-095a1d9c-ed36-4ccc-86c3-e810555972b2 tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] 10.222.0.17 "GET /compute/v2.1/servers/74919866-69a0-460a-999a-b344d1cbc336" status: 200 len: 1266 microversion: 2.1 time: 0.279910 Aug 23 07:16:24.736890 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 243/508] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:16:24 2022] GET /compute/v2.1/servers/74919866-69a0-460a-999a-b344d1cbc336 => generated 1266 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:16:25.385222 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-e3cb667c-1246-4d4d-9a27-6253e5d009b4 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Calling method '>' {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:16:25.386207 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.compute.api [None req-e3cb667c-1246-4d4d-9a27-6253e5d009b4 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] [instance: b9418fe6-a57e-4a99-becb-19a4d3a52da1] Fetching instance by UUID {{(pid=120799) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:16:25.393365 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-e3cb667c-1246-4d4d-9a27-6253e5d009b4 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:16:25.393827 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-e3cb667c-1246-4d4d-9a27-6253e5d009b4 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:16:25.394259 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-e3cb667c-1246-4d4d-9a27-6253e5d009b4 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:16:25.394938 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-e3cb667c-1246-4d4d-9a27-6253e5d009b4 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:16:25.395378 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-e3cb667c-1246-4d4d-9a27-6253e5d009b4 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:16:25.395793 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-e3cb667c-1246-4d4d-9a27-6253e5d009b4 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:16:25.757871 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-6d9ea505-316f-4d1a-b32e-78acfdc85ecf tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Calling method '>' {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:16:25.758462 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.compute.api [None req-6d9ea505-316f-4d1a-b32e-78acfdc85ecf tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] [instance: 74919866-69a0-460a-999a-b344d1cbc336] Fetching instance by UUID {{(pid=120798) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:16:25.765729 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-6d9ea505-316f-4d1a-b32e-78acfdc85ecf tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:16:25.766190 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-6d9ea505-316f-4d1a-b32e-78acfdc85ecf tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:16:25.766952 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-6d9ea505-316f-4d1a-b32e-78acfdc85ecf tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:16:25.767867 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-6d9ea505-316f-4d1a-b32e-78acfdc85ecf tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:16:25.768454 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-6d9ea505-316f-4d1a-b32e-78acfdc85ecf tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:16:25.769021 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-6d9ea505-316f-4d1a-b32e-78acfdc85ecf tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:16:25.773653 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG dbcounter [-] [120798] Writing DB stats nova_cell1:SELECT=100 {{(pid=120798) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:16:25.894972 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.policy [None req-e3cb667c-1246-4d4d-9a27-6253e5d009b4 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64d54cb95b264c18b45d90822507fae1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135367be6e3f4b3d965ee0d99fdca524', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120799) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:16:25.903581 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-e3cb667c-1246-4d4d-9a27-6253e5d009b4 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] 10.222.0.17 "GET /compute/v2.1/servers/b9418fe6-a57e-4a99-becb-19a4d3a52da1" status: 200 len: 1736 microversion: 2.1 time: 0.522147 Aug 23 07:16:25.917828 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 266/509] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:16:25 2022] GET /compute/v2.1/servers/b9418fe6-a57e-4a99-becb-19a4d3a52da1 => generated 1736 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:16:25.979122 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.policy [None req-6d9ea505-316f-4d1a-b32e-78acfdc85ecf tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffd12f09606b4e6ba12f63b976df1884', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43b271d00f74eb7aa3d0719315c5a99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120798) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:16:25.988050 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [None req-6d9ea505-316f-4d1a-b32e-78acfdc85ecf tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] 10.222.0.17 "GET /compute/v2.1/servers/74919866-69a0-460a-999a-b344d1cbc336" status: 200 len: 1266 microversion: 2.1 time: 0.234063 Aug 23 07:16:25.989029 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 244/510] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:16:25 2022] GET /compute/v2.1/servers/74919866-69a0-460a-999a-b344d1cbc336 => generated 1266 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:16:26.023597 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [req-c9b26ca3-66ca-4504-a2c8-9757ff5b05fd req-507f08cc-9164-43a1-bdf1-4653114a2aeb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f7783f88-5770-4ca3-a5cf-294f044d21a8", "tag": "7ccdc22f-1e2b-4dd9-8ea3-858bf0e435cf"}]} {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 07:16:26.033281 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [req-c9b26ca3-66ca-4504-a2c8-9757ff5b05fd req-507f08cc-9164-43a1-bdf1-4653114a2aeb service nova] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:16:26.033863 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [req-c9b26ca3-66ca-4504-a2c8-9757ff5b05fd req-507f08cc-9164-43a1-bdf1-4653114a2aeb service nova] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:16:26.034518 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [req-c9b26ca3-66ca-4504-a2c8-9757ff5b05fd req-507f08cc-9164-43a1-bdf1-4653114a2aeb service nova] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:16:26.038872 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG dbcounter [-] [120799] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120799) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:16:26.048412 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.compute.server_external_events [req-c9b26ca3-66ca-4504-a2c8-9757ff5b05fd req-507f08cc-9164-43a1-bdf1-4653114a2aeb service nova] Creating event network-changed:7ccdc22f-1e2b-4dd9-8ea3-858bf0e435cf for instance f7783f88-5770-4ca3-a5cf-294f044d21a8 on hv-cinder-85409 Aug 23 07:16:26.054174 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [req-c9b26ca3-66ca-4504-a2c8-9757ff5b05fd req-507f08cc-9164-43a1-bdf1-4653114a2aeb service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034687 Aug 23 07:16:26.055219 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 267/511] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Aug 23 07:16:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 07:16:26.924783 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-2d7e1565-8566-452d-8fda-49cc44266404 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Calling method '>' {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:16:26.925572 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.compute.api [None req-2d7e1565-8566-452d-8fda-49cc44266404 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] [instance: b9418fe6-a57e-4a99-becb-19a4d3a52da1] Fetching instance by UUID {{(pid=120798) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:16:26.933315 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-2d7e1565-8566-452d-8fda-49cc44266404 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:16:26.933812 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-2d7e1565-8566-452d-8fda-49cc44266404 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:16:26.934241 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-2d7e1565-8566-452d-8fda-49cc44266404 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:16:26.938467 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-2d7e1565-8566-452d-8fda-49cc44266404 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:16:26.938950 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-2d7e1565-8566-452d-8fda-49cc44266404 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:16:26.939618 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-2d7e1565-8566-452d-8fda-49cc44266404 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:16:27.008636 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-5c656422-1c28-4bb1-8cc2-ffd3656c67f3 tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Calling method '>' {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:16:27.009231 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.compute.api [None req-5c656422-1c28-4bb1-8cc2-ffd3656c67f3 tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] [instance: 74919866-69a0-460a-999a-b344d1cbc336] Fetching instance by UUID {{(pid=120799) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:16:27.013058 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG dbcounter [-] [120799] Writing DB stats nova_api:SELECT=100 {{(pid=120799) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:16:27.021471 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-5c656422-1c28-4bb1-8cc2-ffd3656c67f3 tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:16:27.022778 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-5c656422-1c28-4bb1-8cc2-ffd3656c67f3 tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:16:27.023385 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-5c656422-1c28-4bb1-8cc2-ffd3656c67f3 tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:16:27.024166 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-5c656422-1c28-4bb1-8cc2-ffd3656c67f3 tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:16:27.024618 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-5c656422-1c28-4bb1-8cc2-ffd3656c67f3 tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:16:27.025035 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-5c656422-1c28-4bb1-8cc2-ffd3656c67f3 tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:16:27.132487 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.policy [None req-2d7e1565-8566-452d-8fda-49cc44266404 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64d54cb95b264c18b45d90822507fae1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135367be6e3f4b3d965ee0d99fdca524', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120798) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:16:27.143528 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [None req-2d7e1565-8566-452d-8fda-49cc44266404 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] 10.222.0.17 "GET /compute/v2.1/servers/b9418fe6-a57e-4a99-becb-19a4d3a52da1" status: 200 len: 1736 microversion: 2.1 time: 0.222526 Aug 23 07:16:27.144119 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 245/512] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:16:26 2022] GET /compute/v2.1/servers/b9418fe6-a57e-4a99-becb-19a4d3a52da1 => generated 1736 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:16:27.149422 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-69f0c0c1-5e14-4b46-bb29-d6cc9bb54466 tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-261708711"}} {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 07:16:27.149950 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.compute.api [None req-69f0c0c1-5e14-4b46-bb29-d6cc9bb54466 tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] [instance: f7783f88-5770-4ca3-a5cf-294f044d21a8] Fetching instance by UUID {{(pid=120798) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:16:27.156694 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-69f0c0c1-5e14-4b46-bb29-d6cc9bb54466 tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:16:27.157388 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-69f0c0c1-5e14-4b46-bb29-d6cc9bb54466 tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:16:27.158139 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-69f0c0c1-5e14-4b46-bb29-d6cc9bb54466 tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:16:27.158999 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-69f0c0c1-5e14-4b46-bb29-d6cc9bb54466 tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:16:27.159654 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-69f0c0c1-5e14-4b46-bb29-d6cc9bb54466 tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:16:27.160763 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-69f0c0c1-5e14-4b46-bb29-d6cc9bb54466 tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:16:27.277983 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.policy [None req-5c656422-1c28-4bb1-8cc2-ffd3656c67f3 tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffd12f09606b4e6ba12f63b976df1884', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43b271d00f74eb7aa3d0719315c5a99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120799) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:16:27.287630 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-5c656422-1c28-4bb1-8cc2-ffd3656c67f3 tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] 10.222.0.17 "GET /compute/v2.1/servers/74919866-69a0-460a-999a-b344d1cbc336" status: 200 len: 1453 microversion: 2.1 time: 0.283224 Aug 23 07:16:27.288217 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 268/513] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:16:27 2022] GET /compute/v2.1/servers/74919866-69a0-460a-999a-b344d1cbc336 => generated 1453 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 07:16:27.309721 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-a801b957-8a41-456c-ae5e-df37daf2889e tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Calling method '>' {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:16:27.310520 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.compute.api [None req-a801b957-8a41-456c-ae5e-df37daf2889e tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] [instance: 74919866-69a0-460a-999a-b344d1cbc336] Fetching instance by UUID {{(pid=120799) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:16:27.318909 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-a801b957-8a41-456c-ae5e-df37daf2889e tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:16:27.319481 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-a801b957-8a41-456c-ae5e-df37daf2889e tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:16:27.319973 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-a801b957-8a41-456c-ae5e-df37daf2889e tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:16:27.320731 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-a801b957-8a41-456c-ae5e-df37daf2889e tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:16:27.321369 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-a801b957-8a41-456c-ae5e-df37daf2889e tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:16:27.321788 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-a801b957-8a41-456c-ae5e-df37daf2889e tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:16:27.360737 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.network.security_group_api [None req-69f0c0c1-5e14-4b46-bb29-d6cc9bb54466 tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] Adding security group 2ec95c58-7885-48b0-a3a0-0e5de90e9834 to port 7ccdc22f-1e2b-4dd9-8ea3-858bf0e435cf Aug 23 07:16:27.531839 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.policy [None req-a801b957-8a41-456c-ae5e-df37daf2889e tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffd12f09606b4e6ba12f63b976df1884', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43b271d00f74eb7aa3d0719315c5a99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120799) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:16:27.539920 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-a801b957-8a41-456c-ae5e-df37daf2889e tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] 10.222.0.17 "GET /compute/v2.1/servers/74919866-69a0-460a-999a-b344d1cbc336" status: 200 len: 1453 microversion: 2.1 time: 0.233989 Aug 23 07:16:27.540684 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 269/514] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:16:27 2022] GET /compute/v2.1/servers/74919866-69a0-460a-999a-b344d1cbc336 => generated 1453 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:16:27.807255 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [None req-69f0c0c1-5e14-4b46-bb29-d6cc9bb54466 tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] 10.222.0.17 "POST /compute/v2.1/servers/f7783f88-5770-4ca3-a5cf-294f044d21a8/action" status: 202 len: 0 microversion: 2.1 time: 0.661746 Aug 23 07:16:27.808420 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 246/515] 10.222.0.17 () {60 vars in 1278 bytes} [Tue Aug 23 07:16:27 2022] POST /compute/v2.1/servers/f7783f88-5770-4ca3-a5cf-294f044d21a8/action => generated 0 bytes in 663 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 07:16:27.817131 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-9a2ac04d-3e40-4ef2-81ff-a9247ed13e19 tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] Calling method '>' {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:16:27.817959 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.compute.api [None req-9a2ac04d-3e40-4ef2-81ff-a9247ed13e19 tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] [instance: f7783f88-5770-4ca3-a5cf-294f044d21a8] Fetching instance by UUID {{(pid=120799) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:16:27.825265 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-9a2ac04d-3e40-4ef2-81ff-a9247ed13e19 tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:16:27.828182 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-9a2ac04d-3e40-4ef2-81ff-a9247ed13e19 tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:16:27.828861 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-9a2ac04d-3e40-4ef2-81ff-a9247ed13e19 tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:16:27.829893 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-9a2ac04d-3e40-4ef2-81ff-a9247ed13e19 tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:16:27.830659 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-9a2ac04d-3e40-4ef2-81ff-a9247ed13e19 tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:16:27.831285 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-9a2ac04d-3e40-4ef2-81ff-a9247ed13e19 tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:16:28.071017 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [req-d4f0adc6-dfb0-47c0-8476-3c4bfb65f5e2 req-b80fe4ef-7bd3-4e81-a3bf-5d81e1e867ca service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f7783f88-5770-4ca3-a5cf-294f044d21a8", "tag": "7ccdc22f-1e2b-4dd9-8ea3-858bf0e435cf"}]} {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 07:16:28.081464 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [req-d4f0adc6-dfb0-47c0-8476-3c4bfb65f5e2 req-b80fe4ef-7bd3-4e81-a3bf-5d81e1e867ca service nova] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:16:28.082161 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [req-d4f0adc6-dfb0-47c0-8476-3c4bfb65f5e2 req-b80fe4ef-7bd3-4e81-a3bf-5d81e1e867ca service nova] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:16:28.082803 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [req-d4f0adc6-dfb0-47c0-8476-3c4bfb65f5e2 req-b80fe4ef-7bd3-4e81-a3bf-5d81e1e867ca service nova] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:16:28.095250 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.compute.server_external_events [req-d4f0adc6-dfb0-47c0-8476-3c4bfb65f5e2 req-b80fe4ef-7bd3-4e81-a3bf-5d81e1e867ca service nova] Creating event network-changed:7ccdc22f-1e2b-4dd9-8ea3-858bf0e435cf for instance f7783f88-5770-4ca3-a5cf-294f044d21a8 on hv-cinder-85409 Aug 23 07:16:28.099624 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.policy [None req-9a2ac04d-3e40-4ef2-81ff-a9247ed13e19 tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5e8c33634b246319de495d269c05124', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9466597900d4a3ca60a2ef8b7678c87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120799) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:16:28.101280 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [req-d4f0adc6-dfb0-47c0-8476-3c4bfb65f5e2 req-b80fe4ef-7bd3-4e81-a3bf-5d81e1e867ca service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034404 Aug 23 07:16:28.102410 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 247/516] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Aug 23 07:16:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 07:16:28.110539 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-9a2ac04d-3e40-4ef2-81ff-a9247ed13e19 tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] 10.222.0.17 "GET /compute/v2.1/servers/f7783f88-5770-4ca3-a5cf-294f044d21a8" status: 200 len: 1640 microversion: 2.1 time: 0.297896 Aug 23 07:16:28.111376 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 270/517] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:16:27 2022] GET /compute/v2.1/servers/f7783f88-5770-4ca3-a5cf-294f044d21a8 => generated 1640 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:16:28.166525 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-9dfca474-e1ac-4dbe-90de-beb26932a40c tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Calling method '>' {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:16:28.167309 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.compute.api [None req-9dfca474-e1ac-4dbe-90de-beb26932a40c tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] [instance: b9418fe6-a57e-4a99-becb-19a4d3a52da1] Fetching instance by UUID {{(pid=120798) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:16:28.175295 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-9dfca474-e1ac-4dbe-90de-beb26932a40c tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:16:28.175965 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-9dfca474-e1ac-4dbe-90de-beb26932a40c tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:16:28.176482 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-9dfca474-e1ac-4dbe-90de-beb26932a40c tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:16:28.177550 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-9dfca474-e1ac-4dbe-90de-beb26932a40c tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:16:28.178164 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-9dfca474-e1ac-4dbe-90de-beb26932a40c tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:16:28.178588 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-9dfca474-e1ac-4dbe-90de-beb26932a40c tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:16:28.385460 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.policy [None req-9dfca474-e1ac-4dbe-90de-beb26932a40c tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64d54cb95b264c18b45d90822507fae1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135367be6e3f4b3d965ee0d99fdca524', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120798) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:16:28.397382 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [None req-9dfca474-e1ac-4dbe-90de-beb26932a40c tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] 10.222.0.17 "GET /compute/v2.1/servers/b9418fe6-a57e-4a99-becb-19a4d3a52da1" status: 200 len: 1736 microversion: 2.1 time: 0.235551 Aug 23 07:16:28.398298 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 248/518] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:16:28 2022] GET /compute/v2.1/servers/b9418fe6-a57e-4a99-becb-19a4d3a52da1 => generated 1736 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:16:29.418509 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-cec6b4e3-da5f-402e-b1fb-c5ed872063bd tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Calling method '>' {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:16:29.419089 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.compute.api [None req-cec6b4e3-da5f-402e-b1fb-c5ed872063bd tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] [instance: b9418fe6-a57e-4a99-becb-19a4d3a52da1] Fetching instance by UUID {{(pid=120799) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:16:29.425902 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-cec6b4e3-da5f-402e-b1fb-c5ed872063bd tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:16:29.426383 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-cec6b4e3-da5f-402e-b1fb-c5ed872063bd tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:16:29.426811 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-cec6b4e3-da5f-402e-b1fb-c5ed872063bd tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:16:29.427550 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-cec6b4e3-da5f-402e-b1fb-c5ed872063bd tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:16:29.427997 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-cec6b4e3-da5f-402e-b1fb-c5ed872063bd tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:16:29.428407 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-cec6b4e3-da5f-402e-b1fb-c5ed872063bd tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:16:29.977049 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.policy [None req-cec6b4e3-da5f-402e-b1fb-c5ed872063bd tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64d54cb95b264c18b45d90822507fae1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135367be6e3f4b3d965ee0d99fdca524', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120799) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:16:29.986144 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-cec6b4e3-da5f-402e-b1fb-c5ed872063bd tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] 10.222.0.17 "GET /compute/v2.1/servers/b9418fe6-a57e-4a99-becb-19a4d3a52da1" status: 200 len: 1736 microversion: 2.1 time: 0.571515 Aug 23 07:16:29.986952 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 271/519] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:16:29 2022] GET /compute/v2.1/servers/b9418fe6-a57e-4a99-becb-19a4d3a52da1 => generated 1736 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 07:16:30.188832 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [req-625a7fe8-2fd7-423c-8140-fbfcb0f497aa req-79b39e14-5654-40fc-8812-98b1615d6cd1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "74919866-69a0-460a-999a-b344d1cbc336", "tag": "4f3c189e-8afd-49e5-a4c7-60407c13730e"}]} {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 07:16:30.199058 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [req-625a7fe8-2fd7-423c-8140-fbfcb0f497aa req-79b39e14-5654-40fc-8812-98b1615d6cd1 service nova] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:16:30.199645 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [req-625a7fe8-2fd7-423c-8140-fbfcb0f497aa req-79b39e14-5654-40fc-8812-98b1615d6cd1 service nova] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:16:30.200140 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [req-625a7fe8-2fd7-423c-8140-fbfcb0f497aa req-79b39e14-5654-40fc-8812-98b1615d6cd1 service nova] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:16:30.211858 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.compute.server_external_events [req-625a7fe8-2fd7-423c-8140-fbfcb0f497aa req-79b39e14-5654-40fc-8812-98b1615d6cd1 service nova] Creating event network-changed:4f3c189e-8afd-49e5-a4c7-60407c13730e for instance 74919866-69a0-460a-999a-b344d1cbc336 on hv-cinder-85409 Aug 23 07:16:30.217557 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [req-625a7fe8-2fd7-423c-8140-fbfcb0f497aa req-79b39e14-5654-40fc-8812-98b1615d6cd1 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031900 Aug 23 07:16:30.218269 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 249/520] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Aug 23 07:16:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 07:16:31.008423 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-f17b0ba7-d375-4d3f-ae1c-5a25ebba7413 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Calling method '>' {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:16:31.009126 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.compute.api [None req-f17b0ba7-d375-4d3f-ae1c-5a25ebba7413 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] [instance: b9418fe6-a57e-4a99-becb-19a4d3a52da1] Fetching instance by UUID {{(pid=120799) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:16:31.017340 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-f17b0ba7-d375-4d3f-ae1c-5a25ebba7413 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:16:31.018156 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-f17b0ba7-d375-4d3f-ae1c-5a25ebba7413 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:16:31.018778 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-f17b0ba7-d375-4d3f-ae1c-5a25ebba7413 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:16:31.019570 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-f17b0ba7-d375-4d3f-ae1c-5a25ebba7413 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:16:31.020073 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-f17b0ba7-d375-4d3f-ae1c-5a25ebba7413 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:16:31.020695 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-f17b0ba7-d375-4d3f-ae1c-5a25ebba7413 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:16:31.163836 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.policy [None req-f17b0ba7-d375-4d3f-ae1c-5a25ebba7413 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64d54cb95b264c18b45d90822507fae1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135367be6e3f4b3d965ee0d99fdca524', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120799) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:16:31.172483 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-f17b0ba7-d375-4d3f-ae1c-5a25ebba7413 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] 10.222.0.17 "GET /compute/v2.1/servers/b9418fe6-a57e-4a99-becb-19a4d3a52da1" status: 200 len: 1716 microversion: 2.1 time: 0.168258 Aug 23 07:16:31.173569 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 272/521] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:16:31 2022] GET /compute/v2.1/servers/b9418fe6-a57e-4a99-becb-19a4d3a52da1 => generated 1716 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:16:31.292299 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-0c209063-b57d-45e6-8d26-690411a8cfe0 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Calling method '>' {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:16:31.292853 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.compute.api [None req-0c209063-b57d-45e6-8d26-690411a8cfe0 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] [instance: b9418fe6-a57e-4a99-becb-19a4d3a52da1] Fetching instance by UUID {{(pid=120798) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:16:31.299939 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-0c209063-b57d-45e6-8d26-690411a8cfe0 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:16:31.300408 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-0c209063-b57d-45e6-8d26-690411a8cfe0 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:16:31.300834 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-0c209063-b57d-45e6-8d26-690411a8cfe0 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:16:31.301503 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-0c209063-b57d-45e6-8d26-690411a8cfe0 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:16:31.301938 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-0c209063-b57d-45e6-8d26-690411a8cfe0 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:16:31.302335 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-0c209063-b57d-45e6-8d26-690411a8cfe0 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:16:31.435589 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.wsgi [None req-0c209063-b57d-45e6-8d26-690411a8cfe0 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] HTTP exception thrown: Cannot 'detach_volume' instance b9418fe6-a57e-4a99-becb-19a4d3a52da1 while it is in vm_state rescued Aug 23 07:16:31.437217 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-0c209063-b57d-45e6-8d26-690411a8cfe0 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Request method failure captured: Aug 23 07:16:31.437217 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: request: DELETE /compute/v2.1/servers/b9418fe6-a57e-4a99-becb-19a4d3a52da1/os-volume_attachments/add11750-9e29-4afe-a3ac-ef016ecf7161 HTTP/1.1 Aug 23 07:16:31.437217 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: Accept: application/json Aug 23 07:16:31.437217 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: Accept-Encoding: identity Aug 23 07:16:31.437217 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: Connection: close Aug 23 07:16:31.437217 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: Content-Length: 0 Aug 23 07:16:31.437217 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: Content-Type: application/json Aug 23 07:16:31.437217 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: Host: 10.222.0.17 Aug 23 07:16:31.437217 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: Openstack-System-Scope: None Aug 23 07:16:31.437217 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: User-Agent: python-urllib3/1.26.11 Aug 23 07:16:31.437217 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-Auth-Token: gAAAAABjBH3RTnj580A9ihENlvyGo9Owk2endPDkKW0IbgiaI59nvL65tV9bcHDATbv_TF-j5yNJo86nqcfzcR4EFG9DSwxV6zk_8rKGHN_TbC5GCjcEeyjsLvDIF_O9EwwjUk3-u0A9pdTbyVuUJI9H9X2YTFvkkjoRacmsfuB_sypDT5kcQO8 Aug 23 07:16:31.437217 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-Domain-Id: None Aug 23 07:16:31.437217 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-Domain-Name: None Aug 23 07:16:31.437217 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-Identity-Status: Confirmed Aug 23 07:16:31.437217 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-Is-Admin-Project: True Aug 23 07:16:31.437217 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-Project-Domain-Id: default Aug 23 07:16:31.437217 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-Project-Domain-Name: Default Aug 23 07:16:31.437217 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-Project-Id: 135367be6e3f4b3d965ee0d99fdca524 Aug 23 07:16:31.437217 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-260324431 Aug 23 07:16:31.437217 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-Role: reader,member Aug 23 07:16:31.437217 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-Roles: reader,member Aug 23 07:16:31.438804 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/135367be6e3f4b3d965ee0d99fdca524"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/135367be6e3f4b3d965ee0d99fdca524"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_135367be6e3f4b3d965ee0d99fdca524"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/135367be6e3f4b3d965ee0d99fdca524"}]}] Aug 23 07:16:31.438804 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-Tenant: tempest-ServerRescueNegativeTestJSON-260324431 Aug 23 07:16:31.438804 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-Tenant-Id: 135367be6e3f4b3d965ee0d99fdca524 Aug 23 07:16:31.438804 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-260324431 Aug 23 07:16:31.438804 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-User: tempest-ServerRescueNegativeTestJSON-260324431-project Aug 23 07:16:31.438804 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-User-Domain-Id: default Aug 23 07:16:31.438804 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-User-Domain-Name: Default Aug 23 07:16:31.438804 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-User-Id: 64d54cb95b264c18b45d90822507fae1 Aug 23 07:16:31.438804 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-User-Name: tempest-ServerRescueNegativeTestJSON-260324431-project Aug 23 07:16:31.438804 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: method: > Aug 23 07:16:31.438804 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: exception: Cannot 'detach_volume' instance b9418fe6-a57e-4a99-becb-19a4d3a52da1 while it is in vm_state rescued Aug 23 07:16:31.439709 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: action_args: {'server_id': 'b9418fe6-a57e-4a99-becb-19a4d3a52da1', 'id': 'add11750-9e29-4afe-a3ac-ef016ecf7161'} Aug 23 07:16:31.439709 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 07:16:31.439709 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 07:16:31.439709 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Aug 23 07:16:31.439709 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Aug 23 07:16:31.439709 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 23 07:16:31.439709 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 23 07:16:31.439709 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 23 07:16:31.439709 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 23 07:16:31.439709 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance b9418fe6-a57e-4a99-becb-19a4d3a52da1 in vm_state rescued. Cannot detach_volume while the instance is in this state. Aug 23 07:16:31.439709 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi Aug 23 07:16:31.439709 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 07:16:31.439709 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi Aug 23 07:16:31.439709 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 07:16:31.439709 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 07:16:31.439709 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 07:16:31.439709 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 07:16:31.439709 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 07:16:31.439709 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 07:16:31.439709 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 07:16:31.441244 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Aug 23 07:16:31.441244 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 23 07:16:31.441244 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 23 07:16:31.441244 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 23 07:16:31.441244 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance b9418fe6-a57e-4a99-becb-19a4d3a52da1 while it is in vm_state rescued Aug 23 07:16:31.441244 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi Aug 23 07:16:31.441244 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 07:16:31.441244 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi Aug 23 07:16:31.441244 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 07:16:31.441244 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 07:16:31.441244 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 07:16:31.441244 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 07:16:31.441244 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 07:16:31.441244 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance b9418fe6-a57e-4a99-becb-19a4d3a52da1 while it is in vm_state rescued Aug 23 07:16:31.441244 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi Aug 23 07:16:31.441244 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-0c209063-b57d-45e6-8d26-690411a8cfe0 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Returning 409 to user: Cannot 'detach_volume' instance b9418fe6-a57e-4a99-becb-19a4d3a52da1 while it is in vm_state rescued {{(pid=120798) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 07:16:31.442401 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [None req-0c209063-b57d-45e6-8d26-690411a8cfe0 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] 10.222.0.17 "DELETE /compute/v2.1/servers/b9418fe6-a57e-4a99-becb-19a4d3a52da1/os-volume_attachments/add11750-9e29-4afe-a3ac-ef016ecf7161" status: 409 len: 152 microversion: 2.1 time: 0.151556 Aug 23 07:16:31.442401 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 250/522] 10.222.0.17 () {58 vars in 1416 bytes} [Tue Aug 23 07:16:31 2022] DELETE /compute/v2.1/servers/b9418fe6-a57e-4a99-becb-19a4d3a52da1/os-volume_attachments/add11750-9e29-4afe-a3ac-ef016ecf7161 => generated 152 bytes in 153 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 23 07:16:31.448568 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-9dde9a0b-3f94-4aee-8812-ef9942e55114 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 07:16:31.449099 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.compute.api [None req-9dde9a0b-3f94-4aee-8812-ef9942e55114 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] [instance: b9418fe6-a57e-4a99-becb-19a4d3a52da1] Fetching instance by UUID {{(pid=120799) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:16:31.455468 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-9dde9a0b-3f94-4aee-8812-ef9942e55114 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:16:31.455973 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-9dde9a0b-3f94-4aee-8812-ef9942e55114 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:16:31.456408 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-9dde9a0b-3f94-4aee-8812-ef9942e55114 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:16:31.457089 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-9dde9a0b-3f94-4aee-8812-ef9942e55114 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:16:31.457533 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-9dde9a0b-3f94-4aee-8812-ef9942e55114 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:16:31.457953 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-9dde9a0b-3f94-4aee-8812-ef9942e55114 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:16:31.529557 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-9dde9a0b-3f94-4aee-8812-ef9942e55114 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] 10.222.0.17 "POST /compute/v2.1/servers/b9418fe6-a57e-4a99-becb-19a4d3a52da1/action" status: 202 len: 0 microversion: 2.1 time: 0.084581 Aug 23 07:16:31.530084 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 273/523] 10.222.0.17 () {60 vars in 1278 bytes} [Tue Aug 23 07:16:31 2022] POST /compute/v2.1/servers/b9418fe6-a57e-4a99-becb-19a4d3a52da1/action => generated 0 bytes in 86 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 07:16:31.539193 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-f121e660-2914-4640-849b-2e866d7069ca tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Calling method '>' {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:16:31.539961 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.compute.api [None req-f121e660-2914-4640-849b-2e866d7069ca tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] [instance: b9418fe6-a57e-4a99-becb-19a4d3a52da1] Fetching instance by UUID {{(pid=120798) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:16:31.546267 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-f121e660-2914-4640-849b-2e866d7069ca tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:16:31.546786 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-f121e660-2914-4640-849b-2e866d7069ca tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:16:31.547271 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-f121e660-2914-4640-849b-2e866d7069ca tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:16:31.548136 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-f121e660-2914-4640-849b-2e866d7069ca tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:16:31.548610 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-f121e660-2914-4640-849b-2e866d7069ca tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:16:31.549048 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-f121e660-2914-4640-849b-2e866d7069ca tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:16:31.682738 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.policy [None req-f121e660-2914-4640-849b-2e866d7069ca tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64d54cb95b264c18b45d90822507fae1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135367be6e3f4b3d965ee0d99fdca524', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120798) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:16:31.691930 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [None req-f121e660-2914-4640-849b-2e866d7069ca tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] 10.222.0.17 "GET /compute/v2.1/servers/b9418fe6-a57e-4a99-becb-19a4d3a52da1" status: 200 len: 1724 microversion: 2.1 time: 0.157306 Aug 23 07:16:31.692536 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 251/524] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:16:31 2022] GET /compute/v2.1/servers/b9418fe6-a57e-4a99-becb-19a4d3a52da1 => generated 1724 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:16:32.715908 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-8e6307b2-57af-46e1-a019-b8dbbc49e6ef tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Calling method '>' {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:16:32.716586 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.compute.api [None req-8e6307b2-57af-46e1-a019-b8dbbc49e6ef tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] [instance: b9418fe6-a57e-4a99-becb-19a4d3a52da1] Fetching instance by UUID {{(pid=120799) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:16:32.723209 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-8e6307b2-57af-46e1-a019-b8dbbc49e6ef tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:16:32.723711 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-8e6307b2-57af-46e1-a019-b8dbbc49e6ef tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:16:32.724134 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-8e6307b2-57af-46e1-a019-b8dbbc49e6ef tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:16:32.724835 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-8e6307b2-57af-46e1-a019-b8dbbc49e6ef tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:16:32.725276 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-8e6307b2-57af-46e1-a019-b8dbbc49e6ef tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:16:32.725684 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-8e6307b2-57af-46e1-a019-b8dbbc49e6ef tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:16:32.861992 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.policy [None req-8e6307b2-57af-46e1-a019-b8dbbc49e6ef tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64d54cb95b264c18b45d90822507fae1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135367be6e3f4b3d965ee0d99fdca524', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120799) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:16:32.870619 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-8e6307b2-57af-46e1-a019-b8dbbc49e6ef tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] 10.222.0.17 "GET /compute/v2.1/servers/b9418fe6-a57e-4a99-becb-19a4d3a52da1" status: 200 len: 1724 microversion: 2.1 time: 0.159484 Aug 23 07:16:32.871194 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 274/525] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:16:32 2022] GET /compute/v2.1/servers/b9418fe6-a57e-4a99-becb-19a4d3a52da1 => generated 1724 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:16:33.892658 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-cfcf5c2b-0cee-4d27-b8af-523e4ea17835 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Calling method '>' {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:16:33.893312 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.compute.api [None req-cfcf5c2b-0cee-4d27-b8af-523e4ea17835 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] [instance: b9418fe6-a57e-4a99-becb-19a4d3a52da1] Fetching instance by UUID {{(pid=120798) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:16:33.896849 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG dbcounter [-] [120798] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=120798) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:16:33.900458 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-cfcf5c2b-0cee-4d27-b8af-523e4ea17835 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:16:33.900932 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-cfcf5c2b-0cee-4d27-b8af-523e4ea17835 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:16:33.901332 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-cfcf5c2b-0cee-4d27-b8af-523e4ea17835 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:16:33.902035 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-cfcf5c2b-0cee-4d27-b8af-523e4ea17835 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:16:33.902475 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-cfcf5c2b-0cee-4d27-b8af-523e4ea17835 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:16:33.902888 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-cfcf5c2b-0cee-4d27-b8af-523e4ea17835 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:16:34.048390 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.policy [None req-cfcf5c2b-0cee-4d27-b8af-523e4ea17835 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64d54cb95b264c18b45d90822507fae1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135367be6e3f4b3d965ee0d99fdca524', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120798) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:16:34.056983 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [None req-cfcf5c2b-0cee-4d27-b8af-523e4ea17835 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] 10.222.0.17 "GET /compute/v2.1/servers/b9418fe6-a57e-4a99-becb-19a4d3a52da1" status: 200 len: 1724 microversion: 2.1 time: 0.168424 Aug 23 07:16:34.057550 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 252/526] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:16:33 2022] GET /compute/v2.1/servers/b9418fe6-a57e-4a99-becb-19a4d3a52da1 => generated 1724 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:16:35.082222 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-6d66975f-ae4e-448a-b093-3ded6a7a8f2b tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Calling method '>' {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:16:35.083086 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.compute.api [None req-6d66975f-ae4e-448a-b093-3ded6a7a8f2b tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] [instance: b9418fe6-a57e-4a99-becb-19a4d3a52da1] Fetching instance by UUID {{(pid=120799) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:16:35.093330 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-6d66975f-ae4e-448a-b093-3ded6a7a8f2b tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:16:35.093804 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-6d66975f-ae4e-448a-b093-3ded6a7a8f2b tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:16:35.094219 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-6d66975f-ae4e-448a-b093-3ded6a7a8f2b tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:16:35.094902 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-6d66975f-ae4e-448a-b093-3ded6a7a8f2b tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:16:35.095341 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-6d66975f-ae4e-448a-b093-3ded6a7a8f2b tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:16:35.095923 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-6d66975f-ae4e-448a-b093-3ded6a7a8f2b tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:16:35.228668 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.policy [None req-6d66975f-ae4e-448a-b093-3ded6a7a8f2b tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64d54cb95b264c18b45d90822507fae1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135367be6e3f4b3d965ee0d99fdca524', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120799) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:16:35.239635 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-6d66975f-ae4e-448a-b093-3ded6a7a8f2b tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] 10.222.0.17 "GET /compute/v2.1/servers/b9418fe6-a57e-4a99-becb-19a4d3a52da1" status: 200 len: 1730 microversion: 2.1 time: 0.163687 Aug 23 07:16:35.240420 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 275/527] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:16:35 2022] GET /compute/v2.1/servers/b9418fe6-a57e-4a99-becb-19a4d3a52da1 => generated 1730 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:16:35.260259 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-3bb8f9d6-c377-43c5-8c2c-641e356d28d1 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Calling method '>' {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:16:35.260810 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.compute.api [None req-3bb8f9d6-c377-43c5-8c2c-641e356d28d1 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] [instance: b9418fe6-a57e-4a99-becb-19a4d3a52da1] Fetching instance by UUID {{(pid=120798) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:16:35.267541 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-3bb8f9d6-c377-43c5-8c2c-641e356d28d1 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:16:35.268032 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-3bb8f9d6-c377-43c5-8c2c-641e356d28d1 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:16:35.268462 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-3bb8f9d6-c377-43c5-8c2c-641e356d28d1 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:16:35.269150 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-3bb8f9d6-c377-43c5-8c2c-641e356d28d1 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:16:35.269594 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-3bb8f9d6-c377-43c5-8c2c-641e356d28d1 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:16:35.269993 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-3bb8f9d6-c377-43c5-8c2c-641e356d28d1 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:16:35.356983 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [None req-3bb8f9d6-c377-43c5-8c2c-641e356d28d1 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] 10.222.0.17 "GET /compute/v2.1/servers/b9418fe6-a57e-4a99-becb-19a4d3a52da1/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.100603 Aug 23 07:16:35.357618 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 253/528] 10.222.0.17 () {58 vars in 1275 bytes} [Tue Aug 23 07:16:35 2022] GET /compute/v2.1/servers/b9418fe6-a57e-4a99-becb-19a4d3a52da1/os-interface => generated 285 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 07:16:36.238445 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [req-5adb4078-6cfd-4013-bd12-2a2e43f4ce85 req-e58a849d-94d4-4762-91e0-6a280873693f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b9418fe6-a57e-4a99-becb-19a4d3a52da1", "tag": "13257b29-baec-4cb2-9910-64f78a6db6ba"}]} {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 07:16:36.249414 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [req-5adb4078-6cfd-4013-bd12-2a2e43f4ce85 req-e58a849d-94d4-4762-91e0-6a280873693f service nova] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:16:36.249959 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [req-5adb4078-6cfd-4013-bd12-2a2e43f4ce85 req-e58a849d-94d4-4762-91e0-6a280873693f service nova] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:16:36.250315 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [req-5adb4078-6cfd-4013-bd12-2a2e43f4ce85 req-e58a849d-94d4-4762-91e0-6a280873693f service nova] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:16:36.261788 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.compute.server_external_events [req-5adb4078-6cfd-4013-bd12-2a2e43f4ce85 req-e58a849d-94d4-4762-91e0-6a280873693f service nova] Creating event network-changed:13257b29-baec-4cb2-9910-64f78a6db6ba for instance b9418fe6-a57e-4a99-becb-19a4d3a52da1 on hv-cinder-85409 Aug 23 07:16:36.269088 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [req-5adb4078-6cfd-4013-bd12-2a2e43f4ce85 req-e58a849d-94d4-4762-91e0-6a280873693f service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034400 Aug 23 07:16:36.270529 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 276/529] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Aug 23 07:16:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 07:16:38.291561 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [req-866c3141-37f5-4315-aa7d-91189c5f2c4d req-9c043204-6371-4baf-898b-acc9f275640f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b9418fe6-a57e-4a99-becb-19a4d3a52da1", "tag": "13257b29-baec-4cb2-9910-64f78a6db6ba"}]} {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 07:16:38.303018 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [req-866c3141-37f5-4315-aa7d-91189c5f2c4d req-9c043204-6371-4baf-898b-acc9f275640f service nova] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:16:38.303525 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [req-866c3141-37f5-4315-aa7d-91189c5f2c4d req-9c043204-6371-4baf-898b-acc9f275640f service nova] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:16:38.303956 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [req-866c3141-37f5-4315-aa7d-91189c5f2c4d req-9c043204-6371-4baf-898b-acc9f275640f service nova] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:16:38.316259 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.compute.server_external_events [req-866c3141-37f5-4315-aa7d-91189c5f2c4d req-9c043204-6371-4baf-898b-acc9f275640f service nova] Creating event network-changed:13257b29-baec-4cb2-9910-64f78a6db6ba for instance b9418fe6-a57e-4a99-becb-19a4d3a52da1 on hv-cinder-85409 Aug 23 07:16:38.321615 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [req-866c3141-37f5-4315-aa7d-91189c5f2c4d req-9c043204-6371-4baf-898b-acc9f275640f service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036772 Aug 23 07:16:38.322185 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 254/530] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Aug 23 07:16:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 07:17:00.447795 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-a86a0a8e-4304-4e76-b597-6b35650fc2fc tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 07:17:00.450896 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.compute.api [None req-a86a0a8e-4304-4e76-b597-6b35650fc2fc tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] [instance: f7783f88-5770-4ca3-a5cf-294f044d21a8] Fetching instance by UUID {{(pid=120799) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:17:00.454939 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG dbcounter [-] [120799] Writing DB stats nova_api:SELECT=16 {{(pid=120799) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:17:00.455826 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG dbcounter [-] [120799] Writing DB stats nova_cell1:SELECT=54,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120799) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:17:00.465000 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-a86a0a8e-4304-4e76-b597-6b35650fc2fc tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:17:00.465631 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-a86a0a8e-4304-4e76-b597-6b35650fc2fc tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:17:00.466202 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-a86a0a8e-4304-4e76-b597-6b35650fc2fc tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:17:00.467694 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-a86a0a8e-4304-4e76-b597-6b35650fc2fc tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:17:00.468144 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-a86a0a8e-4304-4e76-b597-6b35650fc2fc tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:17:00.468561 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-a86a0a8e-4304-4e76-b597-6b35650fc2fc tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:17:00.553748 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-a86a0a8e-4304-4e76-b597-6b35650fc2fc tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] 10.222.0.17 "POST /compute/v2.1/servers/f7783f88-5770-4ca3-a5cf-294f044d21a8/action" status: 202 len: 0 microversion: 2.1 time: 0.111585 Aug 23 07:17:00.554373 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 277/531] 10.222.0.17 () {60 vars in 1278 bytes} [Tue Aug 23 07:17:00 2022] POST /compute/v2.1/servers/f7783f88-5770-4ca3-a5cf-294f044d21a8/action => generated 0 bytes in 114 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 07:17:00.560673 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG dbcounter [-] [120798] Writing DB stats nova_api:SELECT=4 {{(pid=120798) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:17:00.561924 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG dbcounter [-] [120798] Writing DB stats nova_cell1:SELECT=48 {{(pid=120798) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:17:00.566164 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-f1d4c71e-9943-4d51-b391-5e7233002f9e tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] Calling method '>' {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:17:00.566859 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.compute.api [None req-f1d4c71e-9943-4d51-b391-5e7233002f9e tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] [instance: f7783f88-5770-4ca3-a5cf-294f044d21a8] Fetching instance by UUID {{(pid=120798) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:17:00.574245 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-f1d4c71e-9943-4d51-b391-5e7233002f9e tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:17:00.574717 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-f1d4c71e-9943-4d51-b391-5e7233002f9e tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:17:00.575140 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-f1d4c71e-9943-4d51-b391-5e7233002f9e tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:17:00.575874 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-f1d4c71e-9943-4d51-b391-5e7233002f9e tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:17:00.576397 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-f1d4c71e-9943-4d51-b391-5e7233002f9e tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:17:00.576925 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-f1d4c71e-9943-4d51-b391-5e7233002f9e tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:17:00.728379 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.policy [None req-f1d4c71e-9943-4d51-b391-5e7233002f9e tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5e8c33634b246319de495d269c05124', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9466597900d4a3ca60a2ef8b7678c87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120798) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:17:00.736718 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [None req-f1d4c71e-9943-4d51-b391-5e7233002f9e tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] 10.222.0.17 "GET /compute/v2.1/servers/f7783f88-5770-4ca3-a5cf-294f044d21a8" status: 200 len: 1751 microversion: 2.1 time: 0.177900 Aug 23 07:17:00.737278 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 255/532] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:17:00 2022] GET /compute/v2.1/servers/f7783f88-5770-4ca3-a5cf-294f044d21a8 => generated 1751 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:17:01.767985 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-f206c6e4-fd86-4fff-880f-666a30973dc1 tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] Calling method '>' {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:17:01.768818 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.compute.api [None req-f206c6e4-fd86-4fff-880f-666a30973dc1 tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] [instance: f7783f88-5770-4ca3-a5cf-294f044d21a8] Fetching instance by UUID {{(pid=120799) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:17:01.777184 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-f206c6e4-fd86-4fff-880f-666a30973dc1 tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:17:01.777870 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-f206c6e4-fd86-4fff-880f-666a30973dc1 tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:17:01.778447 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-f206c6e4-fd86-4fff-880f-666a30973dc1 tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:17:01.779291 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-f206c6e4-fd86-4fff-880f-666a30973dc1 tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:17:01.779895 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-f206c6e4-fd86-4fff-880f-666a30973dc1 tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:17:01.780424 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-f206c6e4-fd86-4fff-880f-666a30973dc1 tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:17:01.940414 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.policy [None req-f206c6e4-fd86-4fff-880f-666a30973dc1 tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5e8c33634b246319de495d269c05124', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9466597900d4a3ca60a2ef8b7678c87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120799) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:17:01.948979 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-f206c6e4-fd86-4fff-880f-666a30973dc1 tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] 10.222.0.17 "GET /compute/v2.1/servers/f7783f88-5770-4ca3-a5cf-294f044d21a8" status: 200 len: 1756 microversion: 2.1 time: 0.187755 Aug 23 07:17:01.949523 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 278/533] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:17:01 2022] GET /compute/v2.1/servers/f7783f88-5770-4ca3-a5cf-294f044d21a8 => generated 1756 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:17:02.978372 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-083db4ea-4a77-442d-b11a-ce6307bd3da6 tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] Calling method '>' {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:17:02.979585 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.compute.api [None req-083db4ea-4a77-442d-b11a-ce6307bd3da6 tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] [instance: f7783f88-5770-4ca3-a5cf-294f044d21a8] Fetching instance by UUID {{(pid=120798) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:17:02.989443 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-083db4ea-4a77-442d-b11a-ce6307bd3da6 tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:17:02.989969 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-083db4ea-4a77-442d-b11a-ce6307bd3da6 tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:17:02.990482 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-083db4ea-4a77-442d-b11a-ce6307bd3da6 tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:17:02.991239 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-083db4ea-4a77-442d-b11a-ce6307bd3da6 tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:17:02.991771 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-083db4ea-4a77-442d-b11a-ce6307bd3da6 tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:17:02.992320 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-083db4ea-4a77-442d-b11a-ce6307bd3da6 tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:17:03.153846 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.policy [None req-083db4ea-4a77-442d-b11a-ce6307bd3da6 tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5e8c33634b246319de495d269c05124', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9466597900d4a3ca60a2ef8b7678c87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120798) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:17:03.166777 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [None req-083db4ea-4a77-442d-b11a-ce6307bd3da6 tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] 10.222.0.17 "GET /compute/v2.1/servers/f7783f88-5770-4ca3-a5cf-294f044d21a8" status: 200 len: 1756 microversion: 2.1 time: 0.197646 Aug 23 07:17:03.167633 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 256/534] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:17:02 2022] GET /compute/v2.1/servers/f7783f88-5770-4ca3-a5cf-294f044d21a8 => generated 1756 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:17:03.938129 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-5e97ad8f-8e37-4ad2-9cf3-aea80fa8efc6 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Calling method '>' {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:17:03.938714 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.compute.api [None req-5e97ad8f-8e37-4ad2-9cf3-aea80fa8efc6 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] [instance: 2276f5b3-e71c-42f5-b540-5535a8aa1d48] Fetching instance by UUID {{(pid=120799) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:17:03.945432 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-5e97ad8f-8e37-4ad2-9cf3-aea80fa8efc6 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:17:03.945908 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-5e97ad8f-8e37-4ad2-9cf3-aea80fa8efc6 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:17:03.946339 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-5e97ad8f-8e37-4ad2-9cf3-aea80fa8efc6 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:17:03.947020 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-5e97ad8f-8e37-4ad2-9cf3-aea80fa8efc6 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:17:03.947484 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-5e97ad8f-8e37-4ad2-9cf3-aea80fa8efc6 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:17:03.947928 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-5e97ad8f-8e37-4ad2-9cf3-aea80fa8efc6 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:17:03.971743 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-5e97ad8f-8e37-4ad2-9cf3-aea80fa8efc6 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] 10.222.0.17 "GET /compute/v2.1/servers/2276f5b3-e71c-42f5-b540-5535a8aa1d48/ips" status: 200 len: 149 microversion: 2.1 time: 0.037640 Aug 23 07:17:03.972294 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 279/535] 10.222.0.17 () {58 vars in 1248 bytes} [Tue Aug 23 07:17:03 2022] GET /compute/v2.1/servers/2276f5b3-e71c-42f5-b540-5535a8aa1d48/ips => generated 149 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 07:17:04.193002 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-15965b6f-23bd-4cf9-9fba-e41452554447 tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] Calling method '>' {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:17:04.193611 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.compute.api [None req-15965b6f-23bd-4cf9-9fba-e41452554447 tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] [instance: f7783f88-5770-4ca3-a5cf-294f044d21a8] Fetching instance by UUID {{(pid=120798) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:17:04.200493 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-15965b6f-23bd-4cf9-9fba-e41452554447 tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:17:04.201081 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-15965b6f-23bd-4cf9-9fba-e41452554447 tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:17:04.201710 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-15965b6f-23bd-4cf9-9fba-e41452554447 tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:17:04.202363 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-15965b6f-23bd-4cf9-9fba-e41452554447 tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:17:04.202626 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-15965b6f-23bd-4cf9-9fba-e41452554447 tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:17:04.203041 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-15965b6f-23bd-4cf9-9fba-e41452554447 tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:17:04.364456 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.policy [None req-15965b6f-23bd-4cf9-9fba-e41452554447 tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5e8c33634b246319de495d269c05124', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9466597900d4a3ca60a2ef8b7678c87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120798) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:17:04.374686 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [None req-15965b6f-23bd-4cf9-9fba-e41452554447 tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] 10.222.0.17 "GET /compute/v2.1/servers/f7783f88-5770-4ca3-a5cf-294f044d21a8" status: 200 len: 1756 microversion: 2.1 time: 0.184987 Aug 23 07:17:04.374686 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 257/536] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:17:04 2022] GET /compute/v2.1/servers/f7783f88-5770-4ca3-a5cf-294f044d21a8 => generated 1756 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:17:05.342498 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-9f9dab33-83fc-4467-89fc-ccc23bc0e1e7 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7583b3dc-7620-4538-9f0c-06933fca8a51"}} {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 07:17:05.344827 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.compute.api [None req-9f9dab33-83fc-4467-89fc-ccc23bc0e1e7 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] [instance: 2276f5b3-e71c-42f5-b540-5535a8aa1d48] Fetching instance by UUID {{(pid=120799) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:17:05.351328 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-9f9dab33-83fc-4467-89fc-ccc23bc0e1e7 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:17:05.351836 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-9f9dab33-83fc-4467-89fc-ccc23bc0e1e7 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:17:05.352229 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-9f9dab33-83fc-4467-89fc-ccc23bc0e1e7 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:17:05.352896 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-9f9dab33-83fc-4467-89fc-ccc23bc0e1e7 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:17:05.353402 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-9f9dab33-83fc-4467-89fc-ccc23bc0e1e7 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:17:05.354295 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-9f9dab33-83fc-4467-89fc-ccc23bc0e1e7 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:17:05.394339 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-d4d31880-8d72-421e-b2d9-2ff00814243f tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] Calling method '>' {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:17:05.395122 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.compute.api [None req-d4d31880-8d72-421e-b2d9-2ff00814243f tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] [instance: f7783f88-5770-4ca3-a5cf-294f044d21a8] Fetching instance by UUID {{(pid=120798) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:17:05.401997 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-d4d31880-8d72-421e-b2d9-2ff00814243f tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:17:05.402559 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-d4d31880-8d72-421e-b2d9-2ff00814243f tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:17:05.403006 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-d4d31880-8d72-421e-b2d9-2ff00814243f tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:17:05.403729 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-d4d31880-8d72-421e-b2d9-2ff00814243f tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:17:05.404168 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-d4d31880-8d72-421e-b2d9-2ff00814243f tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:17:05.404586 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-d4d31880-8d72-421e-b2d9-2ff00814243f tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:17:05.560087 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.policy [None req-d4d31880-8d72-421e-b2d9-2ff00814243f tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5e8c33634b246319de495d269c05124', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9466597900d4a3ca60a2ef8b7678c87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120798) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:17:05.568565 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [None req-d4d31880-8d72-421e-b2d9-2ff00814243f tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] 10.222.0.17 "GET /compute/v2.1/servers/f7783f88-5770-4ca3-a5cf-294f044d21a8" status: 200 len: 1756 microversion: 2.1 time: 0.178156 Aug 23 07:17:05.569139 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 258/537] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:17:05 2022] GET /compute/v2.1/servers/f7783f88-5770-4ca3-a5cf-294f044d21a8 => generated 1756 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:17:05.617017 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-9f9dab33-83fc-4467-89fc-ccc23bc0e1e7 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] 10.222.0.17 "POST /compute/v2.1/servers/2276f5b3-e71c-42f5-b540-5535a8aa1d48/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.278327 Aug 23 07:17:05.617851 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 280/538] 10.222.0.17 () {60 vars in 1323 bytes} [Tue Aug 23 07:17:05 2022] POST /compute/v2.1/servers/2276f5b3-e71c-42f5-b540-5535a8aa1d48/os-volume_attachments => generated 194 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 07:17:06.591151 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-eda12023-bb02-4aa0-85ee-9ed95eb9710d tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] Calling method '>' {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:17:06.591863 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.compute.api [None req-eda12023-bb02-4aa0-85ee-9ed95eb9710d tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] [instance: f7783f88-5770-4ca3-a5cf-294f044d21a8] Fetching instance by UUID {{(pid=120798) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:17:06.598985 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-eda12023-bb02-4aa0-85ee-9ed95eb9710d tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:17:06.599469 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-eda12023-bb02-4aa0-85ee-9ed95eb9710d tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:17:06.599929 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-eda12023-bb02-4aa0-85ee-9ed95eb9710d tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:17:06.600622 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-eda12023-bb02-4aa0-85ee-9ed95eb9710d tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:17:06.601080 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-eda12023-bb02-4aa0-85ee-9ed95eb9710d tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:17:06.601504 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-eda12023-bb02-4aa0-85ee-9ed95eb9710d tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:17:06.752574 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.policy [None req-eda12023-bb02-4aa0-85ee-9ed95eb9710d tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5e8c33634b246319de495d269c05124', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9466597900d4a3ca60a2ef8b7678c87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120798) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:17:06.760991 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [None req-eda12023-bb02-4aa0-85ee-9ed95eb9710d tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] 10.222.0.17 "GET /compute/v2.1/servers/f7783f88-5770-4ca3-a5cf-294f044d21a8" status: 200 len: 1756 microversion: 2.1 time: 0.174151 Aug 23 07:17:06.761548 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 259/539] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:17:06 2022] GET /compute/v2.1/servers/f7783f88-5770-4ca3-a5cf-294f044d21a8 => generated 1756 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:17:07.783339 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-60f78c12-d8a4-4923-9ebb-7b3efbc1772a tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] Calling method '>' {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:17:07.784094 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.compute.api [None req-60f78c12-d8a4-4923-9ebb-7b3efbc1772a tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] [instance: f7783f88-5770-4ca3-a5cf-294f044d21a8] Fetching instance by UUID {{(pid=120799) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:17:07.790685 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-60f78c12-d8a4-4923-9ebb-7b3efbc1772a tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:17:07.791162 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-60f78c12-d8a4-4923-9ebb-7b3efbc1772a tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:17:07.791644 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-60f78c12-d8a4-4923-9ebb-7b3efbc1772a tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:17:07.792332 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-60f78c12-d8a4-4923-9ebb-7b3efbc1772a tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:17:07.792790 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-60f78c12-d8a4-4923-9ebb-7b3efbc1772a tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:17:07.793381 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-60f78c12-d8a4-4923-9ebb-7b3efbc1772a tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:17:07.945467 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.policy [None req-60f78c12-d8a4-4923-9ebb-7b3efbc1772a tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5e8c33634b246319de495d269c05124', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9466597900d4a3ca60a2ef8b7678c87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120799) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:17:07.954143 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-60f78c12-d8a4-4923-9ebb-7b3efbc1772a tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] 10.222.0.17 "GET /compute/v2.1/servers/f7783f88-5770-4ca3-a5cf-294f044d21a8" status: 200 len: 1756 microversion: 2.1 time: 0.175631 Aug 23 07:17:07.954721 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 281/540] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:17:07 2022] GET /compute/v2.1/servers/f7783f88-5770-4ca3-a5cf-294f044d21a8 => generated 1756 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:17:08.979992 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-469c0abb-dbaa-47cf-9745-bf42a388103c tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] Calling method '>' {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:17:08.980820 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.compute.api [None req-469c0abb-dbaa-47cf-9745-bf42a388103c tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] [instance: f7783f88-5770-4ca3-a5cf-294f044d21a8] Fetching instance by UUID {{(pid=120798) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:17:08.988295 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-469c0abb-dbaa-47cf-9745-bf42a388103c tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:17:08.988796 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-469c0abb-dbaa-47cf-9745-bf42a388103c tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:17:08.989217 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-469c0abb-dbaa-47cf-9745-bf42a388103c tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:17:08.989893 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-469c0abb-dbaa-47cf-9745-bf42a388103c tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:17:08.990336 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-469c0abb-dbaa-47cf-9745-bf42a388103c tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:17:08.990743 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-469c0abb-dbaa-47cf-9745-bf42a388103c tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:17:09.146041 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.policy [None req-469c0abb-dbaa-47cf-9745-bf42a388103c tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5e8c33634b246319de495d269c05124', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9466597900d4a3ca60a2ef8b7678c87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120798) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:17:09.155078 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [None req-469c0abb-dbaa-47cf-9745-bf42a388103c tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] 10.222.0.17 "GET /compute/v2.1/servers/f7783f88-5770-4ca3-a5cf-294f044d21a8" status: 200 len: 1756 microversion: 2.1 time: 0.181702 Aug 23 07:17:09.155701 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 260/541] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:17:08 2022] GET /compute/v2.1/servers/f7783f88-5770-4ca3-a5cf-294f044d21a8 => generated 1756 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:17:10.179334 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-dba852c6-39e1-4f96-9a0d-56fd9b0b707d tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] Calling method '>' {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:17:10.180371 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.compute.api [None req-dba852c6-39e1-4f96-9a0d-56fd9b0b707d tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] [instance: f7783f88-5770-4ca3-a5cf-294f044d21a8] Fetching instance by UUID {{(pid=120799) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:17:10.189540 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-dba852c6-39e1-4f96-9a0d-56fd9b0b707d tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:17:10.190027 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-dba852c6-39e1-4f96-9a0d-56fd9b0b707d tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:17:10.190432 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-dba852c6-39e1-4f96-9a0d-56fd9b0b707d tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:17:10.191258 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-dba852c6-39e1-4f96-9a0d-56fd9b0b707d tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:17:10.191743 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-dba852c6-39e1-4f96-9a0d-56fd9b0b707d tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:17:10.192410 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-dba852c6-39e1-4f96-9a0d-56fd9b0b707d tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:17:10.375568 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.policy [None req-dba852c6-39e1-4f96-9a0d-56fd9b0b707d tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5e8c33634b246319de495d269c05124', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9466597900d4a3ca60a2ef8b7678c87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120799) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:17:10.385492 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-dba852c6-39e1-4f96-9a0d-56fd9b0b707d tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] 10.222.0.17 "GET /compute/v2.1/servers/f7783f88-5770-4ca3-a5cf-294f044d21a8" status: 200 len: 1756 microversion: 2.1 time: 0.211254 Aug 23 07:17:10.386384 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 282/542] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:17:10 2022] GET /compute/v2.1/servers/f7783f88-5770-4ca3-a5cf-294f044d21a8 => generated 1756 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:17:11.411357 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-bdaf8217-e09f-4afc-b939-6b04b9eca484 tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] Calling method '>' {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:17:11.412010 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.compute.api [None req-bdaf8217-e09f-4afc-b939-6b04b9eca484 tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] [instance: f7783f88-5770-4ca3-a5cf-294f044d21a8] Fetching instance by UUID {{(pid=120798) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:17:11.419271 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-bdaf8217-e09f-4afc-b939-6b04b9eca484 tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:17:11.420004 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-bdaf8217-e09f-4afc-b939-6b04b9eca484 tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:17:11.420425 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-bdaf8217-e09f-4afc-b939-6b04b9eca484 tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:17:11.421103 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-bdaf8217-e09f-4afc-b939-6b04b9eca484 tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:17:11.421549 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-bdaf8217-e09f-4afc-b939-6b04b9eca484 tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:17:11.421962 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-bdaf8217-e09f-4afc-b939-6b04b9eca484 tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:17:11.591160 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.policy [None req-bdaf8217-e09f-4afc-b939-6b04b9eca484 tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5e8c33634b246319de495d269c05124', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9466597900d4a3ca60a2ef8b7678c87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120798) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:17:11.599706 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [None req-bdaf8217-e09f-4afc-b939-6b04b9eca484 tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] 10.222.0.17 "GET /compute/v2.1/servers/f7783f88-5770-4ca3-a5cf-294f044d21a8" status: 200 len: 1756 microversion: 2.1 time: 0.192577 Aug 23 07:17:11.600276 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 261/543] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:17:11 2022] GET /compute/v2.1/servers/f7783f88-5770-4ca3-a5cf-294f044d21a8 => generated 1756 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:17:12.624269 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-89663333-b547-428a-8cb6-e6a143725d12 tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] Calling method '>' {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:17:12.624951 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.compute.api [None req-89663333-b547-428a-8cb6-e6a143725d12 tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] [instance: f7783f88-5770-4ca3-a5cf-294f044d21a8] Fetching instance by UUID {{(pid=120799) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:17:12.631817 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-89663333-b547-428a-8cb6-e6a143725d12 tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:17:12.632291 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-89663333-b547-428a-8cb6-e6a143725d12 tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:17:12.632707 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-89663333-b547-428a-8cb6-e6a143725d12 tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:17:12.633385 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-89663333-b547-428a-8cb6-e6a143725d12 tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:17:12.633827 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-89663333-b547-428a-8cb6-e6a143725d12 tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:17:12.634240 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-89663333-b547-428a-8cb6-e6a143725d12 tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:17:12.780025 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.policy [None req-89663333-b547-428a-8cb6-e6a143725d12 tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5e8c33634b246319de495d269c05124', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9466597900d4a3ca60a2ef8b7678c87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120799) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:17:12.788812 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-89663333-b547-428a-8cb6-e6a143725d12 tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] 10.222.0.17 "GET /compute/v2.1/servers/f7783f88-5770-4ca3-a5cf-294f044d21a8" status: 200 len: 1756 microversion: 2.1 time: 0.170368 Aug 23 07:17:12.789858 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 283/544] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:17:12 2022] GET /compute/v2.1/servers/f7783f88-5770-4ca3-a5cf-294f044d21a8 => generated 1756 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:17:13.217868 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-21b62b3a-9bb2-4c58-8bbf-e5ebcafbc2b7 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7583b3dc-7620-4538-9f0c-06933fca8a51"}} {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 07:17:13.220305 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.compute.api [None req-21b62b3a-9bb2-4c58-8bbf-e5ebcafbc2b7 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] [instance: 2276f5b3-e71c-42f5-b540-5535a8aa1d48] Fetching instance by UUID {{(pid=120798) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:17:13.226799 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-21b62b3a-9bb2-4c58-8bbf-e5ebcafbc2b7 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:17:13.227275 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-21b62b3a-9bb2-4c58-8bbf-e5ebcafbc2b7 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:17:13.227727 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-21b62b3a-9bb2-4c58-8bbf-e5ebcafbc2b7 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:17:13.228404 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-21b62b3a-9bb2-4c58-8bbf-e5ebcafbc2b7 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:17:13.228838 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-21b62b3a-9bb2-4c58-8bbf-e5ebcafbc2b7 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:17:13.229245 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-21b62b3a-9bb2-4c58-8bbf-e5ebcafbc2b7 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:17:13.316767 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.wsgi [None req-21b62b3a-9bb2-4c58-8bbf-e5ebcafbc2b7 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] HTTP exception thrown: Invalid volume: volume 7583b3dc-7620-4538-9f0c-06933fca8a51 is already attached to instances: 2276f5b3-e71c-42f5-b540-5535a8aa1d48 Aug 23 07:17:13.318576 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-21b62b3a-9bb2-4c58-8bbf-e5ebcafbc2b7 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Request method failure captured: Aug 23 07:17:13.318576 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: request: POST /compute/v2.1/servers/2276f5b3-e71c-42f5-b540-5535a8aa1d48/os-volume_attachments HTTP/1.1 Aug 23 07:17:13.318576 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: Accept: application/json Aug 23 07:17:13.318576 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: Accept-Encoding: identity Aug 23 07:17:13.318576 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: Connection: close Aug 23 07:17:13.318576 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: Content-Length: 74 Aug 23 07:17:13.318576 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: Content-Type: application/json Aug 23 07:17:13.318576 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: Host: 10.222.0.17 Aug 23 07:17:13.318576 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: Openstack-System-Scope: None Aug 23 07:17:13.318576 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: User-Agent: python-urllib3/1.26.11 Aug 23 07:17:13.318576 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-Auth-Token: gAAAAABjBH3ZHMVVLXoXwNDfQQNusO5G5GN02PnHIiEEKbUNElvY7Grlo8u229xKVdQ1mmEwia_EWu2jEutb1fyYPOf6jNbBH41b4mzr6zipvsQ6BtbbjaOUpVuAli-fuxu6YJZFtXM3RMEYq-CLnj1C8WH54zH3cmVnSq_F2KlyAaedAUE420Q Aug 23 07:17:13.318576 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-Domain-Id: None Aug 23 07:17:13.318576 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-Domain-Name: None Aug 23 07:17:13.318576 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-Identity-Status: Confirmed Aug 23 07:17:13.318576 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-Is-Admin-Project: True Aug 23 07:17:13.318576 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-Project-Domain-Id: default Aug 23 07:17:13.318576 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-Project-Domain-Name: Default Aug 23 07:17:13.318576 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-Project-Id: eb44f62fa62e46528712f24479cbb19f Aug 23 07:17:13.318576 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-Project-Name: tempest-AttachVolumeNegativeTest-880454297 Aug 23 07:17:13.318576 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-Role: reader,member Aug 23 07:17:13.318576 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-Roles: reader,member Aug 23 07:17:13.320179 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/eb44f62fa62e46528712f24479cbb19f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/eb44f62fa62e46528712f24479cbb19f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_eb44f62fa62e46528712f24479cbb19f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/eb44f62fa62e46528712f24479cbb19f"}]}] Aug 23 07:17:13.320179 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-Tenant: tempest-AttachVolumeNegativeTest-880454297 Aug 23 07:17:13.320179 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-Tenant-Id: eb44f62fa62e46528712f24479cbb19f Aug 23 07:17:13.320179 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-880454297 Aug 23 07:17:13.320179 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-User: tempest-AttachVolumeNegativeTest-880454297-project Aug 23 07:17:13.320179 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-User-Domain-Id: default Aug 23 07:17:13.320179 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-User-Domain-Name: Default Aug 23 07:17:13.320179 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-User-Id: 471dc5c1db64411ab1d80ad6c038e519 Aug 23 07:17:13.320179 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-User-Name: tempest-AttachVolumeNegativeTest-880454297-project Aug 23 07:17:13.320179 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: Aug 23 07:17:13.320179 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: {"volumeAttachment": {"volumeId": "7583b3dc-7620-4538-9f0c-06933fca8a51"}} Aug 23 07:17:13.320179 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: method: > Aug 23 07:17:13.320954 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: exception: Invalid volume: volume 7583b3dc-7620-4538-9f0c-06933fca8a51 is already attached to instances: 2276f5b3-e71c-42f5-b540-5535a8aa1d48 Aug 23 07:17:13.320954 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: action_args: {'server_id': '2276f5b3-e71c-42f5-b540-5535a8aa1d48', 'body': {'volumeAttachment': {'volumeId': '7583b3dc-7620-4538-9f0c-06933fca8a51'}}} Aug 23 07:17:13.320954 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 07:17:13.320954 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 07:17:13.320954 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 23 07:17:13.320954 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 23 07:17:13.320954 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 23 07:17:13.320954 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 23 07:17:13.320954 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 23 07:17:13.320954 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 23 07:17:13.320954 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5113, in attach_volume Aug 23 07:17:13.320954 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 23 07:17:13.320954 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4953, in _check_volume_already_attached Aug 23 07:17:13.320954 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 23 07:17:13.320954 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 7583b3dc-7620-4538-9f0c-06933fca8a51 is already attached to instances: 2276f5b3-e71c-42f5-b540-5535a8aa1d48 Aug 23 07:17:13.320954 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi Aug 23 07:17:13.320954 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 07:17:13.320954 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi Aug 23 07:17:13.320954 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 07:17:13.322122 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 07:17:13.322122 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 07:17:13.322122 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 07:17:13.322122 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 07:17:13.322122 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 07:17:13.322122 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 07:17:13.322122 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 23 07:17:13.322122 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 23 07:17:13.322122 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 23 07:17:13.322122 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 23 07:17:13.322122 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 23 07:17:13.322122 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 23 07:17:13.322122 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 23 07:17:13.322122 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 23 07:17:13.322122 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 7583b3dc-7620-4538-9f0c-06933fca8a51 is already attached to instances: 2276f5b3-e71c-42f5-b540-5535a8aa1d48 Aug 23 07:17:13.322122 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi Aug 23 07:17:13.322122 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 07:17:13.322122 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi Aug 23 07:17:13.322122 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 07:17:13.322122 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 07:17:13.324400 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 07:17:13.324400 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 07:17:13.324400 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 07:17:13.324400 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 7583b3dc-7620-4538-9f0c-06933fca8a51 is already attached to instances: 2276f5b3-e71c-42f5-b540-5535a8aa1d48 Aug 23 07:17:13.324400 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi Aug 23 07:17:13.324400 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-21b62b3a-9bb2-4c58-8bbf-e5ebcafbc2b7 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Returning 400 to user: Invalid volume: volume 7583b3dc-7620-4538-9f0c-06933fca8a51 is already attached to instances: 2276f5b3-e71c-42f5-b540-5535a8aa1d48 {{(pid=120798) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 07:17:13.324400 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [None req-21b62b3a-9bb2-4c58-8bbf-e5ebcafbc2b7 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] 10.222.0.17 "POST /compute/v2.1/servers/2276f5b3-e71c-42f5-b540-5535a8aa1d48/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.108877 Aug 23 07:17:13.324400 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 262/545] 10.222.0.17 () {60 vars in 1323 bytes} [Tue Aug 23 07:17:13 2022] POST /compute/v2.1/servers/2276f5b3-e71c-42f5-b540-5535a8aa1d48/os-volume_attachments => generated 174 bytes in 111 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 23 07:17:13.387335 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-909a17ea-88ec-4f73-8563-80338c058bca tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Calling method '>' {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:17:13.387849 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.compute.api [None req-909a17ea-88ec-4f73-8563-80338c058bca tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] [instance: 2276f5b3-e71c-42f5-b540-5535a8aa1d48] Fetching instance by UUID {{(pid=120799) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:17:13.393907 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-909a17ea-88ec-4f73-8563-80338c058bca tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:17:13.394353 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-909a17ea-88ec-4f73-8563-80338c058bca tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:17:13.394780 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-909a17ea-88ec-4f73-8563-80338c058bca tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:17:13.395454 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-909a17ea-88ec-4f73-8563-80338c058bca tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:17:13.395915 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-909a17ea-88ec-4f73-8563-80338c058bca tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:17:13.396333 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-909a17ea-88ec-4f73-8563-80338c058bca tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:17:13.475995 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.objects.instance [None req-909a17ea-88ec-4f73-8563-80338c058bca tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lazy-loading 'services' on Instance uuid 2276f5b3-e71c-42f5-b540-5535a8aa1d48 {{(pid=120799) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 07:17:13.760616 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-909a17ea-88ec-4f73-8563-80338c058bca tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] 10.222.0.17 "DELETE /compute/v2.1/servers/2276f5b3-e71c-42f5-b540-5535a8aa1d48/os-volume_attachments/7583b3dc-7620-4538-9f0c-06933fca8a51" status: 202 len: 0 microversion: 2.1 time: 0.377051 Aug 23 07:17:13.761241 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 284/546] 10.222.0.17 () {58 vars in 1416 bytes} [Tue Aug 23 07:17:13 2022] DELETE /compute/v2.1/servers/2276f5b3-e71c-42f5-b540-5535a8aa1d48/os-volume_attachments/7583b3dc-7620-4538-9f0c-06933fca8a51 => generated 0 bytes in 378 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 07:17:13.770971 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-c5ba8f0d-4320-49d2-a3bf-566942f9de71 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Calling method '>' {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:17:13.773156 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.compute.api [None req-c5ba8f0d-4320-49d2-a3bf-566942f9de71 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] [instance: 2276f5b3-e71c-42f5-b540-5535a8aa1d48] Fetching instance by UUID {{(pid=120798) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:17:13.779814 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-c5ba8f0d-4320-49d2-a3bf-566942f9de71 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:17:13.780434 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-c5ba8f0d-4320-49d2-a3bf-566942f9de71 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:17:13.781190 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-c5ba8f0d-4320-49d2-a3bf-566942f9de71 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:17:13.781949 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-c5ba8f0d-4320-49d2-a3bf-566942f9de71 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:17:13.782391 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-c5ba8f0d-4320-49d2-a3bf-566942f9de71 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:17:13.783718 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-c5ba8f0d-4320-49d2-a3bf-566942f9de71 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:17:13.813288 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-99320e09-25ce-4915-ae29-1b28aaa46d68 tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] Calling method '>' {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:17:13.813957 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.compute.api [None req-99320e09-25ce-4915-ae29-1b28aaa46d68 tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] [instance: f7783f88-5770-4ca3-a5cf-294f044d21a8] Fetching instance by UUID {{(pid=120799) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:17:13.821284 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-99320e09-25ce-4915-ae29-1b28aaa46d68 tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:17:13.821469 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [None req-c5ba8f0d-4320-49d2-a3bf-566942f9de71 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] 10.222.0.17 "GET /compute/v2.1/servers/2276f5b3-e71c-42f5-b540-5535a8aa1d48/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054684 Aug 23 07:17:13.821795 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-99320e09-25ce-4915-ae29-1b28aaa46d68 tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:17:13.822651 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-99320e09-25ce-4915-ae29-1b28aaa46d68 tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:17:13.823326 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-99320e09-25ce-4915-ae29-1b28aaa46d68 tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:17:13.823834 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-99320e09-25ce-4915-ae29-1b28aaa46d68 tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:17:13.824228 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-99320e09-25ce-4915-ae29-1b28aaa46d68 tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:17:13.824540 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 263/547] 10.222.0.17 () {58 vars in 1302 bytes} [Tue Aug 23 07:17:13 2022] GET /compute/v2.1/servers/2276f5b3-e71c-42f5-b540-5535a8aa1d48/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 07:17:13.983944 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.policy [None req-99320e09-25ce-4915-ae29-1b28aaa46d68 tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5e8c33634b246319de495d269c05124', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9466597900d4a3ca60a2ef8b7678c87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120799) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:17:13.997084 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-99320e09-25ce-4915-ae29-1b28aaa46d68 tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] 10.222.0.17 "GET /compute/v2.1/servers/f7783f88-5770-4ca3-a5cf-294f044d21a8" status: 200 len: 1756 microversion: 2.1 time: 0.188053 Aug 23 07:17:13.998040 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 285/548] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:17:13 2022] GET /compute/v2.1/servers/f7783f88-5770-4ca3-a5cf-294f044d21a8 => generated 1756 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 07:17:14.834616 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-8522a850-276f-4e66-ae08-dcec1b05a269 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Calling method '>' {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:17:14.837154 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.compute.api [None req-8522a850-276f-4e66-ae08-dcec1b05a269 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] [instance: 2276f5b3-e71c-42f5-b540-5535a8aa1d48] Fetching instance by UUID {{(pid=120798) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:17:14.844236 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-8522a850-276f-4e66-ae08-dcec1b05a269 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:17:14.844711 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-8522a850-276f-4e66-ae08-dcec1b05a269 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:17:14.845139 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-8522a850-276f-4e66-ae08-dcec1b05a269 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:17:14.845812 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-8522a850-276f-4e66-ae08-dcec1b05a269 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:17:14.846257 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-8522a850-276f-4e66-ae08-dcec1b05a269 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:17:14.846671 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-8522a850-276f-4e66-ae08-dcec1b05a269 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:17:14.876479 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [None req-8522a850-276f-4e66-ae08-dcec1b05a269 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] 10.222.0.17 "GET /compute/v2.1/servers/2276f5b3-e71c-42f5-b540-5535a8aa1d48/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045834 Aug 23 07:17:14.877029 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 264/549] 10.222.0.17 () {58 vars in 1302 bytes} [Tue Aug 23 07:17:14 2022] GET /compute/v2.1/servers/2276f5b3-e71c-42f5-b540-5535a8aa1d48/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 23 07:17:14.939367 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-dafdd9b8-2650-47ef-ad63-8a88afadf12f tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Calling method '>' {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:17:14.940053 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.compute.api [None req-dafdd9b8-2650-47ef-ad63-8a88afadf12f tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] [instance: 2276f5b3-e71c-42f5-b540-5535a8aa1d48] Fetching instance by UUID {{(pid=120799) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:17:14.946706 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-dafdd9b8-2650-47ef-ad63-8a88afadf12f tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:17:14.947189 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-dafdd9b8-2650-47ef-ad63-8a88afadf12f tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:17:14.947675 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-dafdd9b8-2650-47ef-ad63-8a88afadf12f tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:17:14.948396 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-dafdd9b8-2650-47ef-ad63-8a88afadf12f tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:17:14.948846 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-dafdd9b8-2650-47ef-ad63-8a88afadf12f tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:17:14.949269 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-dafdd9b8-2650-47ef-ad63-8a88afadf12f tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:17:14.976445 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.compute.api [None req-dafdd9b8-2650-47ef-ad63-8a88afadf12f tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] [instance: 2276f5b3-e71c-42f5-b540-5535a8aa1d48] Going to try to terminate instance {{(pid=120799) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 07:17:15.026012 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-5efd3c97-e6ab-4ccf-82d6-7b0a0d146908 tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] Calling method '>' {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:17:15.026614 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.compute.api [None req-5efd3c97-e6ab-4ccf-82d6-7b0a0d146908 tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] [instance: f7783f88-5770-4ca3-a5cf-294f044d21a8] Fetching instance by UUID {{(pid=120798) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:17:15.034553 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-5efd3c97-e6ab-4ccf-82d6-7b0a0d146908 tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:17:15.035032 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-5efd3c97-e6ab-4ccf-82d6-7b0a0d146908 tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:17:15.035726 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-5efd3c97-e6ab-4ccf-82d6-7b0a0d146908 tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:17:15.036419 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-5efd3c97-e6ab-4ccf-82d6-7b0a0d146908 tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:17:15.036872 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-5efd3c97-e6ab-4ccf-82d6-7b0a0d146908 tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:17:15.037582 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-5efd3c97-e6ab-4ccf-82d6-7b0a0d146908 tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:17:15.059816 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-dafdd9b8-2650-47ef-ad63-8a88afadf12f tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] 10.222.0.17 "DELETE /compute/v2.1/servers/2276f5b3-e71c-42f5-b540-5535a8aa1d48" status: 204 len: 0 microversion: 2.1 time: 0.124014 Aug 23 07:17:15.060633 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 286/550] 10.222.0.17 () {58 vars in 1239 bytes} [Tue Aug 23 07:17:14 2022] DELETE /compute/v2.1/servers/2276f5b3-e71c-42f5-b540-5535a8aa1d48 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 23 07:17:15.071002 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-64bbadd6-d2eb-46e2-a706-af0d256befb2 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Calling method '>' {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:17:15.071731 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.compute.api [None req-64bbadd6-d2eb-46e2-a706-af0d256befb2 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] [instance: 2276f5b3-e71c-42f5-b540-5535a8aa1d48] Fetching instance by UUID {{(pid=120799) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:17:15.077978 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-64bbadd6-d2eb-46e2-a706-af0d256befb2 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:17:15.078453 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-64bbadd6-d2eb-46e2-a706-af0d256befb2 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:17:15.078953 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-64bbadd6-d2eb-46e2-a706-af0d256befb2 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:17:15.079615 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-64bbadd6-d2eb-46e2-a706-af0d256befb2 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:17:15.080058 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-64bbadd6-d2eb-46e2-a706-af0d256befb2 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:17:15.080470 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-64bbadd6-d2eb-46e2-a706-af0d256befb2 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:17:15.284463 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.policy [None req-64bbadd6-d2eb-46e2-a706-af0d256befb2 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '471dc5c1db64411ab1d80ad6c038e519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb44f62fa62e46528712f24479cbb19f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120799) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:17:15.292964 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-64bbadd6-d2eb-46e2-a706-af0d256befb2 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] 10.222.0.17 "GET /compute/v2.1/servers/2276f5b3-e71c-42f5-b540-5535a8aa1d48" status: 200 len: 1679 microversion: 2.1 time: 0.226427 Aug 23 07:17:15.293716 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 287/551] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:17:15 2022] GET /compute/v2.1/servers/2276f5b3-e71c-42f5-b540-5535a8aa1d48 => generated 1679 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:17:15.303227 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.policy [None req-5efd3c97-e6ab-4ccf-82d6-7b0a0d146908 tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5e8c33634b246319de495d269c05124', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9466597900d4a3ca60a2ef8b7678c87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120798) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:17:15.312246 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [None req-5efd3c97-e6ab-4ccf-82d6-7b0a0d146908 tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] 10.222.0.17 "GET /compute/v2.1/servers/f7783f88-5770-4ca3-a5cf-294f044d21a8" status: 200 len: 1756 microversion: 2.1 time: 0.290113 Aug 23 07:17:15.312830 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 265/552] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:17:15 2022] GET /compute/v2.1/servers/f7783f88-5770-4ca3-a5cf-294f044d21a8 => generated 1756 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 07:17:16.319255 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-3319f423-cc92-4fad-8a3b-02783b192986 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Calling method '>' {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:17:16.320270 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.compute.api [None req-3319f423-cc92-4fad-8a3b-02783b192986 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] [instance: 2276f5b3-e71c-42f5-b540-5535a8aa1d48] Fetching instance by UUID {{(pid=120799) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:17:16.331174 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-3319f423-cc92-4fad-8a3b-02783b192986 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:17:16.332049 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-3319f423-cc92-4fad-8a3b-02783b192986 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:17:16.332763 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-3319f423-cc92-4fad-8a3b-02783b192986 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:17:16.333892 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-3319f423-cc92-4fad-8a3b-02783b192986 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:17:16.334731 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-3319f423-cc92-4fad-8a3b-02783b192986 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:17:16.335399 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-3319f423-cc92-4fad-8a3b-02783b192986 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:17:16.337486 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-5c1f34cc-f2ae-4fe7-8d03-c27222604684 tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] Calling method '>' {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:17:16.338487 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.compute.api [None req-5c1f34cc-f2ae-4fe7-8d03-c27222604684 tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] [instance: f7783f88-5770-4ca3-a5cf-294f044d21a8] Fetching instance by UUID {{(pid=120798) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:17:16.346230 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-5c1f34cc-f2ae-4fe7-8d03-c27222604684 tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:17:16.346712 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-5c1f34cc-f2ae-4fe7-8d03-c27222604684 tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:17:16.347142 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-5c1f34cc-f2ae-4fe7-8d03-c27222604684 tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:17:16.347861 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-5c1f34cc-f2ae-4fe7-8d03-c27222604684 tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:17:16.348308 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-5c1f34cc-f2ae-4fe7-8d03-c27222604684 tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:17:16.348725 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-5c1f34cc-f2ae-4fe7-8d03-c27222604684 tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:17:16.532130 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.policy [None req-3319f423-cc92-4fad-8a3b-02783b192986 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '471dc5c1db64411ab1d80ad6c038e519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb44f62fa62e46528712f24479cbb19f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120799) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:17:16.540350 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-3319f423-cc92-4fad-8a3b-02783b192986 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] 10.222.0.17 "GET /compute/v2.1/servers/2276f5b3-e71c-42f5-b540-5535a8aa1d48" status: 200 len: 1679 microversion: 2.1 time: 0.227527 Aug 23 07:17:16.541039 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 288/553] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:17:16 2022] GET /compute/v2.1/servers/2276f5b3-e71c-42f5-b540-5535a8aa1d48 => generated 1679 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:17:16.552939 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.policy [None req-5c1f34cc-f2ae-4fe7-8d03-c27222604684 tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5e8c33634b246319de495d269c05124', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9466597900d4a3ca60a2ef8b7678c87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120798) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:17:16.561756 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [None req-5c1f34cc-f2ae-4fe7-8d03-c27222604684 tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] 10.222.0.17 "GET /compute/v2.1/servers/f7783f88-5770-4ca3-a5cf-294f044d21a8" status: 200 len: 1756 microversion: 2.1 time: 0.231130 Aug 23 07:17:16.562296 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 266/554] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:17:16 2022] GET /compute/v2.1/servers/f7783f88-5770-4ca3-a5cf-294f044d21a8 => generated 1756 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:17:17.562455 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-c9360896-2f90-4837-8fdd-39145aa2b977 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Calling method '>' {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:17:17.563089 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.compute.api [None req-c9360896-2f90-4837-8fdd-39145aa2b977 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] [instance: 2276f5b3-e71c-42f5-b540-5535a8aa1d48] Fetching instance by UUID {{(pid=120799) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:17:17.569951 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-c9360896-2f90-4837-8fdd-39145aa2b977 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:17:17.570473 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-c9360896-2f90-4837-8fdd-39145aa2b977 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:17:17.570974 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-c9360896-2f90-4837-8fdd-39145aa2b977 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:17:17.571740 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-c9360896-2f90-4837-8fdd-39145aa2b977 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:17:17.572204 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-c9360896-2f90-4837-8fdd-39145aa2b977 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:17:17.572650 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-c9360896-2f90-4837-8fdd-39145aa2b977 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:17:17.577328 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG dbcounter [-] [120799] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=4,nova_cell1:INSERT=4 {{(pid=120799) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:17:17.583219 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-0fdebbe6-e308-43ce-b90d-46d141d92f2f tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] Calling method '>' {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:17:17.583858 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.compute.api [None req-0fdebbe6-e308-43ce-b90d-46d141d92f2f tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] [instance: f7783f88-5770-4ca3-a5cf-294f044d21a8] Fetching instance by UUID {{(pid=120798) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:17:17.603045 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-0fdebbe6-e308-43ce-b90d-46d141d92f2f tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:17:17.603569 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-0fdebbe6-e308-43ce-b90d-46d141d92f2f tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:17:17.603972 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-0fdebbe6-e308-43ce-b90d-46d141d92f2f tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:17:17.604692 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-0fdebbe6-e308-43ce-b90d-46d141d92f2f tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:17:17.605133 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-0fdebbe6-e308-43ce-b90d-46d141d92f2f tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:17:17.605554 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-0fdebbe6-e308-43ce-b90d-46d141d92f2f tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:17:17.677008 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.policy [None req-c9360896-2f90-4837-8fdd-39145aa2b977 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '471dc5c1db64411ab1d80ad6c038e519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb44f62fa62e46528712f24479cbb19f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120799) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:17:17.691692 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-c9360896-2f90-4837-8fdd-39145aa2b977 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] 10.222.0.17 "GET /compute/v2.1/servers/2276f5b3-e71c-42f5-b540-5535a8aa1d48" status: 200 len: 1612 microversion: 2.1 time: 0.133107 Aug 23 07:17:17.692639 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 289/555] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:17:17 2022] GET /compute/v2.1/servers/2276f5b3-e71c-42f5-b540-5535a8aa1d48 => generated 1612 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:17:17.788722 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.policy [None req-0fdebbe6-e308-43ce-b90d-46d141d92f2f tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5e8c33634b246319de495d269c05124', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9466597900d4a3ca60a2ef8b7678c87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120798) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:17:17.797277 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [None req-0fdebbe6-e308-43ce-b90d-46d141d92f2f tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] 10.222.0.17 "GET /compute/v2.1/servers/f7783f88-5770-4ca3-a5cf-294f044d21a8" status: 200 len: 1756 microversion: 2.1 time: 0.218210 Aug 23 07:17:17.797851 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 267/556] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:17:17 2022] GET /compute/v2.1/servers/f7783f88-5770-4ca3-a5cf-294f044d21a8 => generated 1756 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:17:17.889694 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [req-a44ac61f-8923-4f56-b222-e8f21c57974e req-f280fd3e-fe06-434f-90cd-4a6008a0c67a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2276f5b3-e71c-42f5-b540-5535a8aa1d48", "name": "network-vif-deleted", "tag": "be3c90aa-cba5-4245-be28-bf2257dc5817"}]} {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 07:17:17.899189 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [req-a44ac61f-8923-4f56-b222-e8f21c57974e req-f280fd3e-fe06-434f-90cd-4a6008a0c67a service nova] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:17:17.899697 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [req-a44ac61f-8923-4f56-b222-e8f21c57974e req-f280fd3e-fe06-434f-90cd-4a6008a0c67a service nova] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:17:17.900119 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [req-a44ac61f-8923-4f56-b222-e8f21c57974e req-f280fd3e-fe06-434f-90cd-4a6008a0c67a service nova] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:17:17.911712 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.compute.server_external_events [req-a44ac61f-8923-4f56-b222-e8f21c57974e req-f280fd3e-fe06-434f-90cd-4a6008a0c67a service nova] Creating event network-vif-deleted:be3c90aa-cba5-4245-be28-bf2257dc5817 for instance 2276f5b3-e71c-42f5-b540-5535a8aa1d48 on hv-cinder-85409 Aug 23 07:17:17.917091 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [req-a44ac61f-8923-4f56-b222-e8f21c57974e req-f280fd3e-fe06-434f-90cd-4a6008a0c67a service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031272 Aug 23 07:17:17.917873 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 290/557] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Aug 23 07:17:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 07:17:18.714042 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-af2a9d7d-abc3-4323-9d78-743a4b78f971 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Calling method '>' {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:17:18.714656 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.compute.api [None req-af2a9d7d-abc3-4323-9d78-743a4b78f971 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] [instance: 2276f5b3-e71c-42f5-b540-5535a8aa1d48] Fetching instance by UUID {{(pid=120798) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:17:18.722068 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-af2a9d7d-abc3-4323-9d78-743a4b78f971 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:17:18.722615 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-af2a9d7d-abc3-4323-9d78-743a4b78f971 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:17:18.723056 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-af2a9d7d-abc3-4323-9d78-743a4b78f971 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:17:18.723813 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-af2a9d7d-abc3-4323-9d78-743a4b78f971 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:17:18.724282 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-af2a9d7d-abc3-4323-9d78-743a4b78f971 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:17:18.724733 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-af2a9d7d-abc3-4323-9d78-743a4b78f971 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:17:18.740636 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.wsgi [None req-af2a9d7d-abc3-4323-9d78-743a4b78f971 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] HTTP exception thrown: Instance 2276f5b3-e71c-42f5-b540-5535a8aa1d48 could not be found. Aug 23 07:17:18.743631 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-af2a9d7d-abc3-4323-9d78-743a4b78f971 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Request method failure captured: Aug 23 07:17:18.743631 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: request: GET /compute/v2.1/servers/2276f5b3-e71c-42f5-b540-5535a8aa1d48 HTTP/1.1 Aug 23 07:17:18.743631 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: Accept: application/json Aug 23 07:17:18.743631 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: Accept-Encoding: identity Aug 23 07:17:18.743631 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: Connection: close Aug 23 07:17:18.743631 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: Content-Length: 0 Aug 23 07:17:18.743631 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: Content-Type: application/json Aug 23 07:17:18.743631 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: Host: 10.222.0.17 Aug 23 07:17:18.743631 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: Openstack-System-Scope: None Aug 23 07:17:18.743631 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: User-Agent: python-urllib3/1.26.11 Aug 23 07:17:18.743631 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-Auth-Token: gAAAAABjBH3ZHMVVLXoXwNDfQQNusO5G5GN02PnHIiEEKbUNElvY7Grlo8u229xKVdQ1mmEwia_EWu2jEutb1fyYPOf6jNbBH41b4mzr6zipvsQ6BtbbjaOUpVuAli-fuxu6YJZFtXM3RMEYq-CLnj1C8WH54zH3cmVnSq_F2KlyAaedAUE420Q Aug 23 07:17:18.743631 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-Domain-Id: None Aug 23 07:17:18.743631 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-Domain-Name: None Aug 23 07:17:18.743631 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-Identity-Status: Confirmed Aug 23 07:17:18.743631 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-Is-Admin-Project: True Aug 23 07:17:18.743631 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-Project-Domain-Id: default Aug 23 07:17:18.743631 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-Project-Domain-Name: Default Aug 23 07:17:18.743631 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-Project-Id: eb44f62fa62e46528712f24479cbb19f Aug 23 07:17:18.743631 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-Project-Name: tempest-AttachVolumeNegativeTest-880454297 Aug 23 07:17:18.743631 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-Role: reader,member Aug 23 07:17:18.743631 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-Roles: reader,member Aug 23 07:17:18.745102 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/eb44f62fa62e46528712f24479cbb19f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/eb44f62fa62e46528712f24479cbb19f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_eb44f62fa62e46528712f24479cbb19f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/eb44f62fa62e46528712f24479cbb19f"}]}] Aug 23 07:17:18.745102 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-Tenant: tempest-AttachVolumeNegativeTest-880454297 Aug 23 07:17:18.745102 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-Tenant-Id: eb44f62fa62e46528712f24479cbb19f Aug 23 07:17:18.745102 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-880454297 Aug 23 07:17:18.745102 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-User: tempest-AttachVolumeNegativeTest-880454297-project Aug 23 07:17:18.745102 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-User-Domain-Id: default Aug 23 07:17:18.745102 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-User-Domain-Name: Default Aug 23 07:17:18.745102 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-User-Id: 471dc5c1db64411ab1d80ad6c038e519 Aug 23 07:17:18.745102 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-User-Name: tempest-AttachVolumeNegativeTest-880454297-project Aug 23 07:17:18.745102 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: method: > Aug 23 07:17:18.745102 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: exception: Instance 2276f5b3-e71c-42f5-b540-5535a8aa1d48 could not be found. Aug 23 07:17:18.745102 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: action_args: {'id': '2276f5b3-e71c-42f5-b540-5535a8aa1d48'} Aug 23 07:17:18.745849 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 07:17:18.745849 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 07:17:18.745849 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 07:17:18.745849 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 07:17:18.745849 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 07:17:18.745849 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 07:17:18.745849 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 07:17:18.745849 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 07:17:18.745849 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 07:17:18.745849 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 07:17:18.745849 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2276f5b3-e71c-42f5-b540-5535a8aa1d48 could not be found. Aug 23 07:17:18.745849 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi Aug 23 07:17:18.745849 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 07:17:18.745849 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi Aug 23 07:17:18.745849 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 07:17:18.745849 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 07:17:18.745849 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 07:17:18.745849 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 07:17:18.745849 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 07:17:18.745849 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 07:17:18.747598 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 07:17:18.747598 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 07:17:18.747598 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 07:17:18.747598 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 07:17:18.747598 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 07:17:18.747598 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 07:17:18.747598 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 07:17:18.747598 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2276f5b3-e71c-42f5-b540-5535a8aa1d48 could not be found. Aug 23 07:17:18.747598 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi Aug 23 07:17:18.747598 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 07:17:18.747598 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi Aug 23 07:17:18.747598 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 07:17:18.747598 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 07:17:18.747598 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 07:17:18.747598 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 07:17:18.747598 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 07:17:18.747598 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2276f5b3-e71c-42f5-b540-5535a8aa1d48 could not be found. Aug 23 07:17:18.747598 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi Aug 23 07:17:18.750695 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-af2a9d7d-abc3-4323-9d78-743a4b78f971 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Returning 404 to user: Instance 2276f5b3-e71c-42f5-b540-5535a8aa1d48 could not be found. {{(pid=120798) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 07:17:18.750695 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [None req-af2a9d7d-abc3-4323-9d78-743a4b78f971 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] 10.222.0.17 "GET /compute/v2.1/servers/2276f5b3-e71c-42f5-b540-5535a8aa1d48" status: 404 len: 111 microversion: 2.1 time: 0.036328 Aug 23 07:17:18.751225 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 268/558] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:17:18 2022] GET /compute/v2.1/servers/2276f5b3-e71c-42f5-b540-5535a8aa1d48 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 07:17:18.758559 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-bca528bf-d1ea-4db2-a73a-d21de6147baa tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Calling method '.version_select at 0x7fe3c580f820>' {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:17:18.782896 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-bca528bf-d1ea-4db2-a73a-d21de6147baa tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-909959701" status: 202 len: 0 microversion: 2.1 time: 0.029323 Aug 23 07:17:18.786269 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 291/559] 10.222.0.17 () {58 vars in 1218 bytes} [Tue Aug 23 07:17:18 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-909959701 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 07:17:18.818556 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-a7693e77-c66e-40a4-9465-dc0c14bb37a1 tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] Calling method '>' {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:17:18.819170 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.compute.api [None req-a7693e77-c66e-40a4-9465-dc0c14bb37a1 tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] [instance: f7783f88-5770-4ca3-a5cf-294f044d21a8] Fetching instance by UUID {{(pid=120798) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:17:18.825596 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-a7693e77-c66e-40a4-9465-dc0c14bb37a1 tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:17:18.826085 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-a7693e77-c66e-40a4-9465-dc0c14bb37a1 tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:17:18.830211 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-a7693e77-c66e-40a4-9465-dc0c14bb37a1 tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:17:18.830972 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-a7693e77-c66e-40a4-9465-dc0c14bb37a1 tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:17:18.831437 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-a7693e77-c66e-40a4-9465-dc0c14bb37a1 tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:17:18.831886 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-a7693e77-c66e-40a4-9465-dc0c14bb37a1 tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:17:19.081460 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.policy [None req-a7693e77-c66e-40a4-9465-dc0c14bb37a1 tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5e8c33634b246319de495d269c05124', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9466597900d4a3ca60a2ef8b7678c87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120798) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:17:19.090282 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [None req-a7693e77-c66e-40a4-9465-dc0c14bb37a1 tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] 10.222.0.17 "GET /compute/v2.1/servers/f7783f88-5770-4ca3-a5cf-294f044d21a8" status: 200 len: 1759 microversion: 2.1 time: 0.275938 Aug 23 07:17:19.090853 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 269/560] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:17:18 2022] GET /compute/v2.1/servers/f7783f88-5770-4ca3-a5cf-294f044d21a8 => generated 1759 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:17:19.517885 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-3be2e3b4-14df-46a1-ada1-31552ab76ebd tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Action: 'create', calling method: .version_select at 0x7fe3c581d0d0>, body: {"keypair": {"name": "tempest-keypair-1587992826", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDNLzki+MnLTYCgTHxnmKUYJhAgFshJUGrJgILSvs/vrXG3GQDGx1wm3LRXP1dDwiP0Vvl0vzdoJOo2GX/6UsBmdV2QvtvfrBwLN1hLveCAHWdyNpX8vubStRysfFIyt2Q=="}} {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 07:17:19.536499 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.quota [None req-3be2e3b4-14df-46a1-ada1-31552ab76ebd tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Getting quotas for project eb44f62fa62e46528712f24479cbb19f. Resources: {'key_pairs'} {{(pid=120799) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 07:17:19.540348 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.quota [None req-3be2e3b4-14df-46a1-ada1-31552ab76ebd tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Getting quotas for user 471dc5c1db64411ab1d80ad6c038e519 and project eb44f62fa62e46528712f24479cbb19f. Resources: {'key_pairs'} {{(pid=120799) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 07:17:19.564925 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-3be2e3b4-14df-46a1-ada1-31552ab76ebd tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.051397 Aug 23 07:17:19.565516 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 292/561] 10.222.0.17 () {60 vars in 1159 bytes} [Tue Aug 23 07:17:19 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 07:17:20.827511 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-52256646-b78c-4ce3-b16f-e2f2f5da3142 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1239555446", "imageRef": "b899fd65-02ae-4b43-bac7-86f38fc3f224", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "5ee97029-6237-4f87-a16d-878d9597a1a6"}], "security_groups": [{"name": "tempest-securitygroup--1851994313"}], "key_name": "tempest-keypair-1587992826", "user_data": "}} {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 07:17:20.933686 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.network.neutron [None req-52256646-b78c-4ce3-b16f-e2f2f5da3142 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] validate_networks() for [('5ee97029-6237-4f87-a16d-878d9597a1a6', None, None, None, None, None)] {{(pid=120798) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 23 07:17:21.340978 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.virt.hardware [None req-52256646-b78c-4ce3-b16f-e2f2f5da3142 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Flavor limits 0:0:0 {{(pid=120798) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 07:17:21.341928 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.virt.hardware [None req-52256646-b78c-4ce3-b16f-e2f2f5da3142 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Image limits 0:0:0 {{(pid=120798) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 07:17:21.342410 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.virt.hardware [None req-52256646-b78c-4ce3-b16f-e2f2f5da3142 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Flavor pref 0:0:0 {{(pid=120798) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 07:17:21.342819 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.virt.hardware [None req-52256646-b78c-4ce3-b16f-e2f2f5da3142 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Image pref 0:0:0 {{(pid=120798) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 07:17:21.343208 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.virt.hardware [None req-52256646-b78c-4ce3-b16f-e2f2f5da3142 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120798) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 07:17:21.352279 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-52256646-b78c-4ce3-b16f-e2f2f5da3142 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:17:21.352751 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-52256646-b78c-4ce3-b16f-e2f2f5da3142 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:17:21.353198 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-52256646-b78c-4ce3-b16f-e2f2f5da3142 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:17:21.353901 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-52256646-b78c-4ce3-b16f-e2f2f5da3142 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:17:21.354396 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-52256646-b78c-4ce3-b16f-e2f2f5da3142 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:17:21.354776 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-52256646-b78c-4ce3-b16f-e2f2f5da3142 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:17:21.375965 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.quota [None req-52256646-b78c-4ce3-b16f-e2f2f5da3142 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Getting quotas for project eb44f62fa62e46528712f24479cbb19f. Resources: {'ram', 'instances', 'cores'} {{(pid=120798) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 07:17:21.380304 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.quota [None req-52256646-b78c-4ce3-b16f-e2f2f5da3142 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Getting quotas for user 471dc5c1db64411ab1d80ad6c038e519 and project eb44f62fa62e46528712f24479cbb19f. Resources: {'ram', 'instances', 'cores'} {{(pid=120798) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 07:17:21.392169 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.compute.api [None req-52256646-b78c-4ce3-b16f-e2f2f5da3142 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Going to run 1 instances... {{(pid=120798) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 23 07:17:21.394560 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.compute.api [None req-52256646-b78c-4ce3-b16f-e2f2f5da3142 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] [instance: 18882ea3-d64e-4894-b42d-9769383c4668] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b899fd65-02ae-4b43-bac7-86f38fc3f224',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120798) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 07:17:21.443031 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [None req-52256646-b78c-4ce3-b16f-e2f2f5da3142 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.620346 Aug 23 07:17:21.443691 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 270/562] 10.222.0.17 () {60 vars in 1147 bytes} [Tue Aug 23 07:17:20 2022] POST /compute/v2.1/servers => generated 402 bytes in 622 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 23 07:17:21.455204 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-ce2e13a7-23a7-4d65-bcc6-5097b6a87273 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Calling method '>' {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:17:21.455995 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.compute.api [None req-ce2e13a7-23a7-4d65-bcc6-5097b6a87273 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] [instance: 18882ea3-d64e-4894-b42d-9769383c4668] Fetching instance by UUID {{(pid=120799) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:17:21.514880 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.policy [None req-ce2e13a7-23a7-4d65-bcc6-5097b6a87273 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '471dc5c1db64411ab1d80ad6c038e519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb44f62fa62e46528712f24479cbb19f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120799) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:17:21.522670 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-ce2e13a7-23a7-4d65-bcc6-5097b6a87273 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] 10.222.0.17 "GET /compute/v2.1/servers/18882ea3-d64e-4894-b42d-9769383c4668" status: 200 len: 1242 microversion: 2.1 time: 0.071800 Aug 23 07:17:21.523237 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 293/563] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:17:21 2022] GET /compute/v2.1/servers/18882ea3-d64e-4894-b42d-9769383c4668 => generated 1242 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:17:22.544483 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-a6f8d513-d76e-4901-bdcb-a21acb37c434 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Calling method '>' {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:17:22.545716 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.compute.api [None req-a6f8d513-d76e-4901-bdcb-a21acb37c434 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] [instance: 18882ea3-d64e-4894-b42d-9769383c4668] Fetching instance by UUID {{(pid=120798) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:17:22.552433 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-a6f8d513-d76e-4901-bdcb-a21acb37c434 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:17:22.552901 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-a6f8d513-d76e-4901-bdcb-a21acb37c434 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:17:22.553357 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-a6f8d513-d76e-4901-bdcb-a21acb37c434 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:17:22.554043 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-a6f8d513-d76e-4901-bdcb-a21acb37c434 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:17:22.554486 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-a6f8d513-d76e-4901-bdcb-a21acb37c434 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:17:22.554965 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-a6f8d513-d76e-4901-bdcb-a21acb37c434 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:17:22.631805 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.policy [None req-a6f8d513-d76e-4901-bdcb-a21acb37c434 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '471dc5c1db64411ab1d80ad6c038e519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb44f62fa62e46528712f24479cbb19f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120798) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:17:22.639989 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [None req-a6f8d513-d76e-4901-bdcb-a21acb37c434 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] 10.222.0.17 "GET /compute/v2.1/servers/18882ea3-d64e-4894-b42d-9769383c4668" status: 200 len: 1302 microversion: 2.1 time: 0.100283 Aug 23 07:17:22.640564 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 271/564] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:17:22 2022] GET /compute/v2.1/servers/18882ea3-d64e-4894-b42d-9769383c4668 => generated 1302 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:17:23.660625 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-115e88bf-5378-4c6a-9ff6-1725441ffa3e tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Calling method '>' {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:17:23.661229 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.compute.api [None req-115e88bf-5378-4c6a-9ff6-1725441ffa3e tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] [instance: 18882ea3-d64e-4894-b42d-9769383c4668] Fetching instance by UUID {{(pid=120799) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:17:23.668155 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-115e88bf-5378-4c6a-9ff6-1725441ffa3e tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:17:23.668625 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-115e88bf-5378-4c6a-9ff6-1725441ffa3e tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:17:23.669055 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-115e88bf-5378-4c6a-9ff6-1725441ffa3e tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:17:23.669907 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-115e88bf-5378-4c6a-9ff6-1725441ffa3e tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:17:23.670919 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-115e88bf-5378-4c6a-9ff6-1725441ffa3e tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:17:23.671351 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-115e88bf-5378-4c6a-9ff6-1725441ffa3e tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:17:23.805682 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.policy [None req-115e88bf-5378-4c6a-9ff6-1725441ffa3e tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '471dc5c1db64411ab1d80ad6c038e519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb44f62fa62e46528712f24479cbb19f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120799) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:17:23.813979 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-115e88bf-5378-4c6a-9ff6-1725441ffa3e tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] 10.222.0.17 "GET /compute/v2.1/servers/18882ea3-d64e-4894-b42d-9769383c4668" status: 200 len: 1368 microversion: 2.1 time: 0.157131 Aug 23 07:17:23.815061 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 294/565] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:17:23 2022] GET /compute/v2.1/servers/18882ea3-d64e-4894-b42d-9769383c4668 => generated 1368 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:17:23.882860 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [req-98bae089-438e-470f-93f5-8ccf4eb0a85d req-326be7a6-1251-44f3-ad29-0d6ab50daed7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "18882ea3-d64e-4894-b42d-9769383c4668", "tag": "daf9b2c2-bba6-4920-99e0-34f072476b94"}]} {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 07:17:23.897802 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [req-98bae089-438e-470f-93f5-8ccf4eb0a85d req-326be7a6-1251-44f3-ad29-0d6ab50daed7 service nova] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:17:23.898293 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [req-98bae089-438e-470f-93f5-8ccf4eb0a85d req-326be7a6-1251-44f3-ad29-0d6ab50daed7 service nova] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:17:23.898720 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [req-98bae089-438e-470f-93f5-8ccf4eb0a85d req-326be7a6-1251-44f3-ad29-0d6ab50daed7 service nova] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:17:23.913568 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.compute.server_external_events [req-98bae089-438e-470f-93f5-8ccf4eb0a85d req-326be7a6-1251-44f3-ad29-0d6ab50daed7 service nova] Creating event network-changed:daf9b2c2-bba6-4920-99e0-34f072476b94 for instance 18882ea3-d64e-4894-b42d-9769383c4668 on hv-cinder-85409 Aug 23 07:17:23.918694 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [req-98bae089-438e-470f-93f5-8ccf4eb0a85d req-326be7a6-1251-44f3-ad29-0d6ab50daed7 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040653 Aug 23 07:17:23.920981 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 272/566] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Aug 23 07:17:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 07:17:24.021209 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-baf5e7b8-b208-4173-8325-12a2fb2f399a tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Calling method '>' {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:17:24.021695 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.compute.api [None req-baf5e7b8-b208-4173-8325-12a2fb2f399a tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] [instance: b9418fe6-a57e-4a99-becb-19a4d3a52da1] Fetching instance by UUID {{(pid=120799) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:17:24.027914 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-baf5e7b8-b208-4173-8325-12a2fb2f399a tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:17:24.028394 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-baf5e7b8-b208-4173-8325-12a2fb2f399a tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:17:24.028822 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-baf5e7b8-b208-4173-8325-12a2fb2f399a tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:17:24.029489 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-baf5e7b8-b208-4173-8325-12a2fb2f399a tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:17:24.030138 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-baf5e7b8-b208-4173-8325-12a2fb2f399a tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:17:24.030540 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-baf5e7b8-b208-4173-8325-12a2fb2f399a tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:17:24.111770 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.objects.instance [None req-baf5e7b8-b208-4173-8325-12a2fb2f399a tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lazy-loading 'services' on Instance uuid b9418fe6-a57e-4a99-becb-19a4d3a52da1 {{(pid=120799) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 07:17:24.188289 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-baf5e7b8-b208-4173-8325-12a2fb2f399a tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] 10.222.0.17 "DELETE /compute/v2.1/servers/b9418fe6-a57e-4a99-becb-19a4d3a52da1/os-volume_attachments/add11750-9e29-4afe-a3ac-ef016ecf7161" status: 202 len: 0 microversion: 2.1 time: 0.170871 Aug 23 07:17:24.188875 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 295/567] 10.222.0.17 () {58 vars in 1416 bytes} [Tue Aug 23 07:17:24 2022] DELETE /compute/v2.1/servers/b9418fe6-a57e-4a99-becb-19a4d3a52da1/os-volume_attachments/add11750-9e29-4afe-a3ac-ef016ecf7161 => generated 0 bytes in 172 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 07:17:24.199237 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-c40ddaec-d866-45ba-b513-052738897a7b tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Calling method '>' {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:17:24.201754 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.compute.api [None req-c40ddaec-d866-45ba-b513-052738897a7b tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] [instance: b9418fe6-a57e-4a99-becb-19a4d3a52da1] Fetching instance by UUID {{(pid=120798) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:17:24.208700 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-c40ddaec-d866-45ba-b513-052738897a7b tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:17:24.209342 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-c40ddaec-d866-45ba-b513-052738897a7b tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:17:24.210007 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-c40ddaec-d866-45ba-b513-052738897a7b tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:17:24.211003 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-c40ddaec-d866-45ba-b513-052738897a7b tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:17:24.211501 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-c40ddaec-d866-45ba-b513-052738897a7b tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:17:24.212024 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-c40ddaec-d866-45ba-b513-052738897a7b tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:17:24.239875 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG dbcounter [-] [120798] Writing DB stats nova_cell1:SELECT=100 {{(pid=120798) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:17:24.255476 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [None req-c40ddaec-d866-45ba-b513-052738897a7b tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] 10.222.0.17 "GET /compute/v2.1/servers/b9418fe6-a57e-4a99-becb-19a4d3a52da1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.060972 Aug 23 07:17:24.256456 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 273/568] 10.222.0.17 () {58 vars in 1302 bytes} [Tue Aug 23 07:17:24 2022] GET /compute/v2.1/servers/b9418fe6-a57e-4a99-becb-19a4d3a52da1/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 07:17:24.840842 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-b91fdb85-9f88-44ff-a846-ff474e125681 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Calling method '>' {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:17:24.841620 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.compute.api [None req-b91fdb85-9f88-44ff-a846-ff474e125681 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] [instance: 18882ea3-d64e-4894-b42d-9769383c4668] Fetching instance by UUID {{(pid=120799) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:17:24.853754 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-b91fdb85-9f88-44ff-a846-ff474e125681 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:17:24.854283 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-b91fdb85-9f88-44ff-a846-ff474e125681 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:17:24.854753 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-b91fdb85-9f88-44ff-a846-ff474e125681 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:17:24.855537 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-b91fdb85-9f88-44ff-a846-ff474e125681 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:17:24.856020 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-b91fdb85-9f88-44ff-a846-ff474e125681 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:17:24.856846 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-b91fdb85-9f88-44ff-a846-ff474e125681 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:17:25.002054 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.policy [None req-b91fdb85-9f88-44ff-a846-ff474e125681 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '471dc5c1db64411ab1d80ad6c038e519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb44f62fa62e46528712f24479cbb19f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120799) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:17:25.010281 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-b91fdb85-9f88-44ff-a846-ff474e125681 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] 10.222.0.17 "GET /compute/v2.1/servers/18882ea3-d64e-4894-b42d-9769383c4668" status: 200 len: 1368 microversion: 2.1 time: 0.175084 Aug 23 07:17:25.010816 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 296/569] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:17:24 2022] GET /compute/v2.1/servers/18882ea3-d64e-4894-b42d-9769383c4668 => generated 1368 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:17:25.270108 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-f58c139b-0dd1-4e18-92b3-c7f0bd9c6af9 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Calling method '>' {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:17:25.272736 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.compute.api [None req-f58c139b-0dd1-4e18-92b3-c7f0bd9c6af9 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] [instance: b9418fe6-a57e-4a99-becb-19a4d3a52da1] Fetching instance by UUID {{(pid=120798) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:17:25.280746 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-f58c139b-0dd1-4e18-92b3-c7f0bd9c6af9 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:17:25.281204 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-f58c139b-0dd1-4e18-92b3-c7f0bd9c6af9 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:17:25.281647 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-f58c139b-0dd1-4e18-92b3-c7f0bd9c6af9 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:17:25.282325 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-f58c139b-0dd1-4e18-92b3-c7f0bd9c6af9 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:17:25.282776 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-f58c139b-0dd1-4e18-92b3-c7f0bd9c6af9 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:17:25.283199 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-f58c139b-0dd1-4e18-92b3-c7f0bd9c6af9 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:17:25.314690 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [None req-f58c139b-0dd1-4e18-92b3-c7f0bd9c6af9 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] 10.222.0.17 "GET /compute/v2.1/servers/b9418fe6-a57e-4a99-becb-19a4d3a52da1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049659 Aug 23 07:17:25.315241 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 274/570] 10.222.0.17 () {58 vars in 1302 bytes} [Tue Aug 23 07:17:25 2022] GET /compute/v2.1/servers/b9418fe6-a57e-4a99-becb-19a4d3a52da1/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 07:17:26.031147 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-e671438f-c81f-45fe-a5a2-9d24808c70e7 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Calling method '>' {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:17:26.031795 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.compute.api [None req-e671438f-c81f-45fe-a5a2-9d24808c70e7 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] [instance: 18882ea3-d64e-4894-b42d-9769383c4668] Fetching instance by UUID {{(pid=120799) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:17:26.038446 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-e671438f-c81f-45fe-a5a2-9d24808c70e7 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:17:26.038938 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-e671438f-c81f-45fe-a5a2-9d24808c70e7 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:17:26.039346 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-e671438f-c81f-45fe-a5a2-9d24808c70e7 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:17:26.040087 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-e671438f-c81f-45fe-a5a2-9d24808c70e7 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:17:26.040611 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-e671438f-c81f-45fe-a5a2-9d24808c70e7 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:17:26.041022 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-e671438f-c81f-45fe-a5a2-9d24808c70e7 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:17:26.225882 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.policy [None req-e671438f-c81f-45fe-a5a2-9d24808c70e7 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '471dc5c1db64411ab1d80ad6c038e519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb44f62fa62e46528712f24479cbb19f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120799) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:17:26.234369 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-e671438f-c81f-45fe-a5a2-9d24808c70e7 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] 10.222.0.17 "GET /compute/v2.1/servers/18882ea3-d64e-4894-b42d-9769383c4668" status: 200 len: 1368 microversion: 2.1 time: 0.207861 Aug 23 07:17:26.234941 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 297/571] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:17:26 2022] GET /compute/v2.1/servers/18882ea3-d64e-4894-b42d-9769383c4668 => generated 1368 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:17:26.330641 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-6673abc0-b65e-4ab7-85ba-0bcc6525df10 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Calling method '>' {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:17:26.333303 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.compute.api [None req-6673abc0-b65e-4ab7-85ba-0bcc6525df10 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] [instance: b9418fe6-a57e-4a99-becb-19a4d3a52da1] Fetching instance by UUID {{(pid=120798) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:17:26.342045 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-6673abc0-b65e-4ab7-85ba-0bcc6525df10 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:17:26.342556 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-6673abc0-b65e-4ab7-85ba-0bcc6525df10 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:17:26.343131 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-6673abc0-b65e-4ab7-85ba-0bcc6525df10 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:17:26.344013 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-6673abc0-b65e-4ab7-85ba-0bcc6525df10 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:17:26.344568 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-6673abc0-b65e-4ab7-85ba-0bcc6525df10 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:17:26.345086 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-6673abc0-b65e-4ab7-85ba-0bcc6525df10 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:17:26.377192 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [None req-6673abc0-b65e-4ab7-85ba-0bcc6525df10 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] 10.222.0.17 "GET /compute/v2.1/servers/b9418fe6-a57e-4a99-becb-19a4d3a52da1/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.052556 Aug 23 07:17:26.377805 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 275/572] 10.222.0.17 () {58 vars in 1302 bytes} [Tue Aug 23 07:17:26 2022] GET /compute/v2.1/servers/b9418fe6-a57e-4a99-becb-19a4d3a52da1/os-volume_attachments => generated 25 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 23 07:17:26.454780 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-376dcf69-143a-41b0-a91a-d2753ba3ec46 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Calling method '>' {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:17:26.455268 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.compute.api [None req-376dcf69-143a-41b0-a91a-d2753ba3ec46 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] [instance: b9418fe6-a57e-4a99-becb-19a4d3a52da1] Fetching instance by UUID {{(pid=120799) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:17:26.461554 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-376dcf69-143a-41b0-a91a-d2753ba3ec46 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:17:26.462037 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-376dcf69-143a-41b0-a91a-d2753ba3ec46 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:17:26.462451 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-376dcf69-143a-41b0-a91a-d2753ba3ec46 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:17:26.463126 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-376dcf69-143a-41b0-a91a-d2753ba3ec46 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:17:26.463608 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-376dcf69-143a-41b0-a91a-d2753ba3ec46 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:17:26.464027 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-376dcf69-143a-41b0-a91a-d2753ba3ec46 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:17:26.489536 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.compute.api [None req-376dcf69-143a-41b0-a91a-d2753ba3ec46 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] [instance: b9418fe6-a57e-4a99-becb-19a4d3a52da1] Going to try to terminate instance {{(pid=120799) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 07:17:26.574414 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-376dcf69-143a-41b0-a91a-d2753ba3ec46 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] 10.222.0.17 "DELETE /compute/v2.1/servers/b9418fe6-a57e-4a99-becb-19a4d3a52da1" status: 204 len: 0 microversion: 2.1 time: 0.123590 Aug 23 07:17:26.575136 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 298/573] 10.222.0.17 () {58 vars in 1239 bytes} [Tue Aug 23 07:17:26 2022] DELETE /compute/v2.1/servers/b9418fe6-a57e-4a99-becb-19a4d3a52da1 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 23 07:17:26.583356 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-8cefaea1-5304-4a97-a8fe-0e905fa21585 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Calling method '>' {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:17:26.584010 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.compute.api [None req-8cefaea1-5304-4a97-a8fe-0e905fa21585 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] [instance: b9418fe6-a57e-4a99-becb-19a4d3a52da1] Fetching instance by UUID {{(pid=120798) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:17:26.590514 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-8cefaea1-5304-4a97-a8fe-0e905fa21585 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:17:26.590982 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-8cefaea1-5304-4a97-a8fe-0e905fa21585 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:17:26.591447 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-8cefaea1-5304-4a97-a8fe-0e905fa21585 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:17:26.592533 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-8cefaea1-5304-4a97-a8fe-0e905fa21585 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:17:26.592974 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-8cefaea1-5304-4a97-a8fe-0e905fa21585 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:17:26.593390 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-8cefaea1-5304-4a97-a8fe-0e905fa21585 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:17:26.730327 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.policy [None req-8cefaea1-5304-4a97-a8fe-0e905fa21585 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64d54cb95b264c18b45d90822507fae1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135367be6e3f4b3d965ee0d99fdca524', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120798) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:17:26.738707 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [None req-8cefaea1-5304-4a97-a8fe-0e905fa21585 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] 10.222.0.17 "GET /compute/v2.1/servers/b9418fe6-a57e-4a99-becb-19a4d3a52da1" status: 200 len: 1690 microversion: 2.1 time: 0.159227 Aug 23 07:17:26.739287 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 276/574] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:17:26 2022] GET /compute/v2.1/servers/b9418fe6-a57e-4a99-becb-19a4d3a52da1 => generated 1690 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:17:27.328108 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-13d3c5d2-f854-44d0-abc8-cd3d488e33aa tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Calling method '>' {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:17:27.328969 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.compute.api [None req-13d3c5d2-f854-44d0-abc8-cd3d488e33aa tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] [instance: 18882ea3-d64e-4894-b42d-9769383c4668] Fetching instance by UUID {{(pid=120799) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:17:27.338428 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-13d3c5d2-f854-44d0-abc8-cd3d488e33aa tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:17:27.339003 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-13d3c5d2-f854-44d0-abc8-cd3d488e33aa tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:17:27.339639 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-13d3c5d2-f854-44d0-abc8-cd3d488e33aa tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:17:27.340613 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-13d3c5d2-f854-44d0-abc8-cd3d488e33aa tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:17:27.341069 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-13d3c5d2-f854-44d0-abc8-cd3d488e33aa tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:17:27.341832 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-13d3c5d2-f854-44d0-abc8-cd3d488e33aa tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:17:27.487772 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.policy [None req-13d3c5d2-f854-44d0-abc8-cd3d488e33aa tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '471dc5c1db64411ab1d80ad6c038e519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb44f62fa62e46528712f24479cbb19f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120799) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:17:27.495746 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-13d3c5d2-f854-44d0-abc8-cd3d488e33aa tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] 10.222.0.17 "GET /compute/v2.1/servers/18882ea3-d64e-4894-b42d-9769383c4668" status: 200 len: 1368 microversion: 2.1 time: 0.242609 Aug 23 07:17:27.496305 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 299/575] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:17:27 2022] GET /compute/v2.1/servers/18882ea3-d64e-4894-b42d-9769383c4668 => generated 1368 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:17:27.762079 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-13f2737a-c0c0-4ff1-9abd-31dc262aafe1 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Calling method '>' {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:17:27.762876 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.compute.api [None req-13f2737a-c0c0-4ff1-9abd-31dc262aafe1 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] [instance: b9418fe6-a57e-4a99-becb-19a4d3a52da1] Fetching instance by UUID {{(pid=120798) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:17:27.770091 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-13f2737a-c0c0-4ff1-9abd-31dc262aafe1 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:17:27.770571 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-13f2737a-c0c0-4ff1-9abd-31dc262aafe1 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:17:27.770995 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-13f2737a-c0c0-4ff1-9abd-31dc262aafe1 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:17:27.771711 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-13f2737a-c0c0-4ff1-9abd-31dc262aafe1 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:17:27.772154 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-13f2737a-c0c0-4ff1-9abd-31dc262aafe1 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:17:27.772570 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-13f2737a-c0c0-4ff1-9abd-31dc262aafe1 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:17:27.907617 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.policy [None req-13f2737a-c0c0-4ff1-9abd-31dc262aafe1 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64d54cb95b264c18b45d90822507fae1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135367be6e3f4b3d965ee0d99fdca524', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120798) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:17:27.915863 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [None req-13f2737a-c0c0-4ff1-9abd-31dc262aafe1 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] 10.222.0.17 "GET /compute/v2.1/servers/b9418fe6-a57e-4a99-becb-19a4d3a52da1" status: 200 len: 1690 microversion: 2.1 time: 0.158824 Aug 23 07:17:27.916349 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 277/576] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:17:27 2022] GET /compute/v2.1/servers/b9418fe6-a57e-4a99-becb-19a4d3a52da1 => generated 1690 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:17:28.518350 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-88643dab-c4f2-4eec-b310-ad13c0393d0e tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Calling method '>' {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:17:28.519128 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.compute.api [None req-88643dab-c4f2-4eec-b310-ad13c0393d0e tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] [instance: 18882ea3-d64e-4894-b42d-9769383c4668] Fetching instance by UUID {{(pid=120799) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:17:28.526301 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-88643dab-c4f2-4eec-b310-ad13c0393d0e tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:17:28.526769 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-88643dab-c4f2-4eec-b310-ad13c0393d0e tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:17:28.527190 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-88643dab-c4f2-4eec-b310-ad13c0393d0e tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:17:28.527886 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-88643dab-c4f2-4eec-b310-ad13c0393d0e tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:17:28.528325 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-88643dab-c4f2-4eec-b310-ad13c0393d0e tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:17:28.528731 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-88643dab-c4f2-4eec-b310-ad13c0393d0e tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:17:28.663082 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.policy [None req-88643dab-c4f2-4eec-b310-ad13c0393d0e tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '471dc5c1db64411ab1d80ad6c038e519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb44f62fa62e46528712f24479cbb19f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120799) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:17:28.671502 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-88643dab-c4f2-4eec-b310-ad13c0393d0e tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] 10.222.0.17 "GET /compute/v2.1/servers/18882ea3-d64e-4894-b42d-9769383c4668" status: 200 len: 1368 microversion: 2.1 time: 0.157361 Aug 23 07:17:28.672680 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 300/577] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:17:28 2022] GET /compute/v2.1/servers/18882ea3-d64e-4894-b42d-9769383c4668 => generated 1368 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:17:28.937390 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-f6324386-54b1-4064-9f09-1762be310eb5 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Calling method '>' {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:17:28.937943 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.compute.api [None req-f6324386-54b1-4064-9f09-1762be310eb5 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] [instance: b9418fe6-a57e-4a99-becb-19a4d3a52da1] Fetching instance by UUID {{(pid=120798) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:17:28.944623 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-f6324386-54b1-4064-9f09-1762be310eb5 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:17:28.945112 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-f6324386-54b1-4064-9f09-1762be310eb5 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:17:28.945536 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-f6324386-54b1-4064-9f09-1762be310eb5 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:17:28.946223 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-f6324386-54b1-4064-9f09-1762be310eb5 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:17:28.946668 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-f6324386-54b1-4064-9f09-1762be310eb5 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:17:28.947086 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-f6324386-54b1-4064-9f09-1762be310eb5 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:17:29.091022 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.policy [None req-f6324386-54b1-4064-9f09-1762be310eb5 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64d54cb95b264c18b45d90822507fae1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135367be6e3f4b3d965ee0d99fdca524', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120798) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:17:29.099482 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [None req-f6324386-54b1-4064-9f09-1762be310eb5 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] 10.222.0.17 "GET /compute/v2.1/servers/b9418fe6-a57e-4a99-becb-19a4d3a52da1" status: 200 len: 1690 microversion: 2.1 time: 0.166735 Aug 23 07:17:29.100070 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 278/578] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:17:28 2022] GET /compute/v2.1/servers/b9418fe6-a57e-4a99-becb-19a4d3a52da1 => generated 1690 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:17:29.692477 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-f1e8299c-01e9-44a8-9516-5c55e33c4879 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Calling method '>' {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:17:29.693102 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.compute.api [None req-f1e8299c-01e9-44a8-9516-5c55e33c4879 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] [instance: 18882ea3-d64e-4894-b42d-9769383c4668] Fetching instance by UUID {{(pid=120799) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:17:29.700006 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-f1e8299c-01e9-44a8-9516-5c55e33c4879 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:17:29.700484 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-f1e8299c-01e9-44a8-9516-5c55e33c4879 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:17:29.701163 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-f1e8299c-01e9-44a8-9516-5c55e33c4879 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:17:29.701928 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-f1e8299c-01e9-44a8-9516-5c55e33c4879 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:17:29.702357 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-f1e8299c-01e9-44a8-9516-5c55e33c4879 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:17:29.702807 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-f1e8299c-01e9-44a8-9516-5c55e33c4879 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:17:29.838400 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.policy [None req-f1e8299c-01e9-44a8-9516-5c55e33c4879 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '471dc5c1db64411ab1d80ad6c038e519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb44f62fa62e46528712f24479cbb19f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120799) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:17:29.846568 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-f1e8299c-01e9-44a8-9516-5c55e33c4879 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] 10.222.0.17 "GET /compute/v2.1/servers/18882ea3-d64e-4894-b42d-9769383c4668" status: 200 len: 1368 microversion: 2.1 time: 0.158355 Aug 23 07:17:29.847104 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 301/579] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:17:29 2022] GET /compute/v2.1/servers/18882ea3-d64e-4894-b42d-9769383c4668 => generated 1368 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:17:30.124106 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-a03defdc-b799-40e4-8c15-dfc032332098 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Calling method '>' {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:17:30.124861 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.compute.api [None req-a03defdc-b799-40e4-8c15-dfc032332098 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] [instance: b9418fe6-a57e-4a99-becb-19a4d3a52da1] Fetching instance by UUID {{(pid=120798) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:17:30.134346 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-a03defdc-b799-40e4-8c15-dfc032332098 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:17:30.135020 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-a03defdc-b799-40e4-8c15-dfc032332098 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:17:30.135743 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-a03defdc-b799-40e4-8c15-dfc032332098 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:17:30.136685 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-a03defdc-b799-40e4-8c15-dfc032332098 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:17:30.137388 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-a03defdc-b799-40e4-8c15-dfc032332098 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:17:30.137971 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-a03defdc-b799-40e4-8c15-dfc032332098 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:17:30.270389 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.policy [None req-a03defdc-b799-40e4-8c15-dfc032332098 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64d54cb95b264c18b45d90822507fae1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135367be6e3f4b3d965ee0d99fdca524', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120798) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:17:30.278446 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [None req-a03defdc-b799-40e4-8c15-dfc032332098 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] 10.222.0.17 "GET /compute/v2.1/servers/b9418fe6-a57e-4a99-becb-19a4d3a52da1" status: 200 len: 1690 microversion: 2.1 time: 0.159984 Aug 23 07:17:30.279046 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 279/580] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:17:30 2022] GET /compute/v2.1/servers/b9418fe6-a57e-4a99-becb-19a4d3a52da1 => generated 1690 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:17:30.589056 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [req-03ecb525-45e3-421b-a6e9-831000249c58 req-3857f10d-1887-4207-9879-a9a90033b553 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "18882ea3-d64e-4894-b42d-9769383c4668", "name": "network-vif-plugged", "status": "completed", "tag": "daf9b2c2-bba6-4920-99e0-34f072476b94"}]} {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 07:17:30.599002 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG dbcounter [-] [120799] Writing DB stats nova_api:SELECT=73,nova_api:UPDATE=2,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=120799) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:17:30.610563 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [req-03ecb525-45e3-421b-a6e9-831000249c58 req-3857f10d-1887-4207-9879-a9a90033b553 service nova] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:17:30.611537 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [req-03ecb525-45e3-421b-a6e9-831000249c58 req-3857f10d-1887-4207-9879-a9a90033b553 service nova] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:17:30.612286 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [req-03ecb525-45e3-421b-a6e9-831000249c58 req-3857f10d-1887-4207-9879-a9a90033b553 service nova] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:17:30.634841 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.compute.server_external_events [req-03ecb525-45e3-421b-a6e9-831000249c58 req-3857f10d-1887-4207-9879-a9a90033b553 service nova] Creating event network-vif-plugged:daf9b2c2-bba6-4920-99e0-34f072476b94 for instance 18882ea3-d64e-4894-b42d-9769383c4668 on hv-cinder-85409 Aug 23 07:17:30.643715 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [req-03ecb525-45e3-421b-a6e9-831000249c58 req-3857f10d-1887-4207-9879-a9a90033b553 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059057 Aug 23 07:17:30.644773 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 302/581] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Aug 23 07:17:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 07:17:30.874183 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-647d3b49-aa28-4d9e-bea1-3275f8738c4c tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Calling method '>' {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:17:30.875153 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.compute.api [None req-647d3b49-aa28-4d9e-bea1-3275f8738c4c tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] [instance: 18882ea3-d64e-4894-b42d-9769383c4668] Fetching instance by UUID {{(pid=120798) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:17:30.878449 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG dbcounter [-] [120798] Writing DB stats nova_api:SELECT=64,nova_api:INSERT=3 {{(pid=120798) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:17:30.882491 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-647d3b49-aa28-4d9e-bea1-3275f8738c4c tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:17:30.883218 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-647d3b49-aa28-4d9e-bea1-3275f8738c4c tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:17:30.883894 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-647d3b49-aa28-4d9e-bea1-3275f8738c4c tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:17:30.884896 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-647d3b49-aa28-4d9e-bea1-3275f8738c4c tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:17:30.885550 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-647d3b49-aa28-4d9e-bea1-3275f8738c4c tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:17:30.886211 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-647d3b49-aa28-4d9e-bea1-3275f8738c4c tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:17:31.025409 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.policy [None req-647d3b49-aa28-4d9e-bea1-3275f8738c4c tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '471dc5c1db64411ab1d80ad6c038e519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb44f62fa62e46528712f24479cbb19f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120798) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:17:31.026842 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [req-8d3d2a68-f5f2-447a-8b74-ef144db11c99 req-dabdcb91-f89f-4296-b1de-e587403bc1c4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b9418fe6-a57e-4a99-becb-19a4d3a52da1", "name": "network-vif-deleted", "tag": "13257b29-baec-4cb2-9910-64f78a6db6ba"}]} {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 07:17:31.033764 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [None req-647d3b49-aa28-4d9e-bea1-3275f8738c4c tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] 10.222.0.17 "GET /compute/v2.1/servers/18882ea3-d64e-4894-b42d-9769383c4668" status: 200 len: 1368 microversion: 2.1 time: 0.163336 Aug 23 07:17:31.035119 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 280/582] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:17:30 2022] GET /compute/v2.1/servers/18882ea3-d64e-4894-b42d-9769383c4668 => generated 1368 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:17:31.040664 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [req-8d3d2a68-f5f2-447a-8b74-ef144db11c99 req-dabdcb91-f89f-4296-b1de-e587403bc1c4 service nova] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:17:31.041215 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [req-8d3d2a68-f5f2-447a-8b74-ef144db11c99 req-dabdcb91-f89f-4296-b1de-e587403bc1c4 service nova] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:17:31.041698 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [req-8d3d2a68-f5f2-447a-8b74-ef144db11c99 req-dabdcb91-f89f-4296-b1de-e587403bc1c4 service nova] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:17:31.053667 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.compute.server_external_events [req-8d3d2a68-f5f2-447a-8b74-ef144db11c99 req-dabdcb91-f89f-4296-b1de-e587403bc1c4 service nova] Creating event network-vif-deleted:13257b29-baec-4cb2-9910-64f78a6db6ba for instance b9418fe6-a57e-4a99-becb-19a4d3a52da1 on hv-cinder-85409 Aug 23 07:17:31.058730 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [req-8d3d2a68-f5f2-447a-8b74-ef144db11c99 req-dabdcb91-f89f-4296-b1de-e587403bc1c4 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037449 Aug 23 07:17:31.059385 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 303/583] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Aug 23 07:17:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 07:17:31.302919 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-ec3b03c0-2b7a-47fe-93a5-de69f38d3c72 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Calling method '>' {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:17:31.303641 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.compute.api [None req-ec3b03c0-2b7a-47fe-93a5-de69f38d3c72 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] [instance: b9418fe6-a57e-4a99-becb-19a4d3a52da1] Fetching instance by UUID {{(pid=120798) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:17:31.312921 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-ec3b03c0-2b7a-47fe-93a5-de69f38d3c72 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:17:31.313417 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-ec3b03c0-2b7a-47fe-93a5-de69f38d3c72 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:17:31.313851 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-ec3b03c0-2b7a-47fe-93a5-de69f38d3c72 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:17:31.314558 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-ec3b03c0-2b7a-47fe-93a5-de69f38d3c72 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:17:31.315011 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-ec3b03c0-2b7a-47fe-93a5-de69f38d3c72 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:17:31.315498 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-ec3b03c0-2b7a-47fe-93a5-de69f38d3c72 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:17:31.348277 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-ec3b03c0-2b7a-47fe-93a5-de69f38d3c72 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:17:31.348764 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-ec3b03c0-2b7a-47fe-93a5-de69f38d3c72 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:17:31.349196 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-ec3b03c0-2b7a-47fe-93a5-de69f38d3c72 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:17:31.349642 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.objects.instance [None req-ec3b03c0-2b7a-47fe-93a5-de69f38d3c72 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lazy-loading 'fault' on Instance uuid b9418fe6-a57e-4a99-becb-19a4d3a52da1 {{(pid=120798) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 07:17:31.364356 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG dbcounter [-] [120798] Writing DB stats nova_cell0:SELECT=2 {{(pid=120798) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:17:31.387651 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG dbcounter [-] [120798] Writing DB stats nova_cell0:SELECT=6 {{(pid=120798) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:17:31.392036 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.policy [None req-ec3b03c0-2b7a-47fe-93a5-de69f38d3c72 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64d54cb95b264c18b45d90822507fae1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135367be6e3f4b3d965ee0d99fdca524', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120798) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:17:31.400496 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [None req-ec3b03c0-2b7a-47fe-93a5-de69f38d3c72 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] 10.222.0.17 "GET /compute/v2.1/servers/b9418fe6-a57e-4a99-becb-19a4d3a52da1" status: 200 len: 1335 microversion: 2.1 time: 0.104259 Aug 23 07:17:31.401081 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 281/584] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:17:31 2022] GET /compute/v2.1/servers/b9418fe6-a57e-4a99-becb-19a4d3a52da1 => generated 1335 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:17:32.057111 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-b7c80bf6-3e8e-43f1-8b8b-d3db4ef233e0 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Calling method '>' {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:17:32.057834 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.compute.api [None req-b7c80bf6-3e8e-43f1-8b8b-d3db4ef233e0 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] [instance: 18882ea3-d64e-4894-b42d-9769383c4668] Fetching instance by UUID {{(pid=120799) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:17:32.059932 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG dbcounter [-] [120799] Writing DB stats nova_cell0:SELECT=6 {{(pid=120799) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:17:32.066669 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-b7c80bf6-3e8e-43f1-8b8b-d3db4ef233e0 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:17:32.067145 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-b7c80bf6-3e8e-43f1-8b8b-d3db4ef233e0 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:17:32.067602 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-b7c80bf6-3e8e-43f1-8b8b-d3db4ef233e0 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:17:32.068289 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-b7c80bf6-3e8e-43f1-8b8b-d3db4ef233e0 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:17:32.068732 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-b7c80bf6-3e8e-43f1-8b8b-d3db4ef233e0 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:17:32.069147 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-b7c80bf6-3e8e-43f1-8b8b-d3db4ef233e0 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:17:32.211775 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.policy [None req-b7c80bf6-3e8e-43f1-8b8b-d3db4ef233e0 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '471dc5c1db64411ab1d80ad6c038e519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb44f62fa62e46528712f24479cbb19f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120799) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:17:32.219591 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-b7c80bf6-3e8e-43f1-8b8b-d3db4ef233e0 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] 10.222.0.17 "GET /compute/v2.1/servers/18882ea3-d64e-4894-b42d-9769383c4668" status: 200 len: 1368 microversion: 2.1 time: 0.166728 Aug 23 07:17:32.220150 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 304/585] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:17:32 2022] GET /compute/v2.1/servers/18882ea3-d64e-4894-b42d-9769383c4668 => generated 1368 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:17:32.423724 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-0101961d-6270-43f8-8a46-92e39de8ffbc tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Calling method '>' {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:17:32.424335 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.compute.api [None req-0101961d-6270-43f8-8a46-92e39de8ffbc tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] [instance: b9418fe6-a57e-4a99-becb-19a4d3a52da1] Fetching instance by UUID {{(pid=120798) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:17:32.431138 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-0101961d-6270-43f8-8a46-92e39de8ffbc tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:17:32.431650 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-0101961d-6270-43f8-8a46-92e39de8ffbc tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:17:32.432058 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-0101961d-6270-43f8-8a46-92e39de8ffbc tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:17:32.432753 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-0101961d-6270-43f8-8a46-92e39de8ffbc tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:17:32.433199 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-0101961d-6270-43f8-8a46-92e39de8ffbc tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:17:32.433618 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-0101961d-6270-43f8-8a46-92e39de8ffbc tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:17:32.447227 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.wsgi [None req-0101961d-6270-43f8-8a46-92e39de8ffbc tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] HTTP exception thrown: Instance b9418fe6-a57e-4a99-becb-19a4d3a52da1 could not be found. Aug 23 07:17:32.448910 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-0101961d-6270-43f8-8a46-92e39de8ffbc tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Request method failure captured: Aug 23 07:17:32.448910 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: request: GET /compute/v2.1/servers/b9418fe6-a57e-4a99-becb-19a4d3a52da1 HTTP/1.1 Aug 23 07:17:32.448910 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: Accept: application/json Aug 23 07:17:32.448910 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: Accept-Encoding: identity Aug 23 07:17:32.448910 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: Connection: close Aug 23 07:17:32.448910 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: Content-Length: 0 Aug 23 07:17:32.448910 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: Content-Type: application/json Aug 23 07:17:32.448910 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: Host: 10.222.0.17 Aug 23 07:17:32.448910 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: Openstack-System-Scope: None Aug 23 07:17:32.448910 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: User-Agent: python-urllib3/1.26.11 Aug 23 07:17:32.448910 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-Auth-Token: gAAAAABjBH3RTnj580A9ihENlvyGo9Owk2endPDkKW0IbgiaI59nvL65tV9bcHDATbv_TF-j5yNJo86nqcfzcR4EFG9DSwxV6zk_8rKGHN_TbC5GCjcEeyjsLvDIF_O9EwwjUk3-u0A9pdTbyVuUJI9H9X2YTFvkkjoRacmsfuB_sypDT5kcQO8 Aug 23 07:17:32.448910 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-Domain-Id: None Aug 23 07:17:32.448910 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-Domain-Name: None Aug 23 07:17:32.448910 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-Identity-Status: Confirmed Aug 23 07:17:32.448910 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-Is-Admin-Project: True Aug 23 07:17:32.448910 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-Project-Domain-Id: default Aug 23 07:17:32.448910 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-Project-Domain-Name: Default Aug 23 07:17:32.448910 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-Project-Id: 135367be6e3f4b3d965ee0d99fdca524 Aug 23 07:17:32.448910 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-260324431 Aug 23 07:17:32.448910 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-Role: reader,member Aug 23 07:17:32.448910 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-Roles: reader,member Aug 23 07:17:32.450411 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/135367be6e3f4b3d965ee0d99fdca524"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/135367be6e3f4b3d965ee0d99fdca524"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_135367be6e3f4b3d965ee0d99fdca524"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/135367be6e3f4b3d965ee0d99fdca524"}]}] Aug 23 07:17:32.450411 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-Tenant: tempest-ServerRescueNegativeTestJSON-260324431 Aug 23 07:17:32.450411 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-Tenant-Id: 135367be6e3f4b3d965ee0d99fdca524 Aug 23 07:17:32.450411 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-260324431 Aug 23 07:17:32.450411 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-User: tempest-ServerRescueNegativeTestJSON-260324431-project Aug 23 07:17:32.450411 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-User-Domain-Id: default Aug 23 07:17:32.450411 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-User-Domain-Name: Default Aug 23 07:17:32.450411 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-User-Id: 64d54cb95b264c18b45d90822507fae1 Aug 23 07:17:32.450411 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-User-Name: tempest-ServerRescueNegativeTestJSON-260324431-project Aug 23 07:17:32.450411 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: method: > Aug 23 07:17:32.450411 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: exception: Instance b9418fe6-a57e-4a99-becb-19a4d3a52da1 could not be found. Aug 23 07:17:32.450411 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: action_args: {'id': 'b9418fe6-a57e-4a99-becb-19a4d3a52da1'} Aug 23 07:17:32.451629 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 07:17:32.451629 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 07:17:32.451629 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 07:17:32.451629 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 07:17:32.451629 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 07:17:32.451629 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 07:17:32.451629 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 07:17:32.451629 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 07:17:32.451629 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 07:17:32.451629 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 07:17:32.451629 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b9418fe6-a57e-4a99-becb-19a4d3a52da1 could not be found. Aug 23 07:17:32.451629 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi Aug 23 07:17:32.451629 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 07:17:32.451629 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi Aug 23 07:17:32.451629 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 07:17:32.451629 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 07:17:32.451629 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 07:17:32.451629 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 07:17:32.451629 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 07:17:32.451629 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 07:17:32.453039 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 07:17:32.453039 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 07:17:32.453039 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 07:17:32.453039 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 07:17:32.453039 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 07:17:32.453039 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 07:17:32.453039 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 07:17:32.453039 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b9418fe6-a57e-4a99-becb-19a4d3a52da1 could not be found. Aug 23 07:17:32.453039 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi Aug 23 07:17:32.453039 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 07:17:32.453039 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi Aug 23 07:17:32.453039 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 07:17:32.453039 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 07:17:32.453039 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 07:17:32.453039 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 07:17:32.453039 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 07:17:32.453039 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b9418fe6-a57e-4a99-becb-19a4d3a52da1 could not be found. Aug 23 07:17:32.453039 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi Aug 23 07:17:32.454411 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-0101961d-6270-43f8-8a46-92e39de8ffbc tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Returning 404 to user: Instance b9418fe6-a57e-4a99-becb-19a4d3a52da1 could not be found. {{(pid=120798) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 07:17:32.454411 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [None req-0101961d-6270-43f8-8a46-92e39de8ffbc tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] 10.222.0.17 "GET /compute/v2.1/servers/b9418fe6-a57e-4a99-becb-19a4d3a52da1" status: 404 len: 111 microversion: 2.1 time: 0.030952 Aug 23 07:17:32.454411 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 282/586] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:17:32 2022] GET /compute/v2.1/servers/b9418fe6-a57e-4a99-becb-19a4d3a52da1 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 07:17:32.459200 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-77085150-a956-496b-bb2c-03a02b8b1d10 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Calling method '.version_select at 0x7fe3c57b59d0>' {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:17:32.480752 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-77085150-a956-496b-bb2c-03a02b8b1d10 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-735719574" status: 202 len: 0 microversion: 2.1 time: 0.025443 Aug 23 07:17:32.481298 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 305/587] 10.222.0.17 () {58 vars in 1218 bytes} [Tue Aug 23 07:17:32 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-735719574 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 07:17:33.241178 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-ee517d3f-3198-4413-ac94-47b05b1b0f4f tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Calling method '>' {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:17:33.241812 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.compute.api [None req-ee517d3f-3198-4413-ac94-47b05b1b0f4f tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] [instance: 18882ea3-d64e-4894-b42d-9769383c4668] Fetching instance by UUID {{(pid=120798) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:17:33.248154 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-ee517d3f-3198-4413-ac94-47b05b1b0f4f tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:17:33.248626 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-ee517d3f-3198-4413-ac94-47b05b1b0f4f tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:17:33.249045 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-ee517d3f-3198-4413-ac94-47b05b1b0f4f tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:17:33.249718 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-ee517d3f-3198-4413-ac94-47b05b1b0f4f tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:17:33.250157 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-ee517d3f-3198-4413-ac94-47b05b1b0f4f tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:17:33.250570 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-ee517d3f-3198-4413-ac94-47b05b1b0f4f tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:17:33.403107 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.policy [None req-ee517d3f-3198-4413-ac94-47b05b1b0f4f tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '471dc5c1db64411ab1d80ad6c038e519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb44f62fa62e46528712f24479cbb19f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120798) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:17:33.411861 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [None req-ee517d3f-3198-4413-ac94-47b05b1b0f4f tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] 10.222.0.17 "GET /compute/v2.1/servers/18882ea3-d64e-4894-b42d-9769383c4668" status: 200 len: 1559 microversion: 2.1 time: 0.174930 Aug 23 07:17:33.412447 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 283/588] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:17:33 2022] GET /compute/v2.1/servers/18882ea3-d64e-4894-b42d-9769383c4668 => generated 1559 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:17:33.433647 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-0704d385-1a6d-42c5-a6a8-4228fde2c254 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Calling method '>' {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:17:33.434144 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.compute.api [None req-0704d385-1a6d-42c5-a6a8-4228fde2c254 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] [instance: 18882ea3-d64e-4894-b42d-9769383c4668] Fetching instance by UUID {{(pid=120799) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:17:33.442896 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-0704d385-1a6d-42c5-a6a8-4228fde2c254 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:17:33.443554 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-0704d385-1a6d-42c5-a6a8-4228fde2c254 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:17:33.443986 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-0704d385-1a6d-42c5-a6a8-4228fde2c254 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:17:33.444672 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-0704d385-1a6d-42c5-a6a8-4228fde2c254 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:17:33.445116 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-0704d385-1a6d-42c5-a6a8-4228fde2c254 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:17:33.445527 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-0704d385-1a6d-42c5-a6a8-4228fde2c254 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:17:33.530020 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-0704d385-1a6d-42c5-a6a8-4228fde2c254 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] 10.222.0.17 "GET /compute/v2.1/servers/18882ea3-d64e-4894-b42d-9769383c4668/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.100780 Aug 23 07:17:33.530650 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 306/589] 10.222.0.17 () {58 vars in 1275 bytes} [Tue Aug 23 07:17:33 2022] GET /compute/v2.1/servers/18882ea3-d64e-4894-b42d-9769383c4668/os-interface => generated 285 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 07:17:34.724395 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [req-fd385110-2ff6-4891-8f39-5ff47587ab3d req-cf42a0f5-9e8b-46c9-b5ec-a43021e1337d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "18882ea3-d64e-4894-b42d-9769383c4668", "tag": "daf9b2c2-bba6-4920-99e0-34f072476b94"}]} {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 07:17:34.734639 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [req-fd385110-2ff6-4891-8f39-5ff47587ab3d req-cf42a0f5-9e8b-46c9-b5ec-a43021e1337d service nova] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:17:34.735040 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [req-fd385110-2ff6-4891-8f39-5ff47587ab3d req-cf42a0f5-9e8b-46c9-b5ec-a43021e1337d service nova] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:17:34.735487 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [req-fd385110-2ff6-4891-8f39-5ff47587ab3d req-cf42a0f5-9e8b-46c9-b5ec-a43021e1337d service nova] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:17:34.746682 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.compute.server_external_events [req-fd385110-2ff6-4891-8f39-5ff47587ab3d req-cf42a0f5-9e8b-46c9-b5ec-a43021e1337d service nova] Creating event network-changed:daf9b2c2-bba6-4920-99e0-34f072476b94 for instance 18882ea3-d64e-4894-b42d-9769383c4668 on hv-cinder-85409 Aug 23 07:17:34.752192 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [req-fd385110-2ff6-4891-8f39-5ff47587ab3d req-cf42a0f5-9e8b-46c9-b5ec-a43021e1337d service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031489 Aug 23 07:17:34.753099 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 284/590] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Aug 23 07:17:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 07:17:35.393099 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-b1a8ff50-d7bd-4cfb-9a0d-f72cd167b71b tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Calling method '>' {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:17:35.393576 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.compute.api [None req-b1a8ff50-d7bd-4cfb-9a0d-f72cd167b71b tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] [instance: 703acb74-65e6-4a60-9dd0-bf986498889e] Fetching instance by UUID {{(pid=120799) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:17:35.399464 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-b1a8ff50-d7bd-4cfb-9a0d-f72cd167b71b tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:17:35.399953 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-b1a8ff50-d7bd-4cfb-9a0d-f72cd167b71b tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:17:35.400379 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-b1a8ff50-d7bd-4cfb-9a0d-f72cd167b71b tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:17:35.401057 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-b1a8ff50-d7bd-4cfb-9a0d-f72cd167b71b tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:17:35.401500 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-b1a8ff50-d7bd-4cfb-9a0d-f72cd167b71b tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:17:35.401917 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-b1a8ff50-d7bd-4cfb-9a0d-f72cd167b71b tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:17:35.429691 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.compute.api [None req-b1a8ff50-d7bd-4cfb-9a0d-f72cd167b71b tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] [instance: 703acb74-65e6-4a60-9dd0-bf986498889e] Going to try to terminate instance {{(pid=120799) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 07:17:35.520051 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-b1a8ff50-d7bd-4cfb-9a0d-f72cd167b71b tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] 10.222.0.17 "DELETE /compute/v2.1/servers/703acb74-65e6-4a60-9dd0-bf986498889e" status: 204 len: 0 microversion: 2.1 time: 0.131132 Aug 23 07:17:35.521339 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 307/591] 10.222.0.17 () {58 vars in 1239 bytes} [Tue Aug 23 07:17:35 2022] DELETE /compute/v2.1/servers/703acb74-65e6-4a60-9dd0-bf986498889e => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 23 07:17:35.534372 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-0537a539-06db-4fea-a2fd-246b919a56eb tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Calling method '>' {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:17:35.535072 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.compute.api [None req-0537a539-06db-4fea-a2fd-246b919a56eb tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] [instance: 703acb74-65e6-4a60-9dd0-bf986498889e] Fetching instance by UUID {{(pid=120798) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:17:35.541700 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-0537a539-06db-4fea-a2fd-246b919a56eb tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:17:35.542175 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-0537a539-06db-4fea-a2fd-246b919a56eb tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:17:35.542599 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-0537a539-06db-4fea-a2fd-246b919a56eb tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:17:35.543287 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-0537a539-06db-4fea-a2fd-246b919a56eb tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:17:35.543775 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-0537a539-06db-4fea-a2fd-246b919a56eb tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:17:35.544429 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-0537a539-06db-4fea-a2fd-246b919a56eb tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:17:35.692818 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.policy [None req-0537a539-06db-4fea-a2fd-246b919a56eb tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64d54cb95b264c18b45d90822507fae1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135367be6e3f4b3d965ee0d99fdca524', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120798) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:17:35.701793 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [None req-0537a539-06db-4fea-a2fd-246b919a56eb tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] 10.222.0.17 "GET /compute/v2.1/servers/703acb74-65e6-4a60-9dd0-bf986498889e" status: 200 len: 1508 microversion: 2.1 time: 0.175241 Aug 23 07:17:35.702372 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 285/592] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:17:35 2022] GET /compute/v2.1/servers/703acb74-65e6-4a60-9dd0-bf986498889e => generated 1508 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:17:36.724598 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-4361bcac-d259-4d7d-8036-caeb8b7dd63a tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Calling method '>' {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:17:36.725274 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.compute.api [None req-4361bcac-d259-4d7d-8036-caeb8b7dd63a tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] [instance: 703acb74-65e6-4a60-9dd0-bf986498889e] Fetching instance by UUID {{(pid=120799) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:17:36.734820 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-4361bcac-d259-4d7d-8036-caeb8b7dd63a tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:17:36.735679 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-4361bcac-d259-4d7d-8036-caeb8b7dd63a tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:17:36.736337 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-4361bcac-d259-4d7d-8036-caeb8b7dd63a tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:17:36.737442 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-4361bcac-d259-4d7d-8036-caeb8b7dd63a tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:17:36.738228 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-4361bcac-d259-4d7d-8036-caeb8b7dd63a tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:17:36.738910 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-4361bcac-d259-4d7d-8036-caeb8b7dd63a tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:17:36.757742 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG dbcounter [-] [120799] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=120799) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:17:36.882321 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.policy [None req-4361bcac-d259-4d7d-8036-caeb8b7dd63a tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64d54cb95b264c18b45d90822507fae1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135367be6e3f4b3d965ee0d99fdca524', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120799) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:17:36.890396 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-4361bcac-d259-4d7d-8036-caeb8b7dd63a tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] 10.222.0.17 "GET /compute/v2.1/servers/703acb74-65e6-4a60-9dd0-bf986498889e" status: 200 len: 1508 microversion: 2.1 time: 0.170770 Aug 23 07:17:36.890963 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 308/593] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:17:36 2022] GET /compute/v2.1/servers/703acb74-65e6-4a60-9dd0-bf986498889e => generated 1508 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:17:37.911445 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-a4fa98cc-c67d-46e3-a927-b95b68df604c tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Calling method '>' {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:17:37.912093 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.compute.api [None req-a4fa98cc-c67d-46e3-a927-b95b68df604c tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] [instance: 703acb74-65e6-4a60-9dd0-bf986498889e] Fetching instance by UUID {{(pid=120798) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:17:37.918891 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-a4fa98cc-c67d-46e3-a927-b95b68df604c tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:17:37.919370 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-a4fa98cc-c67d-46e3-a927-b95b68df604c tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:17:37.919885 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-a4fa98cc-c67d-46e3-a927-b95b68df604c tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:17:37.920710 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-a4fa98cc-c67d-46e3-a927-b95b68df604c tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:17:37.921158 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-a4fa98cc-c67d-46e3-a927-b95b68df604c tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:17:37.921571 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-a4fa98cc-c67d-46e3-a927-b95b68df604c tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:17:38.058257 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.policy [None req-a4fa98cc-c67d-46e3-a927-b95b68df604c tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64d54cb95b264c18b45d90822507fae1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135367be6e3f4b3d965ee0d99fdca524', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120798) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:17:38.066351 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [None req-a4fa98cc-c67d-46e3-a927-b95b68df604c tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] 10.222.0.17 "GET /compute/v2.1/servers/703acb74-65e6-4a60-9dd0-bf986498889e" status: 200 len: 1508 microversion: 2.1 time: 0.158817 Aug 23 07:17:38.066910 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 286/594] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:17:37 2022] GET /compute/v2.1/servers/703acb74-65e6-4a60-9dd0-bf986498889e => generated 1508 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:17:38.200103 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [req-e77045d1-5703-42ef-b8bb-6a044e89abae req-49f07dde-1c8d-4228-a841-0143747b0869 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "703acb74-65e6-4a60-9dd0-bf986498889e", "name": "network-vif-deleted", "tag": "713d5b4f-c65f-4843-862f-a75e5cbe6db4"}]} {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 07:17:38.212664 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [req-e77045d1-5703-42ef-b8bb-6a044e89abae req-49f07dde-1c8d-4228-a841-0143747b0869 service nova] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:17:38.213113 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [req-e77045d1-5703-42ef-b8bb-6a044e89abae req-49f07dde-1c8d-4228-a841-0143747b0869 service nova] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:17:38.213525 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [req-e77045d1-5703-42ef-b8bb-6a044e89abae req-49f07dde-1c8d-4228-a841-0143747b0869 service nova] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:17:38.226574 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.compute.server_external_events [req-e77045d1-5703-42ef-b8bb-6a044e89abae req-49f07dde-1c8d-4228-a841-0143747b0869 service nova] Creating event network-vif-deleted:713d5b4f-c65f-4843-862f-a75e5cbe6db4 for instance 703acb74-65e6-4a60-9dd0-bf986498889e on hv-cinder-85409 Aug 23 07:17:38.233878 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [req-e77045d1-5703-42ef-b8bb-6a044e89abae req-49f07dde-1c8d-4228-a841-0143747b0869 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037188 Aug 23 07:17:38.234475 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 309/595] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Aug 23 07:17:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 07:17:39.091474 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-8a549ae0-bf15-421c-9b27-d748682223b7 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Calling method '>' {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:17:39.092461 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.compute.api [None req-8a549ae0-bf15-421c-9b27-d748682223b7 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] [instance: 703acb74-65e6-4a60-9dd0-bf986498889e] Fetching instance by UUID {{(pid=120798) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:17:39.103243 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-8a549ae0-bf15-421c-9b27-d748682223b7 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:17:39.104096 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-8a549ae0-bf15-421c-9b27-d748682223b7 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:17:39.104806 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-8a549ae0-bf15-421c-9b27-d748682223b7 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:17:39.105985 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-8a549ae0-bf15-421c-9b27-d748682223b7 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:17:39.106725 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-8a549ae0-bf15-421c-9b27-d748682223b7 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:17:39.107507 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-8a549ae0-bf15-421c-9b27-d748682223b7 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:17:39.121366 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.wsgi [None req-8a549ae0-bf15-421c-9b27-d748682223b7 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] HTTP exception thrown: Instance 703acb74-65e6-4a60-9dd0-bf986498889e could not be found. Aug 23 07:17:39.122993 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-8a549ae0-bf15-421c-9b27-d748682223b7 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Request method failure captured: Aug 23 07:17:39.122993 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: request: GET /compute/v2.1/servers/703acb74-65e6-4a60-9dd0-bf986498889e HTTP/1.1 Aug 23 07:17:39.122993 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: Accept: application/json Aug 23 07:17:39.122993 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: Accept-Encoding: identity Aug 23 07:17:39.122993 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: Connection: close Aug 23 07:17:39.122993 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: Content-Length: 0 Aug 23 07:17:39.122993 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: Content-Type: application/json Aug 23 07:17:39.122993 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: Host: 10.222.0.17 Aug 23 07:17:39.122993 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: Openstack-System-Scope: None Aug 23 07:17:39.122993 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: User-Agent: python-urllib3/1.26.11 Aug 23 07:17:39.122993 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-Auth-Token: gAAAAABjBH3RTnj580A9ihENlvyGo9Owk2endPDkKW0IbgiaI59nvL65tV9bcHDATbv_TF-j5yNJo86nqcfzcR4EFG9DSwxV6zk_8rKGHN_TbC5GCjcEeyjsLvDIF_O9EwwjUk3-u0A9pdTbyVuUJI9H9X2YTFvkkjoRacmsfuB_sypDT5kcQO8 Aug 23 07:17:39.122993 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-Domain-Id: None Aug 23 07:17:39.122993 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-Domain-Name: None Aug 23 07:17:39.122993 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-Identity-Status: Confirmed Aug 23 07:17:39.122993 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-Is-Admin-Project: True Aug 23 07:17:39.122993 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-Project-Domain-Id: default Aug 23 07:17:39.122993 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-Project-Domain-Name: Default Aug 23 07:17:39.122993 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-Project-Id: 135367be6e3f4b3d965ee0d99fdca524 Aug 23 07:17:39.122993 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-260324431 Aug 23 07:17:39.122993 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-Role: reader,member Aug 23 07:17:39.122993 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-Roles: reader,member Aug 23 07:17:39.124455 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/135367be6e3f4b3d965ee0d99fdca524"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/135367be6e3f4b3d965ee0d99fdca524"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_135367be6e3f4b3d965ee0d99fdca524"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/135367be6e3f4b3d965ee0d99fdca524"}]}] Aug 23 07:17:39.124455 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-Tenant: tempest-ServerRescueNegativeTestJSON-260324431 Aug 23 07:17:39.124455 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-Tenant-Id: 135367be6e3f4b3d965ee0d99fdca524 Aug 23 07:17:39.124455 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-260324431 Aug 23 07:17:39.124455 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-User: tempest-ServerRescueNegativeTestJSON-260324431-project Aug 23 07:17:39.124455 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-User-Domain-Id: default Aug 23 07:17:39.124455 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-User-Domain-Name: Default Aug 23 07:17:39.124455 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-User-Id: 64d54cb95b264c18b45d90822507fae1 Aug 23 07:17:39.124455 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-User-Name: tempest-ServerRescueNegativeTestJSON-260324431-project Aug 23 07:17:39.124455 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: method: > Aug 23 07:17:39.124455 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: exception: Instance 703acb74-65e6-4a60-9dd0-bf986498889e could not be found. Aug 23 07:17:39.124455 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: action_args: {'id': '703acb74-65e6-4a60-9dd0-bf986498889e'} Aug 23 07:17:39.125318 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 07:17:39.125318 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 07:17:39.125318 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 07:17:39.125318 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 07:17:39.125318 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 07:17:39.125318 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 07:17:39.125318 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 07:17:39.125318 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 07:17:39.125318 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 07:17:39.125318 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 07:17:39.125318 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 703acb74-65e6-4a60-9dd0-bf986498889e could not be found. Aug 23 07:17:39.125318 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi Aug 23 07:17:39.125318 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 07:17:39.125318 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi Aug 23 07:17:39.125318 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 07:17:39.125318 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 07:17:39.125318 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 07:17:39.125318 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 07:17:39.125318 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 07:17:39.125318 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 07:17:39.126726 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 07:17:39.126726 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 07:17:39.126726 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 07:17:39.126726 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 07:17:39.126726 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 07:17:39.126726 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 07:17:39.126726 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 07:17:39.126726 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 703acb74-65e6-4a60-9dd0-bf986498889e could not be found. Aug 23 07:17:39.126726 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi Aug 23 07:17:39.126726 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 07:17:39.126726 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi Aug 23 07:17:39.126726 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 07:17:39.126726 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 07:17:39.126726 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 07:17:39.126726 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 07:17:39.126726 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 07:17:39.126726 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 703acb74-65e6-4a60-9dd0-bf986498889e could not be found. Aug 23 07:17:39.126726 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi Aug 23 07:17:39.128104 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-8a549ae0-bf15-421c-9b27-d748682223b7 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Returning 404 to user: Instance 703acb74-65e6-4a60-9dd0-bf986498889e could not be found. {{(pid=120798) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 07:17:39.128104 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [None req-8a549ae0-bf15-421c-9b27-d748682223b7 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] 10.222.0.17 "GET /compute/v2.1/servers/703acb74-65e6-4a60-9dd0-bf986498889e" status: 404 len: 111 microversion: 2.1 time: 0.039739 Aug 23 07:17:39.128104 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 287/596] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:17:39 2022] GET /compute/v2.1/servers/703acb74-65e6-4a60-9dd0-bf986498889e => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 07:17:39.133788 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-893da0c4-bf88-47f7-89af-b90e9ec04063 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Calling method '>' {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:17:39.134359 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.compute.api [None req-893da0c4-bf88-47f7-89af-b90e9ec04063 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] [instance: 6915ed26-7e2f-41b9-aada-adcb2c2015d3] Fetching instance by UUID {{(pid=120799) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:17:39.141444 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-893da0c4-bf88-47f7-89af-b90e9ec04063 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:17:39.141913 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-893da0c4-bf88-47f7-89af-b90e9ec04063 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:17:39.142495 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-893da0c4-bf88-47f7-89af-b90e9ec04063 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:17:39.143019 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-893da0c4-bf88-47f7-89af-b90e9ec04063 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:17:39.143560 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-893da0c4-bf88-47f7-89af-b90e9ec04063 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:17:39.144295 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-893da0c4-bf88-47f7-89af-b90e9ec04063 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:17:39.177754 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.compute.api [None req-893da0c4-bf88-47f7-89af-b90e9ec04063 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] [instance: 6915ed26-7e2f-41b9-aada-adcb2c2015d3] Going to try to terminate instance {{(pid=120799) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 07:17:39.267428 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-893da0c4-bf88-47f7-89af-b90e9ec04063 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] 10.222.0.17 "DELETE /compute/v2.1/servers/6915ed26-7e2f-41b9-aada-adcb2c2015d3" status: 204 len: 0 microversion: 2.1 time: 0.137805 Aug 23 07:17:39.268396 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 310/597] 10.222.0.17 () {58 vars in 1239 bytes} [Tue Aug 23 07:17:39 2022] DELETE /compute/v2.1/servers/6915ed26-7e2f-41b9-aada-adcb2c2015d3 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 23 07:17:39.276299 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-3d0a15a9-90cb-4cb6-96de-c3ceaf7029b1 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Calling method '>' {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:17:39.276959 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.compute.api [None req-3d0a15a9-90cb-4cb6-96de-c3ceaf7029b1 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] [instance: 6915ed26-7e2f-41b9-aada-adcb2c2015d3] Fetching instance by UUID {{(pid=120798) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:17:39.283404 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-3d0a15a9-90cb-4cb6-96de-c3ceaf7029b1 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:17:39.283929 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-3d0a15a9-90cb-4cb6-96de-c3ceaf7029b1 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:17:39.284361 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-3d0a15a9-90cb-4cb6-96de-c3ceaf7029b1 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:17:39.285053 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-3d0a15a9-90cb-4cb6-96de-c3ceaf7029b1 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:17:39.285505 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-3d0a15a9-90cb-4cb6-96de-c3ceaf7029b1 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:17:39.285927 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-3d0a15a9-90cb-4cb6-96de-c3ceaf7029b1 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:17:39.440510 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.policy [None req-3d0a15a9-90cb-4cb6-96de-c3ceaf7029b1 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64d54cb95b264c18b45d90822507fae1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135367be6e3f4b3d965ee0d99fdca524', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120798) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:17:39.448564 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [None req-3d0a15a9-90cb-4cb6-96de-c3ceaf7029b1 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] 10.222.0.17 "GET /compute/v2.1/servers/6915ed26-7e2f-41b9-aada-adcb2c2015d3" status: 200 len: 1522 microversion: 2.1 time: 0.176175 Aug 23 07:17:39.449460 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 288/598] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:17:39 2022] GET /compute/v2.1/servers/6915ed26-7e2f-41b9-aada-adcb2c2015d3 => generated 1522 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:17:40.474523 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-af13e2d0-6264-4758-8371-fb8085f5cef6 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Calling method '>' {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:17:40.475633 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.compute.api [None req-af13e2d0-6264-4758-8371-fb8085f5cef6 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] [instance: 6915ed26-7e2f-41b9-aada-adcb2c2015d3] Fetching instance by UUID {{(pid=120799) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:17:40.484689 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-af13e2d0-6264-4758-8371-fb8085f5cef6 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:17:40.485173 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-af13e2d0-6264-4758-8371-fb8085f5cef6 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:17:40.485609 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-af13e2d0-6264-4758-8371-fb8085f5cef6 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:17:40.486293 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-af13e2d0-6264-4758-8371-fb8085f5cef6 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:17:40.486745 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-af13e2d0-6264-4758-8371-fb8085f5cef6 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:17:40.487167 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-af13e2d0-6264-4758-8371-fb8085f5cef6 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:17:40.636510 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.policy [None req-af13e2d0-6264-4758-8371-fb8085f5cef6 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64d54cb95b264c18b45d90822507fae1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135367be6e3f4b3d965ee0d99fdca524', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120799) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:17:40.650500 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-af13e2d0-6264-4758-8371-fb8085f5cef6 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] 10.222.0.17 "GET /compute/v2.1/servers/6915ed26-7e2f-41b9-aada-adcb2c2015d3" status: 200 len: 1522 microversion: 2.1 time: 0.182489 Aug 23 07:17:40.651458 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 311/599] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:17:40 2022] GET /compute/v2.1/servers/6915ed26-7e2f-41b9-aada-adcb2c2015d3 => generated 1522 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:17:41.679606 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-d87f730d-4188-4027-925e-9f0e72d86802 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Calling method '>' {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:17:41.680671 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.compute.api [None req-d87f730d-4188-4027-925e-9f0e72d86802 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] [instance: 6915ed26-7e2f-41b9-aada-adcb2c2015d3] Fetching instance by UUID {{(pid=120798) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:17:41.688712 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-d87f730d-4188-4027-925e-9f0e72d86802 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:17:41.689158 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-d87f730d-4188-4027-925e-9f0e72d86802 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:17:41.689613 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-d87f730d-4188-4027-925e-9f0e72d86802 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:17:41.690297 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-d87f730d-4188-4027-925e-9f0e72d86802 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:17:41.690742 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-d87f730d-4188-4027-925e-9f0e72d86802 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:17:41.691158 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-d87f730d-4188-4027-925e-9f0e72d86802 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:17:41.837743 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.policy [None req-d87f730d-4188-4027-925e-9f0e72d86802 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64d54cb95b264c18b45d90822507fae1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135367be6e3f4b3d965ee0d99fdca524', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120798) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:17:41.845788 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [None req-d87f730d-4188-4027-925e-9f0e72d86802 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] 10.222.0.17 "GET /compute/v2.1/servers/6915ed26-7e2f-41b9-aada-adcb2c2015d3" status: 200 len: 1522 microversion: 2.1 time: 0.170804 Aug 23 07:17:41.846361 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 289/600] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:17:41 2022] GET /compute/v2.1/servers/6915ed26-7e2f-41b9-aada-adcb2c2015d3 => generated 1522 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:17:42.867961 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-c1424848-2643-41a6-b28e-ab9ffc33e845 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Calling method '>' {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:17:42.868440 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.compute.api [None req-c1424848-2643-41a6-b28e-ab9ffc33e845 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] [instance: 6915ed26-7e2f-41b9-aada-adcb2c2015d3] Fetching instance by UUID {{(pid=120799) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:17:42.875679 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-c1424848-2643-41a6-b28e-ab9ffc33e845 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:17:42.876156 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-c1424848-2643-41a6-b28e-ab9ffc33e845 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:17:42.876595 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-c1424848-2643-41a6-b28e-ab9ffc33e845 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:17:42.877287 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-c1424848-2643-41a6-b28e-ab9ffc33e845 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:17:42.877730 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-c1424848-2643-41a6-b28e-ab9ffc33e845 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:17:42.878142 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-c1424848-2643-41a6-b28e-ab9ffc33e845 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:17:42.953204 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.policy [None req-c1424848-2643-41a6-b28e-ab9ffc33e845 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64d54cb95b264c18b45d90822507fae1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135367be6e3f4b3d965ee0d99fdca524', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120799) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:17:42.963693 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-c1424848-2643-41a6-b28e-ab9ffc33e845 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] 10.222.0.17 "GET /compute/v2.1/servers/6915ed26-7e2f-41b9-aada-adcb2c2015d3" status: 200 len: 1480 microversion: 2.1 time: 0.100291 Aug 23 07:17:42.964060 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 312/601] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:17:42 2022] GET /compute/v2.1/servers/6915ed26-7e2f-41b9-aada-adcb2c2015d3 => generated 1480 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:17:42.993227 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [req-aa7375fc-f42e-40e7-9c4c-e48f032727a3 req-bd8c7838-85cc-4102-b6b7-bdf7c14318fd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6915ed26-7e2f-41b9-aada-adcb2c2015d3", "name": "network-vif-deleted", "tag": "b8077cfc-5527-4264-938d-c6318acc4e35"}]} {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 07:17:43.003800 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [req-aa7375fc-f42e-40e7-9c4c-e48f032727a3 req-bd8c7838-85cc-4102-b6b7-bdf7c14318fd service nova] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:17:43.004285 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [req-aa7375fc-f42e-40e7-9c4c-e48f032727a3 req-bd8c7838-85cc-4102-b6b7-bdf7c14318fd service nova] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:17:43.004683 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [req-aa7375fc-f42e-40e7-9c4c-e48f032727a3 req-bd8c7838-85cc-4102-b6b7-bdf7c14318fd service nova] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:17:43.015814 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.compute.server_external_events [req-aa7375fc-f42e-40e7-9c4c-e48f032727a3 req-bd8c7838-85cc-4102-b6b7-bdf7c14318fd service nova] Creating event network-vif-deleted:b8077cfc-5527-4264-938d-c6318acc4e35 for instance 6915ed26-7e2f-41b9-aada-adcb2c2015d3 on hv-cinder-85409 Aug 23 07:17:43.021158 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [req-aa7375fc-f42e-40e7-9c4c-e48f032727a3 req-bd8c7838-85cc-4102-b6b7-bdf7c14318fd service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.116667 Aug 23 07:17:43.021780 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 290/602] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Aug 23 07:17:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 07:17:43.985298 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-2b0c6157-86e2-4254-ae0a-fb311541b431 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Calling method '>' {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:17:43.985955 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.compute.api [None req-2b0c6157-86e2-4254-ae0a-fb311541b431 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] [instance: 6915ed26-7e2f-41b9-aada-adcb2c2015d3] Fetching instance by UUID {{(pid=120799) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:17:43.997271 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-2b0c6157-86e2-4254-ae0a-fb311541b431 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:17:43.998103 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-2b0c6157-86e2-4254-ae0a-fb311541b431 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:17:43.998534 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-2b0c6157-86e2-4254-ae0a-fb311541b431 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:17:43.999374 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-2b0c6157-86e2-4254-ae0a-fb311541b431 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:17:43.999844 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-2b0c6157-86e2-4254-ae0a-fb311541b431 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:17:44.000265 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-2b0c6157-86e2-4254-ae0a-fb311541b431 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:17:44.016158 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.wsgi [None req-2b0c6157-86e2-4254-ae0a-fb311541b431 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] HTTP exception thrown: Instance 6915ed26-7e2f-41b9-aada-adcb2c2015d3 could not be found. Aug 23 07:17:44.017791 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-2b0c6157-86e2-4254-ae0a-fb311541b431 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Request method failure captured: Aug 23 07:17:44.017791 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: request: GET /compute/v2.1/servers/6915ed26-7e2f-41b9-aada-adcb2c2015d3 HTTP/1.1 Aug 23 07:17:44.017791 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: Accept: application/json Aug 23 07:17:44.017791 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: Accept-Encoding: identity Aug 23 07:17:44.017791 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: Connection: close Aug 23 07:17:44.017791 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: Content-Length: 0 Aug 23 07:17:44.017791 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: Content-Type: application/json Aug 23 07:17:44.017791 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: Host: 10.222.0.17 Aug 23 07:17:44.017791 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: Openstack-System-Scope: None Aug 23 07:17:44.017791 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: User-Agent: python-urllib3/1.26.11 Aug 23 07:17:44.017791 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-Auth-Token: gAAAAABjBH3RTnj580A9ihENlvyGo9Owk2endPDkKW0IbgiaI59nvL65tV9bcHDATbv_TF-j5yNJo86nqcfzcR4EFG9DSwxV6zk_8rKGHN_TbC5GCjcEeyjsLvDIF_O9EwwjUk3-u0A9pdTbyVuUJI9H9X2YTFvkkjoRacmsfuB_sypDT5kcQO8 Aug 23 07:17:44.017791 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-Domain-Id: None Aug 23 07:17:44.017791 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-Domain-Name: None Aug 23 07:17:44.017791 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-Identity-Status: Confirmed Aug 23 07:17:44.017791 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-Is-Admin-Project: True Aug 23 07:17:44.017791 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-Project-Domain-Id: default Aug 23 07:17:44.017791 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-Project-Domain-Name: Default Aug 23 07:17:44.017791 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-Project-Id: 135367be6e3f4b3d965ee0d99fdca524 Aug 23 07:17:44.017791 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-260324431 Aug 23 07:17:44.017791 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-Role: reader,member Aug 23 07:17:44.017791 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-Roles: reader,member Aug 23 07:17:44.019302 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/135367be6e3f4b3d965ee0d99fdca524"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/135367be6e3f4b3d965ee0d99fdca524"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_135367be6e3f4b3d965ee0d99fdca524"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/135367be6e3f4b3d965ee0d99fdca524"}]}] Aug 23 07:17:44.019302 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-Tenant: tempest-ServerRescueNegativeTestJSON-260324431 Aug 23 07:17:44.019302 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-Tenant-Id: 135367be6e3f4b3d965ee0d99fdca524 Aug 23 07:17:44.019302 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-260324431 Aug 23 07:17:44.019302 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-User: tempest-ServerRescueNegativeTestJSON-260324431-project Aug 23 07:17:44.019302 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-User-Domain-Id: default Aug 23 07:17:44.019302 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-User-Domain-Name: Default Aug 23 07:17:44.019302 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-User-Id: 64d54cb95b264c18b45d90822507fae1 Aug 23 07:17:44.019302 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-User-Name: tempest-ServerRescueNegativeTestJSON-260324431-project Aug 23 07:17:44.019302 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: method: > Aug 23 07:17:44.019302 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: exception: Instance 6915ed26-7e2f-41b9-aada-adcb2c2015d3 could not be found. Aug 23 07:17:44.019302 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: action_args: {'id': '6915ed26-7e2f-41b9-aada-adcb2c2015d3'} Aug 23 07:17:44.020217 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 07:17:44.020217 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 07:17:44.020217 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 07:17:44.020217 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 07:17:44.020217 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 07:17:44.020217 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 07:17:44.020217 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 07:17:44.020217 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 07:17:44.020217 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 07:17:44.020217 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 07:17:44.020217 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6915ed26-7e2f-41b9-aada-adcb2c2015d3 could not be found. Aug 23 07:17:44.020217 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi Aug 23 07:17:44.020217 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 07:17:44.020217 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi Aug 23 07:17:44.020217 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 07:17:44.020217 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 07:17:44.020217 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 07:17:44.020217 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 07:17:44.020217 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 07:17:44.020217 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 07:17:44.021719 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 07:17:44.021719 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 07:17:44.021719 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 07:17:44.021719 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 07:17:44.021719 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 07:17:44.021719 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 07:17:44.021719 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 07:17:44.021719 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6915ed26-7e2f-41b9-aada-adcb2c2015d3 could not be found. Aug 23 07:17:44.021719 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi Aug 23 07:17:44.021719 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 07:17:44.021719 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi Aug 23 07:17:44.021719 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 07:17:44.021719 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 07:17:44.021719 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 07:17:44.021719 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 07:17:44.021719 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 07:17:44.021719 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6915ed26-7e2f-41b9-aada-adcb2c2015d3 could not be found. Aug 23 07:17:44.021719 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi Aug 23 07:17:44.023019 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-2b0c6157-86e2-4254-ae0a-fb311541b431 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] Returning 404 to user: Instance 6915ed26-7e2f-41b9-aada-adcb2c2015d3 could not be found. {{(pid=120799) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 07:17:44.023019 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-2b0c6157-86e2-4254-ae0a-fb311541b431 tempest-ServerRescueNegativeTestJSON-260324431 tempest-ServerRescueNegativeTestJSON-260324431-project] 10.222.0.17 "GET /compute/v2.1/servers/6915ed26-7e2f-41b9-aada-adcb2c2015d3" status: 404 len: 111 microversion: 2.1 time: 0.037941 Aug 23 07:17:44.023019 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 313/603] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:17:43 2022] GET /compute/v2.1/servers/6915ed26-7e2f-41b9-aada-adcb2c2015d3 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 07:17:52.022766 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-910469dc-06a7-4184-8870-21301ee5ca3e tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-261708711"}} {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 07:17:52.023385 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.compute.api [None req-910469dc-06a7-4184-8870-21301ee5ca3e tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] [instance: f7783f88-5770-4ca3-a5cf-294f044d21a8] Fetching instance by UUID {{(pid=120798) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:17:52.032780 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-910469dc-06a7-4184-8870-21301ee5ca3e tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:17:52.033279 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-910469dc-06a7-4184-8870-21301ee5ca3e tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:17:52.033713 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-910469dc-06a7-4184-8870-21301ee5ca3e tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:17:52.034704 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-910469dc-06a7-4184-8870-21301ee5ca3e tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:17:52.035311 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-910469dc-06a7-4184-8870-21301ee5ca3e tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:17:52.035901 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-910469dc-06a7-4184-8870-21301ee5ca3e tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:17:52.193344 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.network.security_group_api [None req-910469dc-06a7-4184-8870-21301ee5ca3e tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] Removing security group 2ec95c58-7885-48b0-a3a0-0e5de90e9834 from port 7ccdc22f-1e2b-4dd9-8ea3-858bf0e435cf Aug 23 07:17:52.585965 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [None req-910469dc-06a7-4184-8870-21301ee5ca3e tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] 10.222.0.17 "POST /compute/v2.1/servers/f7783f88-5770-4ca3-a5cf-294f044d21a8/action" status: 202 len: 0 microversion: 2.1 time: 0.567160 Aug 23 07:17:52.587919 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 291/604] 10.222.0.17 () {60 vars in 1278 bytes} [Tue Aug 23 07:17:52 2022] POST /compute/v2.1/servers/f7783f88-5770-4ca3-a5cf-294f044d21a8/action => generated 0 bytes in 571 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 07:17:52.809621 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [req-4d283d6c-e0cb-4c6a-a1de-4ccada2a11bd req-30ef2aa4-bc97-486e-a6c9-4028894e65dd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f7783f88-5770-4ca3-a5cf-294f044d21a8", "tag": "7ccdc22f-1e2b-4dd9-8ea3-858bf0e435cf"}]} {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 07:17:52.823753 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [req-4d283d6c-e0cb-4c6a-a1de-4ccada2a11bd req-30ef2aa4-bc97-486e-a6c9-4028894e65dd service nova] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:17:52.824243 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [req-4d283d6c-e0cb-4c6a-a1de-4ccada2a11bd req-30ef2aa4-bc97-486e-a6c9-4028894e65dd service nova] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:17:52.824669 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [req-4d283d6c-e0cb-4c6a-a1de-4ccada2a11bd req-30ef2aa4-bc97-486e-a6c9-4028894e65dd service nova] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:17:52.855064 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.compute.server_external_events [req-4d283d6c-e0cb-4c6a-a1de-4ccada2a11bd req-30ef2aa4-bc97-486e-a6c9-4028894e65dd service nova] Creating event network-changed:7ccdc22f-1e2b-4dd9-8ea3-858bf0e435cf for instance f7783f88-5770-4ca3-a5cf-294f044d21a8 on hv-cinder-85409 Aug 23 07:17:52.865820 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [req-4d283d6c-e0cb-4c6a-a1de-4ccada2a11bd req-30ef2aa4-bc97-486e-a6c9-4028894e65dd service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.273185 Aug 23 07:17:52.867723 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 314/605] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Aug 23 07:17:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 07:17:52.912908 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-0b5ff014-9d73-416a-8d19-dd63063da6ac tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Action: 'create', calling method: .version_select at 0x7fe3c5743310>, body: {"keypair": {"name": "tempest-keypair-172953591", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGcJxhWIIeRtxDDNOUr5EvUN6kGlRk4rxPJ42NEoWt+P8qPcFLWoyI54CrGZHaMWCpwQde8LPhLKVt6Nxj57aaPbaf04JAaXgKcYYNzmOE5ScySXGCiWZow5MXKW/SzNZA=="}} {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 07:17:52.929692 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.quota [None req-0b5ff014-9d73-416a-8d19-dd63063da6ac tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Getting quotas for project 42af08ef367945939b1f59ffa8af351a. Resources: {'key_pairs'} {{(pid=120798) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 07:17:52.933995 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.quota [None req-0b5ff014-9d73-416a-8d19-dd63063da6ac tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Getting quotas for user 4fb28547f4b54c4097d2ffc3c533ca67 and project 42af08ef367945939b1f59ffa8af351a. Resources: {'key_pairs'} {{(pid=120798) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 07:17:52.965728 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [None req-0b5ff014-9d73-416a-8d19-dd63063da6ac tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.268523 Aug 23 07:17:52.967585 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 292/606] 10.222.0.17 () {62 vars in 1200 bytes} [Tue Aug 23 07:17:52 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 271 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 23 07:17:54.303532 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-5beca32f-835c-4fa5-baad-8e2094615c66 tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] Calling method '>' {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:17:54.305023 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.compute.api [None req-5beca32f-835c-4fa5-baad-8e2094615c66 tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] [instance: f7783f88-5770-4ca3-a5cf-294f044d21a8] Fetching instance by UUID {{(pid=120799) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:17:54.315577 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-5beca32f-835c-4fa5-baad-8e2094615c66 tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:17:54.316344 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-5beca32f-835c-4fa5-baad-8e2094615c66 tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:17:54.316986 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-5beca32f-835c-4fa5-baad-8e2094615c66 tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:17:54.317873 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-5beca32f-835c-4fa5-baad-8e2094615c66 tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:17:54.319132 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-5beca32f-835c-4fa5-baad-8e2094615c66 tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:17:54.319721 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-5beca32f-835c-4fa5-baad-8e2094615c66 tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:17:54.422244 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.objects.instance [None req-5beca32f-835c-4fa5-baad-8e2094615c66 tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] Lazy-loading 'services' on Instance uuid f7783f88-5770-4ca3-a5cf-294f044d21a8 {{(pid=120799) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 07:17:54.500051 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-5beca32f-835c-4fa5-baad-8e2094615c66 tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] 10.222.0.17 "DELETE /compute/v2.1/servers/f7783f88-5770-4ca3-a5cf-294f044d21a8/os-volume_attachments/a0f9f5e2-9af5-45c4-b20b-c692a2eb6e2d" status: 202 len: 0 microversion: 2.1 time: 0.202897 Aug 23 07:17:54.500650 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 315/607] 10.222.0.17 () {58 vars in 1416 bytes} [Tue Aug 23 07:17:54 2022] DELETE /compute/v2.1/servers/f7783f88-5770-4ca3-a5cf-294f044d21a8/os-volume_attachments/a0f9f5e2-9af5-45c4-b20b-c692a2eb6e2d => generated 0 bytes in 205 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 07:17:54.509436 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-dc52dda4-09cf-4fd5-92dd-57839504146f tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] Calling method '>' {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:17:54.512200 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.compute.api [None req-dc52dda4-09cf-4fd5-92dd-57839504146f tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] [instance: f7783f88-5770-4ca3-a5cf-294f044d21a8] Fetching instance by UUID {{(pid=120798) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:17:54.521110 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-dc52dda4-09cf-4fd5-92dd-57839504146f tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:17:54.521916 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-dc52dda4-09cf-4fd5-92dd-57839504146f tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:17:54.522584 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-dc52dda4-09cf-4fd5-92dd-57839504146f tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:17:54.523668 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-dc52dda4-09cf-4fd5-92dd-57839504146f tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:17:54.524583 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-dc52dda4-09cf-4fd5-92dd-57839504146f tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:17:54.525169 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-dc52dda4-09cf-4fd5-92dd-57839504146f tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:17:54.529791 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG dbcounter [-] [120798] Writing DB stats nova_cell1:SELECT=95 {{(pid=120798) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:17:54.574434 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [None req-dc52dda4-09cf-4fd5-92dd-57839504146f tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] 10.222.0.17 "GET /compute/v2.1/servers/f7783f88-5770-4ca3-a5cf-294f044d21a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.069008 Aug 23 07:17:54.576221 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 293/608] 10.222.0.17 () {58 vars in 1302 bytes} [Tue Aug 23 07:17:54 2022] GET /compute/v2.1/servers/f7783f88-5770-4ca3-a5cf-294f044d21a8/os-volume_attachments => generated 197 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 07:17:54.736226 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-0ec01714-9fdd-4e81-a0a7-6c319a525fc7 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-741425233", "imageRef": "b899fd65-02ae-4b43-bac7-86f38fc3f224", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "e2ad1a62-8403-4dc6-a38f-0eaf29c3b166"}], "security_groups": [{"name": "tempest-securitygroup--409442535"}], "key_name": "tempest-keypair-172953591", "user_data": "}} {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 07:17:54.851817 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.network.neutron [None req-0ec01714-9fdd-4e81-a0a7-6c319a525fc7 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] validate_networks() for [('e2ad1a62-8403-4dc6-a38f-0eaf29c3b166', None, None, None, None, None)] {{(pid=120799) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 23 07:17:54.889143 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [req-b0f966e4-4d3d-4474-8e1a-beea9f6b9310 req-0c3dfae7-7f31-4def-a8c0-c1f3d11126b6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f7783f88-5770-4ca3-a5cf-294f044d21a8", "tag": "7ccdc22f-1e2b-4dd9-8ea3-858bf0e435cf"}]} {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 07:17:54.899439 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [req-b0f966e4-4d3d-4474-8e1a-beea9f6b9310 req-0c3dfae7-7f31-4def-a8c0-c1f3d11126b6 service nova] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:17:54.899924 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [req-b0f966e4-4d3d-4474-8e1a-beea9f6b9310 req-0c3dfae7-7f31-4def-a8c0-c1f3d11126b6 service nova] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:17:54.900343 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [req-b0f966e4-4d3d-4474-8e1a-beea9f6b9310 req-0c3dfae7-7f31-4def-a8c0-c1f3d11126b6 service nova] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:17:54.911904 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.compute.server_external_events [req-b0f966e4-4d3d-4474-8e1a-beea9f6b9310 req-0c3dfae7-7f31-4def-a8c0-c1f3d11126b6 service nova] Creating event network-changed:7ccdc22f-1e2b-4dd9-8ea3-858bf0e435cf for instance f7783f88-5770-4ca3-a5cf-294f044d21a8 on hv-cinder-85409 Aug 23 07:17:54.917019 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [req-b0f966e4-4d3d-4474-8e1a-beea9f6b9310 req-0c3dfae7-7f31-4def-a8c0-c1f3d11126b6 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031671 Aug 23 07:17:54.917959 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 294/609] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Aug 23 07:17:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 07:17:55.386088 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.virt.hardware [None req-0ec01714-9fdd-4e81-a0a7-6c319a525fc7 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Flavor limits 0:0:0 {{(pid=120799) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 07:17:55.387131 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.virt.hardware [None req-0ec01714-9fdd-4e81-a0a7-6c319a525fc7 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Image limits 0:0:0 {{(pid=120799) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 07:17:55.387641 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.virt.hardware [None req-0ec01714-9fdd-4e81-a0a7-6c319a525fc7 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Flavor pref 0:0:0 {{(pid=120799) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 07:17:55.388442 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.virt.hardware [None req-0ec01714-9fdd-4e81-a0a7-6c319a525fc7 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Image pref 0:0:0 {{(pid=120799) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 07:17:55.388999 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.virt.hardware [None req-0ec01714-9fdd-4e81-a0a7-6c319a525fc7 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120799) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 07:17:55.402869 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-0ec01714-9fdd-4e81-a0a7-6c319a525fc7 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:17:55.403404 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-0ec01714-9fdd-4e81-a0a7-6c319a525fc7 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:17:55.405853 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-0ec01714-9fdd-4e81-a0a7-6c319a525fc7 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:17:55.406678 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-0ec01714-9fdd-4e81-a0a7-6c319a525fc7 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:17:55.408087 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-0ec01714-9fdd-4e81-a0a7-6c319a525fc7 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:17:55.408687 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-0ec01714-9fdd-4e81-a0a7-6c319a525fc7 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:17:55.429229 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.quota [None req-0ec01714-9fdd-4e81-a0a7-6c319a525fc7 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Getting quotas for project 42af08ef367945939b1f59ffa8af351a. Resources: {'ram', 'instances', 'cores'} {{(pid=120799) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 07:17:55.434002 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.quota [None req-0ec01714-9fdd-4e81-a0a7-6c319a525fc7 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Getting quotas for user 4fb28547f4b54c4097d2ffc3c533ca67 and project 42af08ef367945939b1f59ffa8af351a. Resources: {'ram', 'instances', 'cores'} {{(pid=120799) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 07:17:55.446740 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.compute.api [None req-0ec01714-9fdd-4e81-a0a7-6c319a525fc7 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Going to run 1 instances... {{(pid=120799) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 23 07:17:55.449646 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.compute.api [None req-0ec01714-9fdd-4e81-a0a7-6c319a525fc7 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] [instance: d1a4fd6e-9323-416e-b844-5e526565774e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b899fd65-02ae-4b43-bac7-86f38fc3f224',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120799) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 07:17:55.526114 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-0ec01714-9fdd-4e81-a0a7-6c319a525fc7 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.795002 Aug 23 07:17:55.527120 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 316/610] 10.222.0.17 () {62 vars in 1188 bytes} [Tue Aug 23 07:17:54 2022] POST /compute/v2.1/servers => generated 401 bytes in 797 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 23 07:17:55.538452 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-1125fd69-d6c5-4f6c-b6d1-7a82582e9710 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Calling method '>' {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:17:55.539801 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.compute.api [None req-1125fd69-d6c5-4f6c-b6d1-7a82582e9710 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] [instance: d1a4fd6e-9323-416e-b844-5e526565774e] Fetching instance by UUID {{(pid=120798) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:17:55.588578 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-315360cd-f096-4a88-bc39-6de020d79eea tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] Calling method '>' {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:17:55.598683 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.compute.api [None req-315360cd-f096-4a88-bc39-6de020d79eea tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] [instance: f7783f88-5770-4ca3-a5cf-294f044d21a8] Fetching instance by UUID {{(pid=120799) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:17:55.614118 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-315360cd-f096-4a88-bc39-6de020d79eea tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:17:55.614613 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-315360cd-f096-4a88-bc39-6de020d79eea tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:17:55.615053 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-315360cd-f096-4a88-bc39-6de020d79eea tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:17:55.615793 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-315360cd-f096-4a88-bc39-6de020d79eea tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:17:55.616245 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-315360cd-f096-4a88-bc39-6de020d79eea tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:17:55.616668 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-315360cd-f096-4a88-bc39-6de020d79eea tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:17:55.650916 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-315360cd-f096-4a88-bc39-6de020d79eea tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] 10.222.0.17 "GET /compute/v2.1/servers/f7783f88-5770-4ca3-a5cf-294f044d21a8/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.066636 Aug 23 07:17:55.652771 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 317/611] 10.222.0.17 () {58 vars in 1302 bytes} [Tue Aug 23 07:17:55 2022] GET /compute/v2.1/servers/f7783f88-5770-4ca3-a5cf-294f044d21a8/os-volume_attachments => generated 25 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 23 07:17:55.664965 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-0e43e160-32bd-4ddc-9b86-a7bf3dc5ec2b tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] Calling method '>' {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:17:55.665472 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.compute.api [None req-0e43e160-32bd-4ddc-9b86-a7bf3dc5ec2b tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] [instance: f7783f88-5770-4ca3-a5cf-294f044d21a8] Fetching instance by UUID {{(pid=120799) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:17:55.671362 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.policy [None req-1125fd69-d6c5-4f6c-b6d1-7a82582e9710 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb28547f4b54c4097d2ffc3c533ca67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42af08ef367945939b1f59ffa8af351a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120798) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:17:55.680544 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.policy [None req-1125fd69-d6c5-4f6c-b6d1-7a82582e9710 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4fb28547f4b54c4097d2ffc3c533ca67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42af08ef367945939b1f59ffa8af351a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120798) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:17:55.682374 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.policy [None req-1125fd69-d6c5-4f6c-b6d1-7a82582e9710 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4fb28547f4b54c4097d2ffc3c533ca67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42af08ef367945939b1f59ffa8af351a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120798) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:17:55.684386 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [None req-1125fd69-d6c5-4f6c-b6d1-7a82582e9710 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] 10.222.0.17 "GET /compute/v2.1/servers/d1a4fd6e-9323-416e-b844-5e526565774e" status: 200 len: 1280 microversion: 2.20 time: 0.150029 Aug 23 07:17:55.687469 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 295/612] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Aug 23 07:17:55 2022] GET /compute/v2.1/servers/d1a4fd6e-9323-416e-b844-5e526565774e => generated 1280 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 07:17:55.691070 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-0e43e160-32bd-4ddc-9b86-a7bf3dc5ec2b tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:17:55.691861 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-0e43e160-32bd-4ddc-9b86-a7bf3dc5ec2b tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:17:55.692605 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-0e43e160-32bd-4ddc-9b86-a7bf3dc5ec2b tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:17:55.693846 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-0e43e160-32bd-4ddc-9b86-a7bf3dc5ec2b tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:17:55.694684 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-0e43e160-32bd-4ddc-9b86-a7bf3dc5ec2b tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:17:55.695961 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-0e43e160-32bd-4ddc-9b86-a7bf3dc5ec2b tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:17:55.817032 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.wsgi [None req-0e43e160-32bd-4ddc-9b86-a7bf3dc5ec2b tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] HTTP exception thrown: Instance f7783f88-5770-4ca3-a5cf-294f044d21a8 is not attached to volume a0f9f5e2-9af5-45c4-b20b-c692a2eb6e2d Aug 23 07:17:55.824456 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-0e43e160-32bd-4ddc-9b86-a7bf3dc5ec2b tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] Request method failure captured: Aug 23 07:17:55.824456 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: request: DELETE /compute/v2.1/servers/f7783f88-5770-4ca3-a5cf-294f044d21a8/os-volume_attachments/a0f9f5e2-9af5-45c4-b20b-c692a2eb6e2d HTTP/1.1 Aug 23 07:17:55.824456 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: Accept: application/json Aug 23 07:17:55.824456 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: Accept-Encoding: identity Aug 23 07:17:55.824456 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: Connection: close Aug 23 07:17:55.824456 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: Content-Length: 0 Aug 23 07:17:55.824456 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: Content-Type: application/json Aug 23 07:17:55.824456 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: Host: 10.222.0.17 Aug 23 07:17:55.824456 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: Openstack-System-Scope: None Aug 23 07:17:55.824456 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: User-Agent: python-urllib3/1.26.11 Aug 23 07:17:55.824456 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-Auth-Token: gAAAAABjBH6BD1Ab6JoUxadkzPMoWrxSDq6SaSnNUANqrOrrvV6TtLpdt5wyAWwOT7p8b0fau3qaM8pFqs8prz8kf3i4Ddi7YV5v8Fo6BeNqoaYbQBK0irTEj4ws7VM09kcvYR5aSi-jSP_SAF4GKc3Saatn2Is_itjYe7rPRi8Pc2-CpaHNLio Aug 23 07:17:55.824456 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-Domain-Id: None Aug 23 07:17:55.824456 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-Domain-Name: None Aug 23 07:17:55.824456 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-Identity-Status: Confirmed Aug 23 07:17:55.824456 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-Is-Admin-Project: True Aug 23 07:17:55.824456 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-Project-Domain-Id: default Aug 23 07:17:55.824456 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-Project-Domain-Name: Default Aug 23 07:17:55.824456 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-Project-Id: f9466597900d4a3ca60a2ef8b7678c87 Aug 23 07:17:55.824456 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-Project-Name: tempest-TestMinimumBasicScenario-542220183 Aug 23 07:17:55.824456 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-Role: reader,member Aug 23 07:17:55.824456 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-Roles: reader,member Aug 23 07:17:55.826022 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/f9466597900d4a3ca60a2ef8b7678c87"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/f9466597900d4a3ca60a2ef8b7678c87"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_f9466597900d4a3ca60a2ef8b7678c87"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/f9466597900d4a3ca60a2ef8b7678c87"}]}] Aug 23 07:17:55.826022 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-Tenant: tempest-TestMinimumBasicScenario-542220183 Aug 23 07:17:55.826022 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-Tenant-Id: f9466597900d4a3ca60a2ef8b7678c87 Aug 23 07:17:55.826022 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-Tenant-Name: tempest-TestMinimumBasicScenario-542220183 Aug 23 07:17:55.826022 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-User: tempest-TestMinimumBasicScenario-542220183-project Aug 23 07:17:55.826022 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-User-Domain-Id: default Aug 23 07:17:55.826022 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-User-Domain-Name: Default Aug 23 07:17:55.826022 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-User-Id: a5e8c33634b246319de495d269c05124 Aug 23 07:17:55.826022 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-User-Name: tempest-TestMinimumBasicScenario-542220183-project Aug 23 07:17:55.826022 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: method: > Aug 23 07:17:55.826022 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: exception: Instance f7783f88-5770-4ca3-a5cf-294f044d21a8 is not attached to volume a0f9f5e2-9af5-45c4-b20b-c692a2eb6e2d Aug 23 07:17:55.827111 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: action_args: {'server_id': 'f7783f88-5770-4ca3-a5cf-294f044d21a8', 'id': 'a0f9f5e2-9af5-45c4-b20b-c692a2eb6e2d'} Aug 23 07:17:55.827111 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 07:17:55.827111 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 07:17:55.827111 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Aug 23 07:17:55.827111 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Aug 23 07:17:55.827111 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 23 07:17:55.827111 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 23 07:17:55.827111 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Aug 23 07:17:55.827111 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Aug 23 07:17:55.827111 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id a0f9f5e2-9af5-45c4-b20b-c692a2eb6e2d. Aug 23 07:17:55.827111 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi Aug 23 07:17:55.827111 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 07:17:55.827111 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi Aug 23 07:17:55.827111 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 07:17:55.827111 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 07:17:55.827111 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 07:17:55.827111 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 07:17:55.827111 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 07:17:55.827111 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 07:17:55.828530 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 07:17:55.828530 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Aug 23 07:17:55.828530 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 23 07:17:55.828530 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f7783f88-5770-4ca3-a5cf-294f044d21a8 is not attached to volume a0f9f5e2-9af5-45c4-b20b-c692a2eb6e2d Aug 23 07:17:55.828530 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi Aug 23 07:17:55.828530 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 07:17:55.828530 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi Aug 23 07:17:55.828530 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 07:17:55.828530 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 07:17:55.828530 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 07:17:55.828530 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 07:17:55.828530 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 07:17:55.828530 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f7783f88-5770-4ca3-a5cf-294f044d21a8 is not attached to volume a0f9f5e2-9af5-45c4-b20b-c692a2eb6e2d Aug 23 07:17:55.828530 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi Aug 23 07:17:55.830502 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-0e43e160-32bd-4ddc-9b86-a7bf3dc5ec2b tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] Returning 404 to user: Instance f7783f88-5770-4ca3-a5cf-294f044d21a8 is not attached to volume a0f9f5e2-9af5-45c4-b20b-c692a2eb6e2d {{(pid=120799) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 07:17:55.831572 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-0e43e160-32bd-4ddc-9b86-a7bf3dc5ec2b tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] 10.222.0.17 "DELETE /compute/v2.1/servers/f7783f88-5770-4ca3-a5cf-294f044d21a8/os-volume_attachments/a0f9f5e2-9af5-45c4-b20b-c692a2eb6e2d" status: 404 len: 154 microversion: 2.1 time: 0.172167 Aug 23 07:17:55.832291 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 318/613] 10.222.0.17 () {58 vars in 1416 bytes} [Tue Aug 23 07:17:55 2022] DELETE /compute/v2.1/servers/f7783f88-5770-4ca3-a5cf-294f044d21a8/os-volume_attachments/a0f9f5e2-9af5-45c4-b20b-c692a2eb6e2d => generated 154 bytes in 173 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 23 07:17:56.710554 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-3a59b8db-8a72-451c-b069-0868594b1786 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Calling method '>' {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:17:56.712203 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.compute.api [None req-3a59b8db-8a72-451c-b069-0868594b1786 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] [instance: d1a4fd6e-9323-416e-b844-5e526565774e] Fetching instance by UUID {{(pid=120798) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:17:56.720786 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-3a59b8db-8a72-451c-b069-0868594b1786 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:17:56.721276 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-3a59b8db-8a72-451c-b069-0868594b1786 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:17:56.721896 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-3a59b8db-8a72-451c-b069-0868594b1786 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:17:56.722770 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-3a59b8db-8a72-451c-b069-0868594b1786 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:17:56.723385 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-3a59b8db-8a72-451c-b069-0868594b1786 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:17:56.724035 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-3a59b8db-8a72-451c-b069-0868594b1786 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:17:56.808707 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.policy [None req-3a59b8db-8a72-451c-b069-0868594b1786 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb28547f4b54c4097d2ffc3c533ca67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42af08ef367945939b1f59ffa8af351a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120798) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:17:56.817878 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.policy [None req-3a59b8db-8a72-451c-b069-0868594b1786 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4fb28547f4b54c4097d2ffc3c533ca67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42af08ef367945939b1f59ffa8af351a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120798) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:17:56.819365 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.policy [None req-3a59b8db-8a72-451c-b069-0868594b1786 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4fb28547f4b54c4097d2ffc3c533ca67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42af08ef367945939b1f59ffa8af351a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120798) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:17:56.820496 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [None req-3a59b8db-8a72-451c-b069-0868594b1786 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] 10.222.0.17 "GET /compute/v2.1/servers/d1a4fd6e-9323-416e-b844-5e526565774e" status: 200 len: 1350 microversion: 2.20 time: 0.114132 Aug 23 07:17:56.821045 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 296/614] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Aug 23 07:17:56 2022] GET /compute/v2.1/servers/d1a4fd6e-9323-416e-b844-5e526565774e => generated 1350 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 07:17:57.026137 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-d3209971-8402-423d-88ab-04e687e7025c tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] Calling method '>' {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:17:57.026680 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.compute.api [None req-d3209971-8402-423d-88ab-04e687e7025c tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] [instance: f7783f88-5770-4ca3-a5cf-294f044d21a8] Fetching instance by UUID {{(pid=120799) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:17:57.033544 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-d3209971-8402-423d-88ab-04e687e7025c tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:17:57.033988 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-d3209971-8402-423d-88ab-04e687e7025c tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:17:57.034409 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-d3209971-8402-423d-88ab-04e687e7025c tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:17:57.035087 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-d3209971-8402-423d-88ab-04e687e7025c tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:17:57.035616 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-d3209971-8402-423d-88ab-04e687e7025c tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:17:57.036036 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-d3209971-8402-423d-88ab-04e687e7025c tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:17:57.062883 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.compute.api [None req-d3209971-8402-423d-88ab-04e687e7025c tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] [instance: f7783f88-5770-4ca3-a5cf-294f044d21a8] Going to try to terminate instance {{(pid=120799) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 07:17:57.150641 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-d3209971-8402-423d-88ab-04e687e7025c tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] 10.222.0.17 "DELETE /compute/v2.1/servers/f7783f88-5770-4ca3-a5cf-294f044d21a8" status: 204 len: 0 microversion: 2.1 time: 0.128677 Aug 23 07:17:57.151238 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 319/615] 10.222.0.17 () {58 vars in 1239 bytes} [Tue Aug 23 07:17:57 2022] DELETE /compute/v2.1/servers/f7783f88-5770-4ca3-a5cf-294f044d21a8 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 23 07:17:57.160822 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-e70506e2-a00c-4209-84a7-4b4fbe12ab24 tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] Calling method '>' {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:17:57.161529 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.compute.api [None req-e70506e2-a00c-4209-84a7-4b4fbe12ab24 tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] [instance: f7783f88-5770-4ca3-a5cf-294f044d21a8] Fetching instance by UUID {{(pid=120798) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:17:57.168207 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-e70506e2-a00c-4209-84a7-4b4fbe12ab24 tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:17:57.168769 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-e70506e2-a00c-4209-84a7-4b4fbe12ab24 tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:17:57.169400 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-e70506e2-a00c-4209-84a7-4b4fbe12ab24 tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:17:57.170658 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-e70506e2-a00c-4209-84a7-4b4fbe12ab24 tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:17:57.171113 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-e70506e2-a00c-4209-84a7-4b4fbe12ab24 tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:17:57.171555 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-e70506e2-a00c-4209-84a7-4b4fbe12ab24 tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:17:57.316997 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.policy [None req-e70506e2-a00c-4209-84a7-4b4fbe12ab24 tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5e8c33634b246319de495d269c05124', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9466597900d4a3ca60a2ef8b7678c87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120798) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:17:57.325607 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [None req-e70506e2-a00c-4209-84a7-4b4fbe12ab24 tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] 10.222.0.17 "GET /compute/v2.1/servers/f7783f88-5770-4ca3-a5cf-294f044d21a8" status: 200 len: 1554 microversion: 2.1 time: 0.169486 Aug 23 07:17:57.326212 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 297/616] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:17:57 2022] GET /compute/v2.1/servers/f7783f88-5770-4ca3-a5cf-294f044d21a8 => generated 1554 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 07:17:57.843654 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-49ad8dd6-eaf0-4358-af8b-41a3aabb5eae tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Calling method '>' {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:17:57.844375 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.compute.api [None req-49ad8dd6-eaf0-4358-af8b-41a3aabb5eae tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] [instance: d1a4fd6e-9323-416e-b844-5e526565774e] Fetching instance by UUID {{(pid=120799) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:17:57.850766 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-49ad8dd6-eaf0-4358-af8b-41a3aabb5eae tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:17:57.851491 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-49ad8dd6-eaf0-4358-af8b-41a3aabb5eae tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:17:57.851917 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-49ad8dd6-eaf0-4358-af8b-41a3aabb5eae tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:17:57.852606 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-49ad8dd6-eaf0-4358-af8b-41a3aabb5eae tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:17:57.853051 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-49ad8dd6-eaf0-4358-af8b-41a3aabb5eae tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:17:57.853513 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-49ad8dd6-eaf0-4358-af8b-41a3aabb5eae tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:17:57.993516 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.policy [None req-49ad8dd6-eaf0-4358-af8b-41a3aabb5eae tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb28547f4b54c4097d2ffc3c533ca67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42af08ef367945939b1f59ffa8af351a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120799) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:17:58.002530 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.policy [None req-49ad8dd6-eaf0-4358-af8b-41a3aabb5eae tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4fb28547f4b54c4097d2ffc3c533ca67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42af08ef367945939b1f59ffa8af351a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120799) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:17:58.004053 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.policy [None req-49ad8dd6-eaf0-4358-af8b-41a3aabb5eae tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4fb28547f4b54c4097d2ffc3c533ca67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42af08ef367945939b1f59ffa8af351a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120799) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:17:58.005213 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-49ad8dd6-eaf0-4358-af8b-41a3aabb5eae tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] 10.222.0.17 "GET /compute/v2.1/servers/d1a4fd6e-9323-416e-b844-5e526565774e" status: 200 len: 1405 microversion: 2.20 time: 0.166360 Aug 23 07:17:58.005771 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 320/617] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Aug 23 07:17:57 2022] GET /compute/v2.1/servers/d1a4fd6e-9323-416e-b844-5e526565774e => generated 1405 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 07:17:58.350674 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-2d549ba1-f5b0-4910-ac89-512ea5995633 tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] Calling method '>' {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:17:58.351550 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.compute.api [None req-2d549ba1-f5b0-4910-ac89-512ea5995633 tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] [instance: f7783f88-5770-4ca3-a5cf-294f044d21a8] Fetching instance by UUID {{(pid=120798) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:17:58.362100 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-2d549ba1-f5b0-4910-ac89-512ea5995633 tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:17:58.362895 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-2d549ba1-f5b0-4910-ac89-512ea5995633 tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:17:58.363640 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-2d549ba1-f5b0-4910-ac89-512ea5995633 tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:17:58.364762 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-2d549ba1-f5b0-4910-ac89-512ea5995633 tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:17:58.365500 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-2d549ba1-f5b0-4910-ac89-512ea5995633 tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:17:58.366190 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-2d549ba1-f5b0-4910-ac89-512ea5995633 tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:17:58.513249 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.policy [None req-2d549ba1-f5b0-4910-ac89-512ea5995633 tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5e8c33634b246319de495d269c05124', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9466597900d4a3ca60a2ef8b7678c87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120798) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:17:58.521328 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [None req-2d549ba1-f5b0-4910-ac89-512ea5995633 tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] 10.222.0.17 "GET /compute/v2.1/servers/f7783f88-5770-4ca3-a5cf-294f044d21a8" status: 200 len: 1554 microversion: 2.1 time: 0.177297 Aug 23 07:17:58.521901 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 298/618] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:17:58 2022] GET /compute/v2.1/servers/f7783f88-5770-4ca3-a5cf-294f044d21a8 => generated 1554 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:17:59.030229 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-25fcf6e0-14bf-4e67-81e2-8f32bf7d78b2 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Calling method '>' {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:17:59.031490 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.compute.api [None req-25fcf6e0-14bf-4e67-81e2-8f32bf7d78b2 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] [instance: d1a4fd6e-9323-416e-b844-5e526565774e] Fetching instance by UUID {{(pid=120799) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:17:59.039240 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-25fcf6e0-14bf-4e67-81e2-8f32bf7d78b2 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:17:59.039836 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-25fcf6e0-14bf-4e67-81e2-8f32bf7d78b2 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:17:59.040478 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-25fcf6e0-14bf-4e67-81e2-8f32bf7d78b2 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:17:59.041179 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-25fcf6e0-14bf-4e67-81e2-8f32bf7d78b2 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:17:59.041630 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-25fcf6e0-14bf-4e67-81e2-8f32bf7d78b2 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:17:59.042051 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-25fcf6e0-14bf-4e67-81e2-8f32bf7d78b2 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:17:59.186036 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [req-c6d4b778-b210-496a-b719-e0863d88e4ac req-aa7ecd1d-7013-4e65-b2fd-0134d03957ce service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d1a4fd6e-9323-416e-b844-5e526565774e", "tag": "4e45252a-a4b1-488a-9f32-2c668277cefd"}]} {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 07:17:59.202327 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [req-c6d4b778-b210-496a-b719-e0863d88e4ac req-aa7ecd1d-7013-4e65-b2fd-0134d03957ce service nova] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:17:59.203199 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [req-c6d4b778-b210-496a-b719-e0863d88e4ac req-aa7ecd1d-7013-4e65-b2fd-0134d03957ce service nova] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:17:59.203891 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [req-c6d4b778-b210-496a-b719-e0863d88e4ac req-aa7ecd1d-7013-4e65-b2fd-0134d03957ce service nova] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:17:59.217443 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.compute.server_external_events [req-c6d4b778-b210-496a-b719-e0863d88e4ac req-aa7ecd1d-7013-4e65-b2fd-0134d03957ce service nova] Creating event network-changed:4e45252a-a4b1-488a-9f32-2c668277cefd for instance d1a4fd6e-9323-416e-b844-5e526565774e on hv-cinder-85409 Aug 23 07:17:59.223947 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [req-c6d4b778-b210-496a-b719-e0863d88e4ac req-aa7ecd1d-7013-4e65-b2fd-0134d03957ce service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042776 Aug 23 07:17:59.224680 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 299/619] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Aug 23 07:17:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 07:17:59.248080 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.policy [None req-25fcf6e0-14bf-4e67-81e2-8f32bf7d78b2 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb28547f4b54c4097d2ffc3c533ca67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42af08ef367945939b1f59ffa8af351a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120799) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:17:59.258174 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.policy [None req-25fcf6e0-14bf-4e67-81e2-8f32bf7d78b2 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4fb28547f4b54c4097d2ffc3c533ca67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42af08ef367945939b1f59ffa8af351a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120799) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:17:59.260021 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.policy [None req-25fcf6e0-14bf-4e67-81e2-8f32bf7d78b2 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4fb28547f4b54c4097d2ffc3c533ca67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42af08ef367945939b1f59ffa8af351a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120799) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:17:59.261231 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-25fcf6e0-14bf-4e67-81e2-8f32bf7d78b2 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] 10.222.0.17 "GET /compute/v2.1/servers/d1a4fd6e-9323-416e-b844-5e526565774e" status: 200 len: 1405 microversion: 2.20 time: 0.236629 Aug 23 07:17:59.262376 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 321/620] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Aug 23 07:17:59 2022] GET /compute/v2.1/servers/d1a4fd6e-9323-416e-b844-5e526565774e => generated 1405 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 07:17:59.427561 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [req-3963684e-cb0b-42ec-9637-b9ea2d133fd5 req-7a80d0e8-2f43-4d72-9f32-516e98d241d5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f7783f88-5770-4ca3-a5cf-294f044d21a8", "name": "network-vif-deleted", "tag": "7ccdc22f-1e2b-4dd9-8ea3-858bf0e435cf"}]} {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 07:17:59.441212 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [req-3963684e-cb0b-42ec-9637-b9ea2d133fd5 req-7a80d0e8-2f43-4d72-9f32-516e98d241d5 service nova] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:17:59.441682 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [req-3963684e-cb0b-42ec-9637-b9ea2d133fd5 req-7a80d0e8-2f43-4d72-9f32-516e98d241d5 service nova] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:17:59.442100 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [req-3963684e-cb0b-42ec-9637-b9ea2d133fd5 req-7a80d0e8-2f43-4d72-9f32-516e98d241d5 service nova] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:17:59.455718 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.compute.server_external_events [req-3963684e-cb0b-42ec-9637-b9ea2d133fd5 req-7a80d0e8-2f43-4d72-9f32-516e98d241d5 service nova] Creating event network-vif-deleted:7ccdc22f-1e2b-4dd9-8ea3-858bf0e435cf for instance f7783f88-5770-4ca3-a5cf-294f044d21a8 on hv-cinder-85409 Aug 23 07:17:59.461955 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [req-3963684e-cb0b-42ec-9637-b9ea2d133fd5 req-7a80d0e8-2f43-4d72-9f32-516e98d241d5 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038663 Aug 23 07:17:59.462548 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 300/621] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Aug 23 07:17:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 07:17:59.543084 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-6872ca4a-bd2c-4af6-aa23-56d0c0988f6a tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] Calling method '>' {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:17:59.543903 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.compute.api [None req-6872ca4a-bd2c-4af6-aa23-56d0c0988f6a tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] [instance: f7783f88-5770-4ca3-a5cf-294f044d21a8] Fetching instance by UUID {{(pid=120799) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:17:59.552552 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-6872ca4a-bd2c-4af6-aa23-56d0c0988f6a tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:17:59.553045 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-6872ca4a-bd2c-4af6-aa23-56d0c0988f6a tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:17:59.559513 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-6872ca4a-bd2c-4af6-aa23-56d0c0988f6a tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:17:59.560625 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-6872ca4a-bd2c-4af6-aa23-56d0c0988f6a tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:17:59.561577 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-6872ca4a-bd2c-4af6-aa23-56d0c0988f6a tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:17:59.562466 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-6872ca4a-bd2c-4af6-aa23-56d0c0988f6a tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:17:59.645617 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.policy [None req-6872ca4a-bd2c-4af6-aa23-56d0c0988f6a tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5e8c33634b246319de495d269c05124', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9466597900d4a3ca60a2ef8b7678c87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120799) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:17:59.659696 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-6872ca4a-bd2c-4af6-aa23-56d0c0988f6a tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] 10.222.0.17 "GET /compute/v2.1/servers/f7783f88-5770-4ca3-a5cf-294f044d21a8" status: 200 len: 1343 microversion: 2.1 time: 0.120892 Aug 23 07:17:59.660435 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 322/622] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:17:59 2022] GET /compute/v2.1/servers/f7783f88-5770-4ca3-a5cf-294f044d21a8 => generated 1343 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:18:00.289240 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-d619088a-6939-480a-87e8-d886d72d06dc tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Calling method '>' {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:18:00.290235 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.compute.api [None req-d619088a-6939-480a-87e8-d886d72d06dc tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] [instance: d1a4fd6e-9323-416e-b844-5e526565774e] Fetching instance by UUID {{(pid=120798) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:18:00.298508 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-d619088a-6939-480a-87e8-d886d72d06dc tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:18:00.298982 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-d619088a-6939-480a-87e8-d886d72d06dc tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:18:00.299437 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-d619088a-6939-480a-87e8-d886d72d06dc tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:18:00.300115 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-d619088a-6939-480a-87e8-d886d72d06dc tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:18:00.300559 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-d619088a-6939-480a-87e8-d886d72d06dc tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:18:00.300973 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-d619088a-6939-480a-87e8-d886d72d06dc tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:18:00.433646 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.policy [None req-d619088a-6939-480a-87e8-d886d72d06dc tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb28547f4b54c4097d2ffc3c533ca67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42af08ef367945939b1f59ffa8af351a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120798) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:18:00.444766 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.policy [None req-d619088a-6939-480a-87e8-d886d72d06dc tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4fb28547f4b54c4097d2ffc3c533ca67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42af08ef367945939b1f59ffa8af351a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120798) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:18:00.447124 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.policy [None req-d619088a-6939-480a-87e8-d886d72d06dc tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4fb28547f4b54c4097d2ffc3c533ca67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42af08ef367945939b1f59ffa8af351a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120798) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:18:00.448685 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [None req-d619088a-6939-480a-87e8-d886d72d06dc tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] 10.222.0.17 "GET /compute/v2.1/servers/d1a4fd6e-9323-416e-b844-5e526565774e" status: 200 len: 1405 microversion: 2.20 time: 0.166750 Aug 23 07:18:00.449418 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 301/623] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Aug 23 07:18:00 2022] GET /compute/v2.1/servers/d1a4fd6e-9323-416e-b844-5e526565774e => generated 1405 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 07:18:00.683762 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-9672ff0e-44f0-42aa-916a-0e3e7e18da12 tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] Calling method '>' {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:18:00.684481 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.compute.api [None req-9672ff0e-44f0-42aa-916a-0e3e7e18da12 tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] [instance: f7783f88-5770-4ca3-a5cf-294f044d21a8] Fetching instance by UUID {{(pid=120799) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:18:00.691924 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-9672ff0e-44f0-42aa-916a-0e3e7e18da12 tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:18:00.692401 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-9672ff0e-44f0-42aa-916a-0e3e7e18da12 tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:18:00.692828 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-9672ff0e-44f0-42aa-916a-0e3e7e18da12 tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:18:00.693515 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-9672ff0e-44f0-42aa-916a-0e3e7e18da12 tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:18:00.693958 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-9672ff0e-44f0-42aa-916a-0e3e7e18da12 tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:18:00.694377 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-9672ff0e-44f0-42aa-916a-0e3e7e18da12 tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:18:00.708507 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.wsgi [None req-9672ff0e-44f0-42aa-916a-0e3e7e18da12 tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] HTTP exception thrown: Instance f7783f88-5770-4ca3-a5cf-294f044d21a8 could not be found. Aug 23 07:18:00.710137 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-9672ff0e-44f0-42aa-916a-0e3e7e18da12 tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] Request method failure captured: Aug 23 07:18:00.710137 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: request: GET /compute/v2.1/servers/f7783f88-5770-4ca3-a5cf-294f044d21a8 HTTP/1.1 Aug 23 07:18:00.710137 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: Accept: application/json Aug 23 07:18:00.710137 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: Accept-Encoding: identity Aug 23 07:18:00.710137 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: Connection: close Aug 23 07:18:00.710137 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: Content-Length: 0 Aug 23 07:18:00.710137 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: Content-Type: application/json Aug 23 07:18:00.710137 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: Host: 10.222.0.17 Aug 23 07:18:00.710137 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: Openstack-System-Scope: None Aug 23 07:18:00.710137 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: User-Agent: python-urllib3/1.26.11 Aug 23 07:18:00.710137 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-Auth-Token: gAAAAABjBH6BD1Ab6JoUxadkzPMoWrxSDq6SaSnNUANqrOrrvV6TtLpdt5wyAWwOT7p8b0fau3qaM8pFqs8prz8kf3i4Ddi7YV5v8Fo6BeNqoaYbQBK0irTEj4ws7VM09kcvYR5aSi-jSP_SAF4GKc3Saatn2Is_itjYe7rPRi8Pc2-CpaHNLio Aug 23 07:18:00.710137 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-Domain-Id: None Aug 23 07:18:00.710137 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-Domain-Name: None Aug 23 07:18:00.710137 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-Identity-Status: Confirmed Aug 23 07:18:00.710137 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-Is-Admin-Project: True Aug 23 07:18:00.710137 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-Project-Domain-Id: default Aug 23 07:18:00.710137 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-Project-Domain-Name: Default Aug 23 07:18:00.710137 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-Project-Id: f9466597900d4a3ca60a2ef8b7678c87 Aug 23 07:18:00.710137 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-Project-Name: tempest-TestMinimumBasicScenario-542220183 Aug 23 07:18:00.710137 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-Role: reader,member Aug 23 07:18:00.710137 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-Roles: reader,member Aug 23 07:18:00.711893 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/f9466597900d4a3ca60a2ef8b7678c87"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/f9466597900d4a3ca60a2ef8b7678c87"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_f9466597900d4a3ca60a2ef8b7678c87"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/f9466597900d4a3ca60a2ef8b7678c87"}]}] Aug 23 07:18:00.711893 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-Tenant: tempest-TestMinimumBasicScenario-542220183 Aug 23 07:18:00.711893 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-Tenant-Id: f9466597900d4a3ca60a2ef8b7678c87 Aug 23 07:18:00.711893 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-Tenant-Name: tempest-TestMinimumBasicScenario-542220183 Aug 23 07:18:00.711893 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-User: tempest-TestMinimumBasicScenario-542220183-project Aug 23 07:18:00.711893 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-User-Domain-Id: default Aug 23 07:18:00.711893 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-User-Domain-Name: Default Aug 23 07:18:00.711893 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-User-Id: a5e8c33634b246319de495d269c05124 Aug 23 07:18:00.711893 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-User-Name: tempest-TestMinimumBasicScenario-542220183-project Aug 23 07:18:00.711893 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: method: > Aug 23 07:18:00.711893 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: exception: Instance f7783f88-5770-4ca3-a5cf-294f044d21a8 could not be found. Aug 23 07:18:00.711893 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: action_args: {'id': 'f7783f88-5770-4ca3-a5cf-294f044d21a8'} Aug 23 07:18:00.712638 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 07:18:00.712638 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 07:18:00.712638 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 07:18:00.712638 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 07:18:00.712638 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 07:18:00.712638 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 07:18:00.712638 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 07:18:00.712638 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 07:18:00.712638 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 07:18:00.712638 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 07:18:00.712638 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f7783f88-5770-4ca3-a5cf-294f044d21a8 could not be found. Aug 23 07:18:00.712638 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi Aug 23 07:18:00.712638 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 07:18:00.712638 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi Aug 23 07:18:00.712638 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 07:18:00.712638 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 07:18:00.712638 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 07:18:00.712638 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 07:18:00.712638 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 07:18:00.712638 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 07:18:00.714174 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 07:18:00.714174 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 07:18:00.714174 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 07:18:00.714174 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 07:18:00.714174 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 07:18:00.714174 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 07:18:00.714174 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 07:18:00.714174 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f7783f88-5770-4ca3-a5cf-294f044d21a8 could not be found. Aug 23 07:18:00.714174 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi Aug 23 07:18:00.714174 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 07:18:00.714174 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi Aug 23 07:18:00.714174 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 07:18:00.714174 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 07:18:00.714174 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 07:18:00.714174 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 07:18:00.714174 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 07:18:00.714174 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f7783f88-5770-4ca3-a5cf-294f044d21a8 could not be found. Aug 23 07:18:00.714174 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi Aug 23 07:18:00.715679 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-9672ff0e-44f0-42aa-916a-0e3e7e18da12 tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] Returning 404 to user: Instance f7783f88-5770-4ca3-a5cf-294f044d21a8 could not be found. {{(pid=120799) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 07:18:00.715679 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-9672ff0e-44f0-42aa-916a-0e3e7e18da12 tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] 10.222.0.17 "GET /compute/v2.1/servers/f7783f88-5770-4ca3-a5cf-294f044d21a8" status: 404 len: 111 microversion: 2.1 time: 0.032930 Aug 23 07:18:00.715679 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 323/624] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:18:00 2022] GET /compute/v2.1/servers/f7783f88-5770-4ca3-a5cf-294f044d21a8 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 07:18:00.721326 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-2b8cb1a4-605b-4d75-b04b-989bc4b57db9 tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] Calling method '.version_select at 0x7fe3c580dca0>' {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:18:00.742754 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [None req-2b8cb1a4-605b-4d75-b04b-989bc4b57db9 tempest-TestMinimumBasicScenario-542220183 tempest-TestMinimumBasicScenario-542220183-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-324828606" status: 202 len: 0 microversion: 2.1 time: 0.025391 Aug 23 07:18:00.743310 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 302/625] 10.222.0.17 () {58 vars in 1269 bytes} [Tue Aug 23 07:18:00 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-324828606 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 07:18:01.471800 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-7d67ada1-68d8-4485-a239-b3f49a7b50ab tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Calling method '>' {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:18:01.472303 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.compute.api [None req-7d67ada1-68d8-4485-a239-b3f49a7b50ab tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] [instance: d1a4fd6e-9323-416e-b844-5e526565774e] Fetching instance by UUID {{(pid=120799) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:18:01.474258 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG dbcounter [-] [120799] Writing DB stats nova_api:SELECT=73,nova_api:DELETE=1,nova_api:UPDATE=3,nova_api:INSERT=3 {{(pid=120799) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:18:01.480082 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-7d67ada1-68d8-4485-a239-b3f49a7b50ab tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:18:01.480747 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-7d67ada1-68d8-4485-a239-b3f49a7b50ab tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:18:01.481165 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-7d67ada1-68d8-4485-a239-b3f49a7b50ab tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:18:01.481847 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-7d67ada1-68d8-4485-a239-b3f49a7b50ab tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:18:01.482863 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-7d67ada1-68d8-4485-a239-b3f49a7b50ab tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:18:01.483292 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-7d67ada1-68d8-4485-a239-b3f49a7b50ab tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:18:01.488647 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG dbcounter [-] [120799] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=120799) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:18:01.936555 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.policy [None req-7d67ada1-68d8-4485-a239-b3f49a7b50ab tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb28547f4b54c4097d2ffc3c533ca67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42af08ef367945939b1f59ffa8af351a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120799) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:18:01.945367 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.policy [None req-7d67ada1-68d8-4485-a239-b3f49a7b50ab tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4fb28547f4b54c4097d2ffc3c533ca67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42af08ef367945939b1f59ffa8af351a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120799) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:18:01.946859 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.policy [None req-7d67ada1-68d8-4485-a239-b3f49a7b50ab tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4fb28547f4b54c4097d2ffc3c533ca67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42af08ef367945939b1f59ffa8af351a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120799) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:18:01.948005 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-7d67ada1-68d8-4485-a239-b3f49a7b50ab tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] 10.222.0.17 "GET /compute/v2.1/servers/d1a4fd6e-9323-416e-b844-5e526565774e" status: 200 len: 1405 microversion: 2.20 time: 0.480351 Aug 23 07:18:01.948583 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 324/626] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Aug 23 07:18:01 2022] GET /compute/v2.1/servers/d1a4fd6e-9323-416e-b844-5e526565774e => generated 1405 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 07:18:02.972060 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-96876d66-8f51-43f6-b246-00ef9c7f4d08 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Calling method '>' {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:18:02.973415 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.compute.api [None req-96876d66-8f51-43f6-b246-00ef9c7f4d08 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] [instance: d1a4fd6e-9323-416e-b844-5e526565774e] Fetching instance by UUID {{(pid=120798) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:18:02.975366 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG dbcounter [-] [120798] Writing DB stats nova_api:SELECT=60,nova_api:INSERT=1,nova_api:DELETE=1 {{(pid=120798) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:18:02.984474 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-96876d66-8f51-43f6-b246-00ef9c7f4d08 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:18:02.985242 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-96876d66-8f51-43f6-b246-00ef9c7f4d08 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:18:02.985666 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-96876d66-8f51-43f6-b246-00ef9c7f4d08 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:18:02.986530 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-96876d66-8f51-43f6-b246-00ef9c7f4d08 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:18:02.986983 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-96876d66-8f51-43f6-b246-00ef9c7f4d08 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:18:02.987402 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-96876d66-8f51-43f6-b246-00ef9c7f4d08 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:18:03.273936 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.policy [None req-96876d66-8f51-43f6-b246-00ef9c7f4d08 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb28547f4b54c4097d2ffc3c533ca67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42af08ef367945939b1f59ffa8af351a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120798) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:18:03.282505 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.policy [None req-96876d66-8f51-43f6-b246-00ef9c7f4d08 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4fb28547f4b54c4097d2ffc3c533ca67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42af08ef367945939b1f59ffa8af351a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120798) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:18:03.284046 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.policy [None req-96876d66-8f51-43f6-b246-00ef9c7f4d08 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4fb28547f4b54c4097d2ffc3c533ca67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42af08ef367945939b1f59ffa8af351a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120798) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:18:03.285120 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [None req-96876d66-8f51-43f6-b246-00ef9c7f4d08 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] 10.222.0.17 "GET /compute/v2.1/servers/d1a4fd6e-9323-416e-b844-5e526565774e" status: 200 len: 1405 microversion: 2.20 time: 0.318810 Aug 23 07:18:03.285958 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 303/627] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Aug 23 07:18:02 2022] GET /compute/v2.1/servers/d1a4fd6e-9323-416e-b844-5e526565774e => generated 1405 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 07:18:04.308477 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-7152793b-ede3-4aeb-bec5-8c578eef63b1 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Calling method '>' {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:18:04.309672 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.compute.api [None req-7152793b-ede3-4aeb-bec5-8c578eef63b1 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] [instance: d1a4fd6e-9323-416e-b844-5e526565774e] Fetching instance by UUID {{(pid=120799) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:18:04.317611 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-7152793b-ede3-4aeb-bec5-8c578eef63b1 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:18:04.318309 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-7152793b-ede3-4aeb-bec5-8c578eef63b1 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:18:04.318739 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-7152793b-ede3-4aeb-bec5-8c578eef63b1 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:18:04.319452 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-7152793b-ede3-4aeb-bec5-8c578eef63b1 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:18:04.319898 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-7152793b-ede3-4aeb-bec5-8c578eef63b1 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:18:04.320346 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-7152793b-ede3-4aeb-bec5-8c578eef63b1 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:18:04.509837 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.policy [None req-7152793b-ede3-4aeb-bec5-8c578eef63b1 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb28547f4b54c4097d2ffc3c533ca67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42af08ef367945939b1f59ffa8af351a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120799) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:18:04.518609 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.policy [None req-7152793b-ede3-4aeb-bec5-8c578eef63b1 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4fb28547f4b54c4097d2ffc3c533ca67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42af08ef367945939b1f59ffa8af351a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120799) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:18:04.520267 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.policy [None req-7152793b-ede3-4aeb-bec5-8c578eef63b1 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4fb28547f4b54c4097d2ffc3c533ca67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42af08ef367945939b1f59ffa8af351a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120799) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:18:04.521377 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-7152793b-ede3-4aeb-bec5-8c578eef63b1 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] 10.222.0.17 "GET /compute/v2.1/servers/d1a4fd6e-9323-416e-b844-5e526565774e" status: 200 len: 1405 microversion: 2.20 time: 0.216864 Aug 23 07:18:04.522098 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 325/628] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Aug 23 07:18:04 2022] GET /compute/v2.1/servers/d1a4fd6e-9323-416e-b844-5e526565774e => generated 1405 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 07:18:04.957297 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [req-4d8358b7-70e3-403c-90d2-c551b752ffdf req-d9f99404-4f73-4eff-80be-d1808325ec07 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d1a4fd6e-9323-416e-b844-5e526565774e", "name": "network-vif-plugged", "status": "completed", "tag": "4e45252a-a4b1-488a-9f32-2c668277cefd"}]} {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 07:18:04.968063 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [req-4d8358b7-70e3-403c-90d2-c551b752ffdf req-d9f99404-4f73-4eff-80be-d1808325ec07 service nova] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:18:04.968793 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [req-4d8358b7-70e3-403c-90d2-c551b752ffdf req-d9f99404-4f73-4eff-80be-d1808325ec07 service nova] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:18:04.969379 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [req-4d8358b7-70e3-403c-90d2-c551b752ffdf req-d9f99404-4f73-4eff-80be-d1808325ec07 service nova] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:18:04.982260 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.compute.server_external_events [req-4d8358b7-70e3-403c-90d2-c551b752ffdf req-d9f99404-4f73-4eff-80be-d1808325ec07 service nova] Creating event network-vif-plugged:4e45252a-a4b1-488a-9f32-2c668277cefd for instance d1a4fd6e-9323-416e-b844-5e526565774e on hv-cinder-85409 Aug 23 07:18:04.988927 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [req-4d8358b7-70e3-403c-90d2-c551b752ffdf req-d9f99404-4f73-4eff-80be-d1808325ec07 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.130820 Aug 23 07:18:04.989729 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 304/629] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Aug 23 07:18:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 07:18:05.546505 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-feaf39af-e3dc-416f-9146-0cc6df8040e5 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Calling method '>' {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:18:05.549146 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.compute.api [None req-feaf39af-e3dc-416f-9146-0cc6df8040e5 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] [instance: d1a4fd6e-9323-416e-b844-5e526565774e] Fetching instance by UUID {{(pid=120799) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:18:05.552787 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG dbcounter [-] [120799] Writing DB stats nova_cell0:SELECT=2 {{(pid=120799) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:18:05.553734 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG dbcounter [-] [120799] Writing DB stats nova_cell0:SELECT=6 {{(pid=120799) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:18:05.562465 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-feaf39af-e3dc-416f-9146-0cc6df8040e5 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:18:05.562989 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-feaf39af-e3dc-416f-9146-0cc6df8040e5 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:18:05.563450 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-feaf39af-e3dc-416f-9146-0cc6df8040e5 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:18:05.564181 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-feaf39af-e3dc-416f-9146-0cc6df8040e5 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:18:05.564628 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-feaf39af-e3dc-416f-9146-0cc6df8040e5 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:18:05.565045 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-feaf39af-e3dc-416f-9146-0cc6df8040e5 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:18:05.698210 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.policy [None req-feaf39af-e3dc-416f-9146-0cc6df8040e5 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb28547f4b54c4097d2ffc3c533ca67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42af08ef367945939b1f59ffa8af351a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120799) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:18:05.706699 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.policy [None req-feaf39af-e3dc-416f-9146-0cc6df8040e5 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4fb28547f4b54c4097d2ffc3c533ca67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42af08ef367945939b1f59ffa8af351a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120799) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:18:05.708674 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.policy [None req-feaf39af-e3dc-416f-9146-0cc6df8040e5 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4fb28547f4b54c4097d2ffc3c533ca67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42af08ef367945939b1f59ffa8af351a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120799) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:18:05.709853 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-feaf39af-e3dc-416f-9146-0cc6df8040e5 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] 10.222.0.17 "GET /compute/v2.1/servers/d1a4fd6e-9323-416e-b844-5e526565774e" status: 200 len: 1405 microversion: 2.20 time: 0.168611 Aug 23 07:18:05.710395 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 326/630] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Aug 23 07:18:05 2022] GET /compute/v2.1/servers/d1a4fd6e-9323-416e-b844-5e526565774e => generated 1405 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 07:18:06.730858 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG dbcounter [-] [120798] Writing DB stats nova_cell0:SELECT=6 {{(pid=120798) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:18:06.737456 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-b529bbb3-8eb5-4c09-91a8-40d4bc3e16fa tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Calling method '>' {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:18:06.738186 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.compute.api [None req-b529bbb3-8eb5-4c09-91a8-40d4bc3e16fa tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] [instance: d1a4fd6e-9323-416e-b844-5e526565774e] Fetching instance by UUID {{(pid=120798) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:18:06.757264 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-b529bbb3-8eb5-4c09-91a8-40d4bc3e16fa tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:18:06.758132 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-b529bbb3-8eb5-4c09-91a8-40d4bc3e16fa tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:18:06.759265 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-b529bbb3-8eb5-4c09-91a8-40d4bc3e16fa tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:18:06.760837 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-b529bbb3-8eb5-4c09-91a8-40d4bc3e16fa tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:18:06.761626 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-b529bbb3-8eb5-4c09-91a8-40d4bc3e16fa tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:18:06.762419 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-b529bbb3-8eb5-4c09-91a8-40d4bc3e16fa tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:18:07.190743 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.policy [None req-b529bbb3-8eb5-4c09-91a8-40d4bc3e16fa tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb28547f4b54c4097d2ffc3c533ca67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42af08ef367945939b1f59ffa8af351a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120798) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:18:07.200353 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.policy [None req-b529bbb3-8eb5-4c09-91a8-40d4bc3e16fa tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4fb28547f4b54c4097d2ffc3c533ca67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42af08ef367945939b1f59ffa8af351a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120798) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:18:07.202039 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.policy [None req-b529bbb3-8eb5-4c09-91a8-40d4bc3e16fa tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4fb28547f4b54c4097d2ffc3c533ca67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42af08ef367945939b1f59ffa8af351a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120798) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:18:07.203212 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [None req-b529bbb3-8eb5-4c09-91a8-40d4bc3e16fa tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] 10.222.0.17 "GET /compute/v2.1/servers/d1a4fd6e-9323-416e-b844-5e526565774e" status: 200 len: 1405 microversion: 2.20 time: 0.473346 Aug 23 07:18:07.203991 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 305/631] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Aug 23 07:18:06 2022] GET /compute/v2.1/servers/d1a4fd6e-9323-416e-b844-5e526565774e => generated 1405 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 07:18:08.227441 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-8f6ff8e9-73dd-4395-b38f-355cf1f1ab44 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Calling method '>' {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:18:08.228140 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.compute.api [None req-8f6ff8e9-73dd-4395-b38f-355cf1f1ab44 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] [instance: d1a4fd6e-9323-416e-b844-5e526565774e] Fetching instance by UUID {{(pid=120799) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:18:08.238312 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-8f6ff8e9-73dd-4395-b38f-355cf1f1ab44 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:18:08.239393 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-8f6ff8e9-73dd-4395-b38f-355cf1f1ab44 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:18:08.239917 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-8f6ff8e9-73dd-4395-b38f-355cf1f1ab44 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:18:08.240703 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-8f6ff8e9-73dd-4395-b38f-355cf1f1ab44 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:18:08.241212 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-8f6ff8e9-73dd-4395-b38f-355cf1f1ab44 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:18:08.241701 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-8f6ff8e9-73dd-4395-b38f-355cf1f1ab44 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:18:08.415505 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.policy [None req-8f6ff8e9-73dd-4395-b38f-355cf1f1ab44 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb28547f4b54c4097d2ffc3c533ca67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42af08ef367945939b1f59ffa8af351a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120799) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:18:08.424283 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.policy [None req-8f6ff8e9-73dd-4395-b38f-355cf1f1ab44 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4fb28547f4b54c4097d2ffc3c533ca67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42af08ef367945939b1f59ffa8af351a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120799) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:18:08.425779 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.policy [None req-8f6ff8e9-73dd-4395-b38f-355cf1f1ab44 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4fb28547f4b54c4097d2ffc3c533ca67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42af08ef367945939b1f59ffa8af351a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120799) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:18:08.426908 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-8f6ff8e9-73dd-4395-b38f-355cf1f1ab44 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] 10.222.0.17 "GET /compute/v2.1/servers/d1a4fd6e-9323-416e-b844-5e526565774e" status: 200 len: 1596 microversion: 2.20 time: 0.203922 Aug 23 07:18:08.427649 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 327/632] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Aug 23 07:18:08 2022] GET /compute/v2.1/servers/d1a4fd6e-9323-416e-b844-5e526565774e => generated 1596 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 07:18:08.449032 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-cc42ddb7-a242-4b84-8717-b7de49412eec tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Calling method '>' {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:18:08.449504 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.compute.api [None req-cc42ddb7-a242-4b84-8717-b7de49412eec tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] [instance: d1a4fd6e-9323-416e-b844-5e526565774e] Fetching instance by UUID {{(pid=120798) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:18:08.456350 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-cc42ddb7-a242-4b84-8717-b7de49412eec tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:18:08.456862 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-cc42ddb7-a242-4b84-8717-b7de49412eec tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:18:08.457389 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-cc42ddb7-a242-4b84-8717-b7de49412eec tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:18:08.457995 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-cc42ddb7-a242-4b84-8717-b7de49412eec tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:18:08.458464 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-cc42ddb7-a242-4b84-8717-b7de49412eec tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:18:08.458881 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-cc42ddb7-a242-4b84-8717-b7de49412eec tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:18:08.539977 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [None req-cc42ddb7-a242-4b84-8717-b7de49412eec tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] 10.222.0.17 "GET /compute/v2.1/servers/d1a4fd6e-9323-416e-b844-5e526565774e/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.094736 Aug 23 07:18:08.540619 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 306/633] 10.222.0.17 () {60 vars in 1316 bytes} [Tue Aug 23 07:18:08 2022] GET /compute/v2.1/servers/d1a4fd6e-9323-416e-b844-5e526565774e/os-interface => generated 284 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 23 07:18:09.502366 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [req-885cbf9e-c761-40b3-8eb6-37b18875ba60 req-607f55ca-7316-4276-b728-08a47d3228d4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d1a4fd6e-9323-416e-b844-5e526565774e", "tag": "4e45252a-a4b1-488a-9f32-2c668277cefd"}]} {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 07:18:09.518920 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [req-885cbf9e-c761-40b3-8eb6-37b18875ba60 req-607f55ca-7316-4276-b728-08a47d3228d4 service nova] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:18:09.519506 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [req-885cbf9e-c761-40b3-8eb6-37b18875ba60 req-607f55ca-7316-4276-b728-08a47d3228d4 service nova] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:18:09.520001 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [req-885cbf9e-c761-40b3-8eb6-37b18875ba60 req-607f55ca-7316-4276-b728-08a47d3228d4 service nova] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:18:09.534958 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.compute.server_external_events [req-885cbf9e-c761-40b3-8eb6-37b18875ba60 req-607f55ca-7316-4276-b728-08a47d3228d4 service nova] Creating event network-changed:4e45252a-a4b1-488a-9f32-2c668277cefd for instance d1a4fd6e-9323-416e-b844-5e526565774e on hv-cinder-85409 Aug 23 07:18:09.540160 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [req-885cbf9e-c761-40b3-8eb6-37b18875ba60 req-607f55ca-7316-4276-b728-08a47d3228d4 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042253 Aug 23 07:18:09.540812 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 328/634] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Aug 23 07:18:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 07:18:10.689715 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-a7b8af80-25ee-4cba-aec4-1314b331d2f0 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Calling method '>' {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:18:10.690320 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.compute.api [None req-a7b8af80-25ee-4cba-aec4-1314b331d2f0 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] [instance: 18882ea3-d64e-4894-b42d-9769383c4668] Fetching instance by UUID {{(pid=120798) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:18:10.702570 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-a7b8af80-25ee-4cba-aec4-1314b331d2f0 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:18:10.703364 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-a7b8af80-25ee-4cba-aec4-1314b331d2f0 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:18:10.703877 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-a7b8af80-25ee-4cba-aec4-1314b331d2f0 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:18:10.704685 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-a7b8af80-25ee-4cba-aec4-1314b331d2f0 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:18:10.705066 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-a7b8af80-25ee-4cba-aec4-1314b331d2f0 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:18:10.705460 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-a7b8af80-25ee-4cba-aec4-1314b331d2f0 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:18:10.731092 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [None req-a7b8af80-25ee-4cba-aec4-1314b331d2f0 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] 10.222.0.17 "GET /compute/v2.1/servers/18882ea3-d64e-4894-b42d-9769383c4668/ips" status: 200 len: 150 microversion: 2.1 time: 0.047040 Aug 23 07:18:10.731707 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 307/635] 10.222.0.17 () {58 vars in 1248 bytes} [Tue Aug 23 07:18:10 2022] GET /compute/v2.1/servers/18882ea3-d64e-4894-b42d-9769383c4668/ips => generated 150 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 07:18:12.122726 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-ebfe655e-7725-4a81-810b-0c8b502afa5f tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "fe3d3a02-14f1-49cd-ab5b-375bd2e4e2da"}} {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 07:18:12.125298 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.compute.api [None req-ebfe655e-7725-4a81-810b-0c8b502afa5f tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] [instance: 18882ea3-d64e-4894-b42d-9769383c4668] Fetching instance by UUID {{(pid=120799) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:18:12.131854 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-ebfe655e-7725-4a81-810b-0c8b502afa5f tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:18:12.132327 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-ebfe655e-7725-4a81-810b-0c8b502afa5f tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:18:12.132815 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-ebfe655e-7725-4a81-810b-0c8b502afa5f tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:18:12.133489 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-ebfe655e-7725-4a81-810b-0c8b502afa5f tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:18:12.133962 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-ebfe655e-7725-4a81-810b-0c8b502afa5f tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:18:12.134387 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-ebfe655e-7725-4a81-810b-0c8b502afa5f tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:18:12.398308 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-ebfe655e-7725-4a81-810b-0c8b502afa5f tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] 10.222.0.17 "POST /compute/v2.1/servers/18882ea3-d64e-4894-b42d-9769383c4668/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.280240 Aug 23 07:18:12.399039 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 329/636] 10.222.0.17 () {60 vars in 1323 bytes} [Tue Aug 23 07:18:12 2022] POST /compute/v2.1/servers/18882ea3-d64e-4894-b42d-9769383c4668/os-volume_attachments => generated 194 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 07:18:19.015504 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-b83632b0-de45-44c8-a296-bdbf607fa845 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Calling method '>' {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:18:19.016041 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.compute.api [None req-b83632b0-de45-44c8-a296-bdbf607fa845 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] [instance: 18882ea3-d64e-4894-b42d-9769383c4668] Fetching instance by UUID {{(pid=120798) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:18:19.022533 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-b83632b0-de45-44c8-a296-bdbf607fa845 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:18:19.023005 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-b83632b0-de45-44c8-a296-bdbf607fa845 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:18:19.023454 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-b83632b0-de45-44c8-a296-bdbf607fa845 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:18:19.024136 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-b83632b0-de45-44c8-a296-bdbf607fa845 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:18:19.024578 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-b83632b0-de45-44c8-a296-bdbf607fa845 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:18:19.024994 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-b83632b0-de45-44c8-a296-bdbf607fa845 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:18:19.107847 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.objects.instance [None req-b83632b0-de45-44c8-a296-bdbf607fa845 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lazy-loading 'services' on Instance uuid 18882ea3-d64e-4894-b42d-9769383c4668 {{(pid=120798) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 07:18:19.233598 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [None req-b83632b0-de45-44c8-a296-bdbf607fa845 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] 10.222.0.17 "DELETE /compute/v2.1/servers/18882ea3-d64e-4894-b42d-9769383c4668/os-volume_attachments/fe3d3a02-14f1-49cd-ab5b-375bd2e4e2da" status: 202 len: 0 microversion: 2.1 time: 0.223455 Aug 23 07:18:19.234173 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 308/637] 10.222.0.17 () {58 vars in 1416 bytes} [Tue Aug 23 07:18:19 2022] DELETE /compute/v2.1/servers/18882ea3-d64e-4894-b42d-9769383c4668/os-volume_attachments/fe3d3a02-14f1-49cd-ab5b-375bd2e4e2da => generated 0 bytes in 225 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 07:18:19.244771 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-e398cef0-8cd2-43db-85ae-b1f1acbbadb2 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Calling method '>' {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:18:19.247105 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.compute.api [None req-e398cef0-8cd2-43db-85ae-b1f1acbbadb2 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] [instance: 18882ea3-d64e-4894-b42d-9769383c4668] Fetching instance by UUID {{(pid=120799) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:18:19.254974 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-e398cef0-8cd2-43db-85ae-b1f1acbbadb2 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:18:19.256116 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-e398cef0-8cd2-43db-85ae-b1f1acbbadb2 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:18:19.256699 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-e398cef0-8cd2-43db-85ae-b1f1acbbadb2 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:18:19.257575 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-e398cef0-8cd2-43db-85ae-b1f1acbbadb2 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:18:19.258218 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-e398cef0-8cd2-43db-85ae-b1f1acbbadb2 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:18:19.258640 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-e398cef0-8cd2-43db-85ae-b1f1acbbadb2 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:18:19.295047 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-e398cef0-8cd2-43db-85ae-b1f1acbbadb2 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] 10.222.0.17 "GET /compute/v2.1/servers/18882ea3-d64e-4894-b42d-9769383c4668/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056192 Aug 23 07:18:19.295758 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 330/638] 10.222.0.17 () {58 vars in 1302 bytes} [Tue Aug 23 07:18:19 2022] GET /compute/v2.1/servers/18882ea3-d64e-4894-b42d-9769383c4668/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 07:18:20.314201 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-8797ba1c-8adf-429c-9091-99ddb5b9eba1 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Calling method '>' {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:18:20.317824 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.compute.api [None req-8797ba1c-8adf-429c-9091-99ddb5b9eba1 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] [instance: 18882ea3-d64e-4894-b42d-9769383c4668] Fetching instance by UUID {{(pid=120798) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:18:20.328428 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-8797ba1c-8adf-429c-9091-99ddb5b9eba1 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:18:20.329228 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-8797ba1c-8adf-429c-9091-99ddb5b9eba1 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:18:20.330003 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-8797ba1c-8adf-429c-9091-99ddb5b9eba1 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:18:20.331161 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-8797ba1c-8adf-429c-9091-99ddb5b9eba1 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:18:20.331970 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-8797ba1c-8adf-429c-9091-99ddb5b9eba1 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:18:20.332359 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-8797ba1c-8adf-429c-9091-99ddb5b9eba1 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:18:20.362952 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [None req-8797ba1c-8adf-429c-9091-99ddb5b9eba1 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] 10.222.0.17 "GET /compute/v2.1/servers/18882ea3-d64e-4894-b42d-9769383c4668/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.057254 Aug 23 07:18:20.363578 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 309/639] 10.222.0.17 () {58 vars in 1302 bytes} [Tue Aug 23 07:18:20 2022] GET /compute/v2.1/servers/18882ea3-d64e-4894-b42d-9769383c4668/os-volume_attachments => generated 25 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 23 07:18:20.434109 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-35cdf4c1-8b20-4d7a-9912-419e00c50c3f tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Calling method '>' {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:18:20.434611 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.compute.api [None req-35cdf4c1-8b20-4d7a-9912-419e00c50c3f tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] [instance: 18882ea3-d64e-4894-b42d-9769383c4668] Fetching instance by UUID {{(pid=120799) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:18:20.444206 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-35cdf4c1-8b20-4d7a-9912-419e00c50c3f tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:18:20.444906 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-35cdf4c1-8b20-4d7a-9912-419e00c50c3f tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:18:20.445527 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-35cdf4c1-8b20-4d7a-9912-419e00c50c3f tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:18:20.446520 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-35cdf4c1-8b20-4d7a-9912-419e00c50c3f tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:18:20.447130 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-35cdf4c1-8b20-4d7a-9912-419e00c50c3f tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:18:20.447671 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-35cdf4c1-8b20-4d7a-9912-419e00c50c3f tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:18:20.474416 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.compute.api [None req-35cdf4c1-8b20-4d7a-9912-419e00c50c3f tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] [instance: 18882ea3-d64e-4894-b42d-9769383c4668] Going to try to terminate instance {{(pid=120799) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 07:18:20.558410 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-35cdf4c1-8b20-4d7a-9912-419e00c50c3f tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] 10.222.0.17 "DELETE /compute/v2.1/servers/18882ea3-d64e-4894-b42d-9769383c4668" status: 204 len: 0 microversion: 2.1 time: 0.129245 Aug 23 07:18:20.558998 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 331/640] 10.222.0.17 () {58 vars in 1239 bytes} [Tue Aug 23 07:18:20 2022] DELETE /compute/v2.1/servers/18882ea3-d64e-4894-b42d-9769383c4668 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 23 07:18:20.568063 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-35ffa3d8-11c8-4328-bcac-6f757699751f tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Calling method '>' {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:18:20.568590 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.compute.api [None req-35ffa3d8-11c8-4328-bcac-6f757699751f tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] [instance: 18882ea3-d64e-4894-b42d-9769383c4668] Fetching instance by UUID {{(pid=120798) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:18:20.574575 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-35ffa3d8-11c8-4328-bcac-6f757699751f tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:18:20.575043 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-35ffa3d8-11c8-4328-bcac-6f757699751f tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:18:20.575490 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-35ffa3d8-11c8-4328-bcac-6f757699751f tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:18:20.576500 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-35ffa3d8-11c8-4328-bcac-6f757699751f tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:18:20.576947 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-35ffa3d8-11c8-4328-bcac-6f757699751f tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:18:20.577348 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-35ffa3d8-11c8-4328-bcac-6f757699751f tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:18:20.711677 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.policy [None req-35ffa3d8-11c8-4328-bcac-6f757699751f tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '471dc5c1db64411ab1d80ad6c038e519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb44f62fa62e46528712f24479cbb19f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120798) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:18:20.720024 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [None req-35ffa3d8-11c8-4328-bcac-6f757699751f tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] 10.222.0.17 "GET /compute/v2.1/servers/18882ea3-d64e-4894-b42d-9769383c4668" status: 200 len: 1683 microversion: 2.1 time: 0.155856 Aug 23 07:18:20.720590 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 310/641] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:18:20 2022] GET /compute/v2.1/servers/18882ea3-d64e-4894-b42d-9769383c4668 => generated 1683 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:18:21.756166 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-3325c266-5452-4829-88a7-58242d1a6709 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Calling method '>' {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:18:21.757157 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.compute.api [None req-3325c266-5452-4829-88a7-58242d1a6709 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] [instance: 18882ea3-d64e-4894-b42d-9769383c4668] Fetching instance by UUID {{(pid=120799) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:18:21.766289 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-3325c266-5452-4829-88a7-58242d1a6709 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:18:21.766764 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-3325c266-5452-4829-88a7-58242d1a6709 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:18:21.767192 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-3325c266-5452-4829-88a7-58242d1a6709 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:18:21.767909 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-3325c266-5452-4829-88a7-58242d1a6709 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:18:21.768359 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-3325c266-5452-4829-88a7-58242d1a6709 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:18:21.768770 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-3325c266-5452-4829-88a7-58242d1a6709 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:18:21.913331 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.policy [None req-3325c266-5452-4829-88a7-58242d1a6709 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '471dc5c1db64411ab1d80ad6c038e519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb44f62fa62e46528712f24479cbb19f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120799) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:18:21.923949 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-3325c266-5452-4829-88a7-58242d1a6709 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] 10.222.0.17 "GET /compute/v2.1/servers/18882ea3-d64e-4894-b42d-9769383c4668" status: 200 len: 1683 microversion: 2.1 time: 0.176541 Aug 23 07:18:21.924510 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 332/642] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:18:21 2022] GET /compute/v2.1/servers/18882ea3-d64e-4894-b42d-9769383c4668 => generated 1683 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:18:22.945618 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-3f0fd04a-c17c-4cd4-8bfb-50bafd57f38a tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Calling method '>' {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:18:22.946308 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.compute.api [None req-3f0fd04a-c17c-4cd4-8bfb-50bafd57f38a tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] [instance: 18882ea3-d64e-4894-b42d-9769383c4668] Fetching instance by UUID {{(pid=120798) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:18:22.952975 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-3f0fd04a-c17c-4cd4-8bfb-50bafd57f38a tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:18:22.953476 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-3f0fd04a-c17c-4cd4-8bfb-50bafd57f38a tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:18:22.953908 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-3f0fd04a-c17c-4cd4-8bfb-50bafd57f38a tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:18:22.954601 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-3f0fd04a-c17c-4cd4-8bfb-50bafd57f38a tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:18:22.955052 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-3f0fd04a-c17c-4cd4-8bfb-50bafd57f38a tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:18:22.955514 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-3f0fd04a-c17c-4cd4-8bfb-50bafd57f38a tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:18:23.023710 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.policy [None req-3f0fd04a-c17c-4cd4-8bfb-50bafd57f38a tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '471dc5c1db64411ab1d80ad6c038e519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb44f62fa62e46528712f24479cbb19f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120798) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:18:23.031795 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [None req-3f0fd04a-c17c-4cd4-8bfb-50bafd57f38a tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] 10.222.0.17 "GET /compute/v2.1/servers/18882ea3-d64e-4894-b42d-9769383c4668" status: 200 len: 1615 microversion: 2.1 time: 0.090240 Aug 23 07:18:23.032439 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 311/643] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:18:22 2022] GET /compute/v2.1/servers/18882ea3-d64e-4894-b42d-9769383c4668 => generated 1615 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:18:23.080860 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [req-c4994e0e-3bd9-4d5c-a481-e89da599f52e req-debf83ff-1c04-4c11-8e15-3091faedb790 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "18882ea3-d64e-4894-b42d-9769383c4668", "name": "network-vif-deleted", "tag": "daf9b2c2-bba6-4920-99e0-34f072476b94"}]} {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 07:18:23.093833 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [req-c4994e0e-3bd9-4d5c-a481-e89da599f52e req-debf83ff-1c04-4c11-8e15-3091faedb790 service nova] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:18:23.094332 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [req-c4994e0e-3bd9-4d5c-a481-e89da599f52e req-debf83ff-1c04-4c11-8e15-3091faedb790 service nova] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:18:23.094782 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [req-c4994e0e-3bd9-4d5c-a481-e89da599f52e req-debf83ff-1c04-4c11-8e15-3091faedb790 service nova] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:18:23.109047 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.compute.server_external_events [req-c4994e0e-3bd9-4d5c-a481-e89da599f52e req-debf83ff-1c04-4c11-8e15-3091faedb790 service nova] Creating event network-vif-deleted:daf9b2c2-bba6-4920-99e0-34f072476b94 for instance 18882ea3-d64e-4894-b42d-9769383c4668 on hv-cinder-85409 Aug 23 07:18:23.116179 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [req-c4994e0e-3bd9-4d5c-a481-e89da599f52e req-debf83ff-1c04-4c11-8e15-3091faedb790 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039820 Aug 23 07:18:23.117143 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 333/644] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Aug 23 07:18:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 07:18:24.054128 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-1151d4e0-d026-4a9f-b006-e3f47b7284d7 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Calling method '>' {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:18:24.054827 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.compute.api [None req-1151d4e0-d026-4a9f-b006-e3f47b7284d7 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] [instance: 18882ea3-d64e-4894-b42d-9769383c4668] Fetching instance by UUID {{(pid=120798) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:18:24.061838 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-1151d4e0-d026-4a9f-b006-e3f47b7284d7 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:18:24.062331 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-1151d4e0-d026-4a9f-b006-e3f47b7284d7 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:18:24.062763 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-1151d4e0-d026-4a9f-b006-e3f47b7284d7 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:18:24.063538 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-1151d4e0-d026-4a9f-b006-e3f47b7284d7 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:18:24.063998 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-1151d4e0-d026-4a9f-b006-e3f47b7284d7 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:18:24.064421 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-1151d4e0-d026-4a9f-b006-e3f47b7284d7 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:18:24.079256 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.wsgi [None req-1151d4e0-d026-4a9f-b006-e3f47b7284d7 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] HTTP exception thrown: Instance 18882ea3-d64e-4894-b42d-9769383c4668 could not be found. Aug 23 07:18:24.081095 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-1151d4e0-d026-4a9f-b006-e3f47b7284d7 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Request method failure captured: Aug 23 07:18:24.081095 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: request: GET /compute/v2.1/servers/18882ea3-d64e-4894-b42d-9769383c4668 HTTP/1.1 Aug 23 07:18:24.081095 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: Accept: application/json Aug 23 07:18:24.081095 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: Accept-Encoding: identity Aug 23 07:18:24.081095 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: Connection: close Aug 23 07:18:24.081095 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: Content-Length: 0 Aug 23 07:18:24.081095 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: Content-Type: application/json Aug 23 07:18:24.081095 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: Host: 10.222.0.17 Aug 23 07:18:24.081095 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: Openstack-System-Scope: None Aug 23 07:18:24.081095 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: User-Agent: python-urllib3/1.26.11 Aug 23 07:18:24.081095 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-Auth-Token: gAAAAABjBH3ZHMVVLXoXwNDfQQNusO5G5GN02PnHIiEEKbUNElvY7Grlo8u229xKVdQ1mmEwia_EWu2jEutb1fyYPOf6jNbBH41b4mzr6zipvsQ6BtbbjaOUpVuAli-fuxu6YJZFtXM3RMEYq-CLnj1C8WH54zH3cmVnSq_F2KlyAaedAUE420Q Aug 23 07:18:24.081095 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-Domain-Id: None Aug 23 07:18:24.081095 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-Domain-Name: None Aug 23 07:18:24.081095 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-Identity-Status: Confirmed Aug 23 07:18:24.081095 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-Is-Admin-Project: True Aug 23 07:18:24.081095 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-Project-Domain-Id: default Aug 23 07:18:24.081095 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-Project-Domain-Name: Default Aug 23 07:18:24.081095 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-Project-Id: eb44f62fa62e46528712f24479cbb19f Aug 23 07:18:24.081095 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-Project-Name: tempest-AttachVolumeNegativeTest-880454297 Aug 23 07:18:24.081095 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-Role: reader,member Aug 23 07:18:24.081095 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-Roles: reader,member Aug 23 07:18:24.082479 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/eb44f62fa62e46528712f24479cbb19f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/eb44f62fa62e46528712f24479cbb19f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_eb44f62fa62e46528712f24479cbb19f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/eb44f62fa62e46528712f24479cbb19f"}]}] Aug 23 07:18:24.082479 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-Tenant: tempest-AttachVolumeNegativeTest-880454297 Aug 23 07:18:24.082479 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-Tenant-Id: eb44f62fa62e46528712f24479cbb19f Aug 23 07:18:24.082479 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-880454297 Aug 23 07:18:24.082479 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-User: tempest-AttachVolumeNegativeTest-880454297-project Aug 23 07:18:24.082479 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-User-Domain-Id: default Aug 23 07:18:24.082479 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-User-Domain-Name: Default Aug 23 07:18:24.082479 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-User-Id: 471dc5c1db64411ab1d80ad6c038e519 Aug 23 07:18:24.082479 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-User-Name: tempest-AttachVolumeNegativeTest-880454297-project Aug 23 07:18:24.082479 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: method: > Aug 23 07:18:24.082479 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: exception: Instance 18882ea3-d64e-4894-b42d-9769383c4668 could not be found. Aug 23 07:18:24.082479 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: action_args: {'id': '18882ea3-d64e-4894-b42d-9769383c4668'} Aug 23 07:18:24.083302 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 07:18:24.083302 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 07:18:24.083302 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 07:18:24.083302 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 07:18:24.083302 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 07:18:24.083302 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 07:18:24.083302 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 07:18:24.083302 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 07:18:24.083302 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 07:18:24.083302 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 07:18:24.083302 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 18882ea3-d64e-4894-b42d-9769383c4668 could not be found. Aug 23 07:18:24.083302 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi Aug 23 07:18:24.083302 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 07:18:24.083302 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi Aug 23 07:18:24.083302 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 07:18:24.083302 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 07:18:24.083302 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 07:18:24.083302 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 07:18:24.083302 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 07:18:24.083302 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 07:18:24.084771 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 07:18:24.084771 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 07:18:24.084771 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 07:18:24.084771 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 07:18:24.084771 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 07:18:24.084771 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 07:18:24.084771 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 07:18:24.084771 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 18882ea3-d64e-4894-b42d-9769383c4668 could not be found. Aug 23 07:18:24.084771 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi Aug 23 07:18:24.084771 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 07:18:24.084771 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi Aug 23 07:18:24.084771 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 07:18:24.084771 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 07:18:24.084771 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 07:18:24.084771 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 07:18:24.084771 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 07:18:24.084771 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 18882ea3-d64e-4894-b42d-9769383c4668 could not be found. Aug 23 07:18:24.084771 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi Aug 23 07:18:24.086083 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-1151d4e0-d026-4a9f-b006-e3f47b7284d7 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Returning 404 to user: Instance 18882ea3-d64e-4894-b42d-9769383c4668 could not be found. {{(pid=120798) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 07:18:24.086083 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [None req-1151d4e0-d026-4a9f-b006-e3f47b7284d7 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] 10.222.0.17 "GET /compute/v2.1/servers/18882ea3-d64e-4894-b42d-9769383c4668" status: 404 len: 111 microversion: 2.1 time: 0.032231 Aug 23 07:18:24.086083 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 312/645] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:18:24 2022] GET /compute/v2.1/servers/18882ea3-d64e-4894-b42d-9769383c4668 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 07:18:24.093048 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-cdef22e4-eb16-462f-b13e-c2f868481a5c tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Calling method '.version_select at 0x7fe3c56e5b80>' {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:18:24.114755 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-cdef22e4-eb16-462f-b13e-c2f868481a5c tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1587992826" status: 202 len: 0 microversion: 2.1 time: 0.026019 Aug 23 07:18:24.115342 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 334/646] 10.222.0.17 () {58 vars in 1221 bytes} [Tue Aug 23 07:18:24 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1587992826 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 07:18:25.883021 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-87b16f3d-62e0-45fb-844c-f901fc4c26a2 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Calling method '>' {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:18:25.883585 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.compute.api [None req-87b16f3d-62e0-45fb-844c-f901fc4c26a2 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] [instance: 18882ea3-d64e-4894-b42d-9769383c4668] Fetching instance by UUID {{(pid=120798) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:18:25.890417 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-87b16f3d-62e0-45fb-844c-f901fc4c26a2 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:18:25.890891 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-87b16f3d-62e0-45fb-844c-f901fc4c26a2 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:18:25.891319 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-87b16f3d-62e0-45fb-844c-f901fc4c26a2 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:18:25.892055 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-87b16f3d-62e0-45fb-844c-f901fc4c26a2 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:18:25.892504 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-87b16f3d-62e0-45fb-844c-f901fc4c26a2 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:18:25.892927 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-87b16f3d-62e0-45fb-844c-f901fc4c26a2 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:18:25.895679 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG dbcounter [-] [120798] Writing DB stats nova_cell1:SELECT=87,nova_cell1:INSERT=1 {{(pid=120798) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:18:25.911162 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.wsgi [None req-87b16f3d-62e0-45fb-844c-f901fc4c26a2 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] HTTP exception thrown: Instance 18882ea3-d64e-4894-b42d-9769383c4668 could not be found. Aug 23 07:18:25.912758 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-87b16f3d-62e0-45fb-844c-f901fc4c26a2 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Request method failure captured: Aug 23 07:18:25.912758 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: request: DELETE /compute/v2.1/servers/18882ea3-d64e-4894-b42d-9769383c4668 HTTP/1.1 Aug 23 07:18:25.912758 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: Accept: application/json Aug 23 07:18:25.912758 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: Accept-Encoding: identity Aug 23 07:18:25.912758 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: Connection: close Aug 23 07:18:25.912758 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: Content-Length: 0 Aug 23 07:18:25.912758 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: Content-Type: application/json Aug 23 07:18:25.912758 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: Host: 10.222.0.17 Aug 23 07:18:25.912758 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: Openstack-System-Scope: None Aug 23 07:18:25.912758 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: User-Agent: python-urllib3/1.26.11 Aug 23 07:18:25.912758 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-Auth-Token: gAAAAABjBH3ZHMVVLXoXwNDfQQNusO5G5GN02PnHIiEEKbUNElvY7Grlo8u229xKVdQ1mmEwia_EWu2jEutb1fyYPOf6jNbBH41b4mzr6zipvsQ6BtbbjaOUpVuAli-fuxu6YJZFtXM3RMEYq-CLnj1C8WH54zH3cmVnSq_F2KlyAaedAUE420Q Aug 23 07:18:25.912758 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-Domain-Id: None Aug 23 07:18:25.912758 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-Domain-Name: None Aug 23 07:18:25.912758 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-Identity-Status: Confirmed Aug 23 07:18:25.912758 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-Is-Admin-Project: True Aug 23 07:18:25.912758 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-Project-Domain-Id: default Aug 23 07:18:25.912758 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-Project-Domain-Name: Default Aug 23 07:18:25.912758 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-Project-Id: eb44f62fa62e46528712f24479cbb19f Aug 23 07:18:25.912758 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-Project-Name: tempest-AttachVolumeNegativeTest-880454297 Aug 23 07:18:25.912758 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-Role: reader,member Aug 23 07:18:25.912758 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-Roles: reader,member Aug 23 07:18:25.914135 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/eb44f62fa62e46528712f24479cbb19f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/eb44f62fa62e46528712f24479cbb19f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_eb44f62fa62e46528712f24479cbb19f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/eb44f62fa62e46528712f24479cbb19f"}]}] Aug 23 07:18:25.914135 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-Tenant: tempest-AttachVolumeNegativeTest-880454297 Aug 23 07:18:25.914135 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-Tenant-Id: eb44f62fa62e46528712f24479cbb19f Aug 23 07:18:25.914135 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-880454297 Aug 23 07:18:25.914135 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-User: tempest-AttachVolumeNegativeTest-880454297-project Aug 23 07:18:25.914135 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-User-Domain-Id: default Aug 23 07:18:25.914135 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-User-Domain-Name: Default Aug 23 07:18:25.914135 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-User-Id: 471dc5c1db64411ab1d80ad6c038e519 Aug 23 07:18:25.914135 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-User-Name: tempest-AttachVolumeNegativeTest-880454297-project Aug 23 07:18:25.914135 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: method: > Aug 23 07:18:25.914135 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: exception: Instance 18882ea3-d64e-4894-b42d-9769383c4668 could not be found. Aug 23 07:18:25.914135 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: action_args: {'id': '18882ea3-d64e-4894-b42d-9769383c4668'} Aug 23 07:18:25.915462 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 07:18:25.915462 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 07:18:25.915462 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 07:18:25.915462 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 07:18:25.915462 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 07:18:25.915462 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 07:18:25.915462 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 07:18:25.915462 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 07:18:25.915462 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 07:18:25.915462 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 07:18:25.915462 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 18882ea3-d64e-4894-b42d-9769383c4668 could not be found. Aug 23 07:18:25.915462 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi Aug 23 07:18:25.915462 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 07:18:25.915462 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi Aug 23 07:18:25.915462 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 07:18:25.915462 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 07:18:25.915462 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 07:18:25.915462 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 07:18:25.915462 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 07:18:25.915462 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 07:18:25.916656 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 07:18:25.916656 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 23 07:18:25.916656 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 23 07:18:25.916656 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 23 07:18:25.916656 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 23 07:18:25.916656 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 07:18:25.916656 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 07:18:25.916656 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 07:18:25.916656 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 07:18:25.916656 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 18882ea3-d64e-4894-b42d-9769383c4668 could not be found. Aug 23 07:18:25.916656 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi Aug 23 07:18:25.916656 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 07:18:25.916656 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi Aug 23 07:18:25.916656 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 07:18:25.916656 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 07:18:25.916656 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 07:18:25.916656 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 07:18:25.916656 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 07:18:25.916656 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 18882ea3-d64e-4894-b42d-9769383c4668 could not be found. Aug 23 07:18:25.916656 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi Aug 23 07:18:25.917830 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-87b16f3d-62e0-45fb-844c-f901fc4c26a2 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Returning 404 to user: Instance 18882ea3-d64e-4894-b42d-9769383c4668 could not be found. {{(pid=120798) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 07:18:25.917830 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [None req-87b16f3d-62e0-45fb-844c-f901fc4c26a2 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] 10.222.0.17 "DELETE /compute/v2.1/servers/18882ea3-d64e-4894-b42d-9769383c4668" status: 404 len: 111 microversion: 2.1 time: 0.035107 Aug 23 07:18:25.917830 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 313/647] 10.222.0.17 () {58 vars in 1239 bytes} [Tue Aug 23 07:18:25 2022] DELETE /compute/v2.1/servers/18882ea3-d64e-4894-b42d-9769383c4668 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 07:18:25.923951 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-e487c825-71e8-4bab-bf5f-45c318a1f144 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Calling method '>' {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:18:25.924681 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.compute.api [None req-e487c825-71e8-4bab-bf5f-45c318a1f144 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] [instance: 18882ea3-d64e-4894-b42d-9769383c4668] Fetching instance by UUID {{(pid=120799) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:18:25.931792 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-e487c825-71e8-4bab-bf5f-45c318a1f144 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:18:25.932270 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-e487c825-71e8-4bab-bf5f-45c318a1f144 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:18:25.932701 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-e487c825-71e8-4bab-bf5f-45c318a1f144 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:18:25.933384 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-e487c825-71e8-4bab-bf5f-45c318a1f144 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:18:25.933847 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-e487c825-71e8-4bab-bf5f-45c318a1f144 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:18:25.934278 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-e487c825-71e8-4bab-bf5f-45c318a1f144 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:18:25.952328 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.wsgi [None req-e487c825-71e8-4bab-bf5f-45c318a1f144 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] HTTP exception thrown: Instance 18882ea3-d64e-4894-b42d-9769383c4668 could not be found. Aug 23 07:18:25.954113 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-e487c825-71e8-4bab-bf5f-45c318a1f144 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Request method failure captured: Aug 23 07:18:25.954113 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: request: GET /compute/v2.1/servers/18882ea3-d64e-4894-b42d-9769383c4668 HTTP/1.1 Aug 23 07:18:25.954113 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: Accept: application/json Aug 23 07:18:25.954113 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: Accept-Encoding: identity Aug 23 07:18:25.954113 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: Connection: close Aug 23 07:18:25.954113 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: Content-Length: 0 Aug 23 07:18:25.954113 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: Content-Type: application/json Aug 23 07:18:25.954113 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: Host: 10.222.0.17 Aug 23 07:18:25.954113 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: Openstack-System-Scope: None Aug 23 07:18:25.954113 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: User-Agent: python-urllib3/1.26.11 Aug 23 07:18:25.954113 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-Auth-Token: gAAAAABjBH3ZHMVVLXoXwNDfQQNusO5G5GN02PnHIiEEKbUNElvY7Grlo8u229xKVdQ1mmEwia_EWu2jEutb1fyYPOf6jNbBH41b4mzr6zipvsQ6BtbbjaOUpVuAli-fuxu6YJZFtXM3RMEYq-CLnj1C8WH54zH3cmVnSq_F2KlyAaedAUE420Q Aug 23 07:18:25.954113 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-Domain-Id: None Aug 23 07:18:25.954113 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-Domain-Name: None Aug 23 07:18:25.954113 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-Identity-Status: Confirmed Aug 23 07:18:25.954113 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-Is-Admin-Project: True Aug 23 07:18:25.954113 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-Project-Domain-Id: default Aug 23 07:18:25.954113 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-Project-Domain-Name: Default Aug 23 07:18:25.954113 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-Project-Id: eb44f62fa62e46528712f24479cbb19f Aug 23 07:18:25.954113 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-Project-Name: tempest-AttachVolumeNegativeTest-880454297 Aug 23 07:18:25.954113 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-Role: reader,member Aug 23 07:18:25.954113 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-Roles: reader,member Aug 23 07:18:25.955615 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/eb44f62fa62e46528712f24479cbb19f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/eb44f62fa62e46528712f24479cbb19f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_eb44f62fa62e46528712f24479cbb19f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/eb44f62fa62e46528712f24479cbb19f"}]}] Aug 23 07:18:25.955615 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-Tenant: tempest-AttachVolumeNegativeTest-880454297 Aug 23 07:18:25.955615 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-Tenant-Id: eb44f62fa62e46528712f24479cbb19f Aug 23 07:18:25.955615 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-880454297 Aug 23 07:18:25.955615 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-User: tempest-AttachVolumeNegativeTest-880454297-project Aug 23 07:18:25.955615 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-User-Domain-Id: default Aug 23 07:18:25.955615 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-User-Domain-Name: Default Aug 23 07:18:25.955615 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-User-Id: 471dc5c1db64411ab1d80ad6c038e519 Aug 23 07:18:25.955615 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-User-Name: tempest-AttachVolumeNegativeTest-880454297-project Aug 23 07:18:25.955615 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: method: > Aug 23 07:18:25.955615 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: exception: Instance 18882ea3-d64e-4894-b42d-9769383c4668 could not be found. Aug 23 07:18:25.955615 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: action_args: {'id': '18882ea3-d64e-4894-b42d-9769383c4668'} Aug 23 07:18:25.956427 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 07:18:25.956427 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 07:18:25.956427 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 07:18:25.956427 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 07:18:25.956427 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 07:18:25.956427 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 07:18:25.956427 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 07:18:25.956427 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 07:18:25.956427 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 07:18:25.956427 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 07:18:25.956427 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 18882ea3-d64e-4894-b42d-9769383c4668 could not be found. Aug 23 07:18:25.956427 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi Aug 23 07:18:25.956427 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 07:18:25.956427 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi Aug 23 07:18:25.956427 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 07:18:25.956427 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 07:18:25.956427 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 07:18:25.956427 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 07:18:25.956427 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 07:18:25.956427 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 07:18:25.957564 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 07:18:25.957564 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 07:18:25.957564 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 07:18:25.957564 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 07:18:25.957564 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 07:18:25.957564 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 07:18:25.957564 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 07:18:25.957564 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 18882ea3-d64e-4894-b42d-9769383c4668 could not be found. Aug 23 07:18:25.957564 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi Aug 23 07:18:25.957564 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 07:18:25.957564 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi Aug 23 07:18:25.957564 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 07:18:25.957564 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 07:18:25.957564 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 07:18:25.957564 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 07:18:25.957564 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 07:18:25.957564 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 18882ea3-d64e-4894-b42d-9769383c4668 could not be found. Aug 23 07:18:25.957564 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi Aug 23 07:18:25.958689 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-e487c825-71e8-4bab-bf5f-45c318a1f144 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Returning 404 to user: Instance 18882ea3-d64e-4894-b42d-9769383c4668 could not be found. {{(pid=120799) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 07:18:25.958689 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-e487c825-71e8-4bab-bf5f-45c318a1f144 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] 10.222.0.17 "GET /compute/v2.1/servers/18882ea3-d64e-4894-b42d-9769383c4668" status: 404 len: 111 microversion: 2.1 time: 0.036556 Aug 23 07:18:25.958689 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 335/648] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:18:25 2022] GET /compute/v2.1/servers/18882ea3-d64e-4894-b42d-9769383c4668 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 07:18:27.123376 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-d610b2af-ffc9-42d9-af20-9598a9800e18 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Calling method '>' {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:18:27.123907 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.compute.api [None req-d610b2af-ffc9-42d9-af20-9598a9800e18 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] [instance: 2276f5b3-e71c-42f5-b540-5535a8aa1d48] Fetching instance by UUID {{(pid=120798) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:18:27.130390 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-d610b2af-ffc9-42d9-af20-9598a9800e18 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:18:27.130924 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-d610b2af-ffc9-42d9-af20-9598a9800e18 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:18:27.131355 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-d610b2af-ffc9-42d9-af20-9598a9800e18 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:18:27.132054 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-d610b2af-ffc9-42d9-af20-9598a9800e18 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:18:27.132527 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-d610b2af-ffc9-42d9-af20-9598a9800e18 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:18:27.132949 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-d610b2af-ffc9-42d9-af20-9598a9800e18 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:18:27.146746 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.wsgi [None req-d610b2af-ffc9-42d9-af20-9598a9800e18 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] HTTP exception thrown: Instance 2276f5b3-e71c-42f5-b540-5535a8aa1d48 could not be found. Aug 23 07:18:27.148426 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-d610b2af-ffc9-42d9-af20-9598a9800e18 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Request method failure captured: Aug 23 07:18:27.148426 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: request: DELETE /compute/v2.1/servers/2276f5b3-e71c-42f5-b540-5535a8aa1d48 HTTP/1.1 Aug 23 07:18:27.148426 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: Accept: application/json Aug 23 07:18:27.148426 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: Accept-Encoding: identity Aug 23 07:18:27.148426 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: Connection: close Aug 23 07:18:27.148426 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: Content-Length: 0 Aug 23 07:18:27.148426 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: Content-Type: application/json Aug 23 07:18:27.148426 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: Host: 10.222.0.17 Aug 23 07:18:27.148426 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: Openstack-System-Scope: None Aug 23 07:18:27.148426 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: User-Agent: python-urllib3/1.26.11 Aug 23 07:18:27.148426 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-Auth-Token: gAAAAABjBH3ZHMVVLXoXwNDfQQNusO5G5GN02PnHIiEEKbUNElvY7Grlo8u229xKVdQ1mmEwia_EWu2jEutb1fyYPOf6jNbBH41b4mzr6zipvsQ6BtbbjaOUpVuAli-fuxu6YJZFtXM3RMEYq-CLnj1C8WH54zH3cmVnSq_F2KlyAaedAUE420Q Aug 23 07:18:27.148426 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-Domain-Id: None Aug 23 07:18:27.148426 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-Domain-Name: None Aug 23 07:18:27.148426 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-Identity-Status: Confirmed Aug 23 07:18:27.148426 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-Is-Admin-Project: True Aug 23 07:18:27.148426 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-Project-Domain-Id: default Aug 23 07:18:27.148426 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-Project-Domain-Name: Default Aug 23 07:18:27.148426 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-Project-Id: eb44f62fa62e46528712f24479cbb19f Aug 23 07:18:27.148426 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-Project-Name: tempest-AttachVolumeNegativeTest-880454297 Aug 23 07:18:27.148426 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-Role: reader,member Aug 23 07:18:27.148426 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-Roles: reader,member Aug 23 07:18:27.149919 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/eb44f62fa62e46528712f24479cbb19f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/eb44f62fa62e46528712f24479cbb19f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_eb44f62fa62e46528712f24479cbb19f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/eb44f62fa62e46528712f24479cbb19f"}]}] Aug 23 07:18:27.149919 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-Tenant: tempest-AttachVolumeNegativeTest-880454297 Aug 23 07:18:27.149919 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-Tenant-Id: eb44f62fa62e46528712f24479cbb19f Aug 23 07:18:27.149919 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-880454297 Aug 23 07:18:27.149919 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-User: tempest-AttachVolumeNegativeTest-880454297-project Aug 23 07:18:27.149919 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-User-Domain-Id: default Aug 23 07:18:27.149919 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-User-Domain-Name: Default Aug 23 07:18:27.149919 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-User-Id: 471dc5c1db64411ab1d80ad6c038e519 Aug 23 07:18:27.149919 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-User-Name: tempest-AttachVolumeNegativeTest-880454297-project Aug 23 07:18:27.149919 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: method: > Aug 23 07:18:27.149919 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: exception: Instance 2276f5b3-e71c-42f5-b540-5535a8aa1d48 could not be found. Aug 23 07:18:27.149919 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: action_args: {'id': '2276f5b3-e71c-42f5-b540-5535a8aa1d48'} Aug 23 07:18:27.150715 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 07:18:27.150715 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 07:18:27.150715 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 07:18:27.150715 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 07:18:27.150715 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 07:18:27.150715 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 07:18:27.150715 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 07:18:27.150715 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 07:18:27.150715 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 07:18:27.150715 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 07:18:27.150715 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2276f5b3-e71c-42f5-b540-5535a8aa1d48 could not be found. Aug 23 07:18:27.150715 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi Aug 23 07:18:27.150715 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 07:18:27.150715 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi Aug 23 07:18:27.150715 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 07:18:27.150715 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 07:18:27.150715 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 07:18:27.150715 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 07:18:27.150715 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 07:18:27.150715 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 07:18:27.152505 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 07:18:27.152505 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 23 07:18:27.152505 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 23 07:18:27.152505 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 23 07:18:27.152505 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 23 07:18:27.152505 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 07:18:27.152505 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 07:18:27.152505 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 07:18:27.152505 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 07:18:27.152505 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2276f5b3-e71c-42f5-b540-5535a8aa1d48 could not be found. Aug 23 07:18:27.152505 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi Aug 23 07:18:27.152505 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 07:18:27.152505 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi Aug 23 07:18:27.152505 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 07:18:27.152505 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 07:18:27.152505 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 07:18:27.152505 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 07:18:27.152505 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 07:18:27.152505 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2276f5b3-e71c-42f5-b540-5535a8aa1d48 could not be found. Aug 23 07:18:27.152505 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi Aug 23 07:18:27.154334 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-d610b2af-ffc9-42d9-af20-9598a9800e18 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Returning 404 to user: Instance 2276f5b3-e71c-42f5-b540-5535a8aa1d48 could not be found. {{(pid=120798) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 07:18:27.154334 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [None req-d610b2af-ffc9-42d9-af20-9598a9800e18 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] 10.222.0.17 "DELETE /compute/v2.1/servers/2276f5b3-e71c-42f5-b540-5535a8aa1d48" status: 404 len: 111 microversion: 2.1 time: 0.030448 Aug 23 07:18:27.154334 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 314/649] 10.222.0.17 () {58 vars in 1239 bytes} [Tue Aug 23 07:18:27 2022] DELETE /compute/v2.1/servers/2276f5b3-e71c-42f5-b540-5535a8aa1d48 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 07:18:27.158365 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-9d4e9b62-dda0-434f-ac77-c66664893ff5 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Calling method '>' {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:18:27.158970 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.compute.api [None req-9d4e9b62-dda0-434f-ac77-c66664893ff5 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] [instance: 2276f5b3-e71c-42f5-b540-5535a8aa1d48] Fetching instance by UUID {{(pid=120799) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:18:27.165495 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-9d4e9b62-dda0-434f-ac77-c66664893ff5 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:18:27.165970 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-9d4e9b62-dda0-434f-ac77-c66664893ff5 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:18:27.166395 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-9d4e9b62-dda0-434f-ac77-c66664893ff5 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:18:27.167074 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-9d4e9b62-dda0-434f-ac77-c66664893ff5 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:18:27.167551 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-9d4e9b62-dda0-434f-ac77-c66664893ff5 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:18:27.167968 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-9d4e9b62-dda0-434f-ac77-c66664893ff5 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:18:27.181848 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.wsgi [None req-9d4e9b62-dda0-434f-ac77-c66664893ff5 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] HTTP exception thrown: Instance 2276f5b3-e71c-42f5-b540-5535a8aa1d48 could not be found. Aug 23 07:18:27.183383 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-9d4e9b62-dda0-434f-ac77-c66664893ff5 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Request method failure captured: Aug 23 07:18:27.183383 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: request: GET /compute/v2.1/servers/2276f5b3-e71c-42f5-b540-5535a8aa1d48 HTTP/1.1 Aug 23 07:18:27.183383 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: Accept: application/json Aug 23 07:18:27.183383 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: Accept-Encoding: identity Aug 23 07:18:27.183383 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: Connection: close Aug 23 07:18:27.183383 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: Content-Length: 0 Aug 23 07:18:27.183383 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: Content-Type: application/json Aug 23 07:18:27.183383 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: Host: 10.222.0.17 Aug 23 07:18:27.183383 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: Openstack-System-Scope: None Aug 23 07:18:27.183383 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: User-Agent: python-urllib3/1.26.11 Aug 23 07:18:27.183383 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-Auth-Token: gAAAAABjBH3ZHMVVLXoXwNDfQQNusO5G5GN02PnHIiEEKbUNElvY7Grlo8u229xKVdQ1mmEwia_EWu2jEutb1fyYPOf6jNbBH41b4mzr6zipvsQ6BtbbjaOUpVuAli-fuxu6YJZFtXM3RMEYq-CLnj1C8WH54zH3cmVnSq_F2KlyAaedAUE420Q Aug 23 07:18:27.183383 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-Domain-Id: None Aug 23 07:18:27.183383 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-Domain-Name: None Aug 23 07:18:27.183383 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-Identity-Status: Confirmed Aug 23 07:18:27.183383 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-Is-Admin-Project: True Aug 23 07:18:27.183383 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-Project-Domain-Id: default Aug 23 07:18:27.183383 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-Project-Domain-Name: Default Aug 23 07:18:27.183383 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-Project-Id: eb44f62fa62e46528712f24479cbb19f Aug 23 07:18:27.183383 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-Project-Name: tempest-AttachVolumeNegativeTest-880454297 Aug 23 07:18:27.183383 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-Role: reader,member Aug 23 07:18:27.183383 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-Roles: reader,member Aug 23 07:18:27.185519 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/eb44f62fa62e46528712f24479cbb19f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/eb44f62fa62e46528712f24479cbb19f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_eb44f62fa62e46528712f24479cbb19f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/eb44f62fa62e46528712f24479cbb19f"}]}] Aug 23 07:18:27.185519 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-Tenant: tempest-AttachVolumeNegativeTest-880454297 Aug 23 07:18:27.185519 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-Tenant-Id: eb44f62fa62e46528712f24479cbb19f Aug 23 07:18:27.185519 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-880454297 Aug 23 07:18:27.185519 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-User: tempest-AttachVolumeNegativeTest-880454297-project Aug 23 07:18:27.185519 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-User-Domain-Id: default Aug 23 07:18:27.185519 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-User-Domain-Name: Default Aug 23 07:18:27.185519 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-User-Id: 471dc5c1db64411ab1d80ad6c038e519 Aug 23 07:18:27.185519 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-User-Name: tempest-AttachVolumeNegativeTest-880454297-project Aug 23 07:18:27.185519 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: method: > Aug 23 07:18:27.185519 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: exception: Instance 2276f5b3-e71c-42f5-b540-5535a8aa1d48 could not be found. Aug 23 07:18:27.185519 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: action_args: {'id': '2276f5b3-e71c-42f5-b540-5535a8aa1d48'} Aug 23 07:18:27.186728 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 07:18:27.186728 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 07:18:27.186728 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 07:18:27.186728 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 07:18:27.186728 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 07:18:27.186728 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 07:18:27.186728 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 07:18:27.186728 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 07:18:27.186728 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 07:18:27.186728 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 07:18:27.186728 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2276f5b3-e71c-42f5-b540-5535a8aa1d48 could not be found. Aug 23 07:18:27.186728 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi Aug 23 07:18:27.186728 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 07:18:27.186728 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi Aug 23 07:18:27.186728 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 07:18:27.186728 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 07:18:27.186728 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 07:18:27.186728 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 07:18:27.186728 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 07:18:27.186728 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 07:18:27.188580 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 07:18:27.188580 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 07:18:27.188580 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 07:18:27.188580 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 07:18:27.188580 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 07:18:27.188580 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 07:18:27.188580 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 07:18:27.188580 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2276f5b3-e71c-42f5-b540-5535a8aa1d48 could not be found. Aug 23 07:18:27.188580 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi Aug 23 07:18:27.188580 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 07:18:27.188580 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi Aug 23 07:18:27.188580 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 07:18:27.188580 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 07:18:27.188580 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 07:18:27.188580 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 07:18:27.188580 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 07:18:27.188580 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2276f5b3-e71c-42f5-b540-5535a8aa1d48 could not be found. Aug 23 07:18:27.188580 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi Aug 23 07:18:27.196714 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-9d4e9b62-dda0-434f-ac77-c66664893ff5 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Returning 404 to user: Instance 2276f5b3-e71c-42f5-b540-5535a8aa1d48 could not be found. {{(pid=120799) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 07:18:27.196714 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-9d4e9b62-dda0-434f-ac77-c66664893ff5 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] 10.222.0.17 "GET /compute/v2.1/servers/2276f5b3-e71c-42f5-b540-5535a8aa1d48" status: 404 len: 111 microversion: 2.1 time: 0.030237 Aug 23 07:18:27.196714 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 336/650] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:18:27 2022] GET /compute/v2.1/servers/2276f5b3-e71c-42f5-b540-5535a8aa1d48 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 07:18:27.196965 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-c45caf10-1f06-43ff-af70-d26e819cbfc5 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Calling method '>' {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:18:27.196965 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.compute.api [None req-c45caf10-1f06-43ff-af70-d26e819cbfc5 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] [instance: ce9a9c42-b9ed-40b1-b72c-390b85578204] Fetching instance by UUID {{(pid=120798) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:18:27.202526 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-c45caf10-1f06-43ff-af70-d26e819cbfc5 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:18:27.202995 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-c45caf10-1f06-43ff-af70-d26e819cbfc5 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:18:27.203431 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-c45caf10-1f06-43ff-af70-d26e819cbfc5 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:18:27.204134 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-c45caf10-1f06-43ff-af70-d26e819cbfc5 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:18:27.204572 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-c45caf10-1f06-43ff-af70-d26e819cbfc5 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:18:27.204982 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-c45caf10-1f06-43ff-af70-d26e819cbfc5 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:18:27.218743 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.wsgi [None req-c45caf10-1f06-43ff-af70-d26e819cbfc5 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] HTTP exception thrown: Instance ce9a9c42-b9ed-40b1-b72c-390b85578204 could not be found. Aug 23 07:18:27.220312 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-c45caf10-1f06-43ff-af70-d26e819cbfc5 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Request method failure captured: Aug 23 07:18:27.220312 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: request: DELETE /compute/v2.1/servers/ce9a9c42-b9ed-40b1-b72c-390b85578204 HTTP/1.1 Aug 23 07:18:27.220312 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: Accept: application/json Aug 23 07:18:27.220312 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: Accept-Encoding: identity Aug 23 07:18:27.220312 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: Connection: close Aug 23 07:18:27.220312 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: Content-Length: 0 Aug 23 07:18:27.220312 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: Content-Type: application/json Aug 23 07:18:27.220312 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: Host: 10.222.0.17 Aug 23 07:18:27.220312 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: Openstack-System-Scope: None Aug 23 07:18:27.220312 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: User-Agent: python-urllib3/1.26.11 Aug 23 07:18:27.220312 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-Auth-Token: gAAAAABjBH3ZHMVVLXoXwNDfQQNusO5G5GN02PnHIiEEKbUNElvY7Grlo8u229xKVdQ1mmEwia_EWu2jEutb1fyYPOf6jNbBH41b4mzr6zipvsQ6BtbbjaOUpVuAli-fuxu6YJZFtXM3RMEYq-CLnj1C8WH54zH3cmVnSq_F2KlyAaedAUE420Q Aug 23 07:18:27.220312 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-Domain-Id: None Aug 23 07:18:27.220312 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-Domain-Name: None Aug 23 07:18:27.220312 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-Identity-Status: Confirmed Aug 23 07:18:27.220312 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-Is-Admin-Project: True Aug 23 07:18:27.220312 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-Project-Domain-Id: default Aug 23 07:18:27.220312 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-Project-Domain-Name: Default Aug 23 07:18:27.220312 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-Project-Id: eb44f62fa62e46528712f24479cbb19f Aug 23 07:18:27.220312 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-Project-Name: tempest-AttachVolumeNegativeTest-880454297 Aug 23 07:18:27.220312 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-Role: reader,member Aug 23 07:18:27.220312 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-Roles: reader,member Aug 23 07:18:27.221869 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/eb44f62fa62e46528712f24479cbb19f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/eb44f62fa62e46528712f24479cbb19f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_eb44f62fa62e46528712f24479cbb19f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/eb44f62fa62e46528712f24479cbb19f"}]}] Aug 23 07:18:27.221869 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-Tenant: tempest-AttachVolumeNegativeTest-880454297 Aug 23 07:18:27.221869 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-Tenant-Id: eb44f62fa62e46528712f24479cbb19f Aug 23 07:18:27.221869 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-880454297 Aug 23 07:18:27.221869 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-User: tempest-AttachVolumeNegativeTest-880454297-project Aug 23 07:18:27.221869 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-User-Domain-Id: default Aug 23 07:18:27.221869 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-User-Domain-Name: Default Aug 23 07:18:27.221869 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-User-Id: 471dc5c1db64411ab1d80ad6c038e519 Aug 23 07:18:27.221869 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-User-Name: tempest-AttachVolumeNegativeTest-880454297-project Aug 23 07:18:27.221869 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: method: > Aug 23 07:18:27.221869 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: exception: Instance ce9a9c42-b9ed-40b1-b72c-390b85578204 could not be found. Aug 23 07:18:27.221869 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: action_args: {'id': 'ce9a9c42-b9ed-40b1-b72c-390b85578204'} Aug 23 07:18:27.222671 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 07:18:27.222671 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 07:18:27.222671 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 07:18:27.222671 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 07:18:27.222671 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 07:18:27.222671 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 07:18:27.222671 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 07:18:27.222671 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 07:18:27.222671 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 07:18:27.222671 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 07:18:27.222671 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ce9a9c42-b9ed-40b1-b72c-390b85578204 could not be found. Aug 23 07:18:27.222671 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi Aug 23 07:18:27.222671 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 07:18:27.222671 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi Aug 23 07:18:27.222671 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 07:18:27.222671 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 07:18:27.222671 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 07:18:27.222671 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 07:18:27.222671 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 07:18:27.222671 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 07:18:27.223904 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 07:18:27.223904 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 23 07:18:27.223904 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 23 07:18:27.223904 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 23 07:18:27.223904 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 23 07:18:27.223904 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 07:18:27.223904 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 07:18:27.223904 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 07:18:27.223904 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 07:18:27.223904 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ce9a9c42-b9ed-40b1-b72c-390b85578204 could not be found. Aug 23 07:18:27.223904 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi Aug 23 07:18:27.223904 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 07:18:27.223904 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi Aug 23 07:18:27.223904 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 07:18:27.223904 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 07:18:27.223904 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 07:18:27.223904 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 07:18:27.223904 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 07:18:27.223904 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ce9a9c42-b9ed-40b1-b72c-390b85578204 could not be found. Aug 23 07:18:27.223904 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi Aug 23 07:18:27.225062 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-c45caf10-1f06-43ff-af70-d26e819cbfc5 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Returning 404 to user: Instance ce9a9c42-b9ed-40b1-b72c-390b85578204 could not be found. {{(pid=120798) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 07:18:27.225062 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [None req-c45caf10-1f06-43ff-af70-d26e819cbfc5 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] 10.222.0.17 "DELETE /compute/v2.1/servers/ce9a9c42-b9ed-40b1-b72c-390b85578204" status: 404 len: 111 microversion: 2.1 time: 0.031752 Aug 23 07:18:27.225062 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 315/651] 10.222.0.17 () {58 vars in 1239 bytes} [Tue Aug 23 07:18:27 2022] DELETE /compute/v2.1/servers/ce9a9c42-b9ed-40b1-b72c-390b85578204 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 07:18:27.230482 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-c5a18bf7-c4c6-40cd-9c3d-4b86fa43bdc9 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Calling method '>' {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:18:27.231121 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.compute.api [None req-c5a18bf7-c4c6-40cd-9c3d-4b86fa43bdc9 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] [instance: ce9a9c42-b9ed-40b1-b72c-390b85578204] Fetching instance by UUID {{(pid=120799) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:18:27.237452 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-c5a18bf7-c4c6-40cd-9c3d-4b86fa43bdc9 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:18:27.237936 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-c5a18bf7-c4c6-40cd-9c3d-4b86fa43bdc9 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:18:27.238353 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-c5a18bf7-c4c6-40cd-9c3d-4b86fa43bdc9 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:18:27.239022 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-c5a18bf7-c4c6-40cd-9c3d-4b86fa43bdc9 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:18:27.239465 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-c5a18bf7-c4c6-40cd-9c3d-4b86fa43bdc9 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:18:27.239900 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-c5a18bf7-c4c6-40cd-9c3d-4b86fa43bdc9 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:18:27.253370 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.wsgi [None req-c5a18bf7-c4c6-40cd-9c3d-4b86fa43bdc9 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] HTTP exception thrown: Instance ce9a9c42-b9ed-40b1-b72c-390b85578204 could not be found. Aug 23 07:18:27.254862 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-c5a18bf7-c4c6-40cd-9c3d-4b86fa43bdc9 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Request method failure captured: Aug 23 07:18:27.254862 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: request: GET /compute/v2.1/servers/ce9a9c42-b9ed-40b1-b72c-390b85578204 HTTP/1.1 Aug 23 07:18:27.254862 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: Accept: application/json Aug 23 07:18:27.254862 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: Accept-Encoding: identity Aug 23 07:18:27.254862 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: Connection: close Aug 23 07:18:27.254862 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: Content-Length: 0 Aug 23 07:18:27.254862 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: Content-Type: application/json Aug 23 07:18:27.254862 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: Host: 10.222.0.17 Aug 23 07:18:27.254862 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: Openstack-System-Scope: None Aug 23 07:18:27.254862 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: User-Agent: python-urllib3/1.26.11 Aug 23 07:18:27.254862 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-Auth-Token: gAAAAABjBH3ZHMVVLXoXwNDfQQNusO5G5GN02PnHIiEEKbUNElvY7Grlo8u229xKVdQ1mmEwia_EWu2jEutb1fyYPOf6jNbBH41b4mzr6zipvsQ6BtbbjaOUpVuAli-fuxu6YJZFtXM3RMEYq-CLnj1C8WH54zH3cmVnSq_F2KlyAaedAUE420Q Aug 23 07:18:27.254862 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-Domain-Id: None Aug 23 07:18:27.254862 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-Domain-Name: None Aug 23 07:18:27.254862 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-Identity-Status: Confirmed Aug 23 07:18:27.254862 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-Is-Admin-Project: True Aug 23 07:18:27.254862 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-Project-Domain-Id: default Aug 23 07:18:27.254862 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-Project-Domain-Name: Default Aug 23 07:18:27.254862 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-Project-Id: eb44f62fa62e46528712f24479cbb19f Aug 23 07:18:27.254862 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-Project-Name: tempest-AttachVolumeNegativeTest-880454297 Aug 23 07:18:27.254862 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-Role: reader,member Aug 23 07:18:27.254862 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-Roles: reader,member Aug 23 07:18:27.256341 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/eb44f62fa62e46528712f24479cbb19f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/eb44f62fa62e46528712f24479cbb19f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_eb44f62fa62e46528712f24479cbb19f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/eb44f62fa62e46528712f24479cbb19f"}]}] Aug 23 07:18:27.256341 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-Tenant: tempest-AttachVolumeNegativeTest-880454297 Aug 23 07:18:27.256341 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-Tenant-Id: eb44f62fa62e46528712f24479cbb19f Aug 23 07:18:27.256341 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-880454297 Aug 23 07:18:27.256341 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-User: tempest-AttachVolumeNegativeTest-880454297-project Aug 23 07:18:27.256341 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-User-Domain-Id: default Aug 23 07:18:27.256341 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-User-Domain-Name: Default Aug 23 07:18:27.256341 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-User-Id: 471dc5c1db64411ab1d80ad6c038e519 Aug 23 07:18:27.256341 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-User-Name: tempest-AttachVolumeNegativeTest-880454297-project Aug 23 07:18:27.256341 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: method: > Aug 23 07:18:27.256341 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: exception: Instance ce9a9c42-b9ed-40b1-b72c-390b85578204 could not be found. Aug 23 07:18:27.256341 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: action_args: {'id': 'ce9a9c42-b9ed-40b1-b72c-390b85578204'} Aug 23 07:18:27.257174 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 07:18:27.257174 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 07:18:27.257174 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 07:18:27.257174 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 07:18:27.257174 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 07:18:27.257174 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 07:18:27.257174 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 07:18:27.257174 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 07:18:27.257174 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 07:18:27.257174 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 07:18:27.257174 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ce9a9c42-b9ed-40b1-b72c-390b85578204 could not be found. Aug 23 07:18:27.257174 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi Aug 23 07:18:27.257174 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 07:18:27.257174 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi Aug 23 07:18:27.257174 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 07:18:27.257174 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 07:18:27.257174 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 07:18:27.257174 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 07:18:27.257174 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 07:18:27.257174 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 07:18:27.258672 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 07:18:27.258672 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 07:18:27.258672 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 07:18:27.258672 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 07:18:27.258672 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 07:18:27.258672 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 07:18:27.258672 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 07:18:27.258672 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ce9a9c42-b9ed-40b1-b72c-390b85578204 could not be found. Aug 23 07:18:27.258672 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi Aug 23 07:18:27.258672 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 07:18:27.258672 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi Aug 23 07:18:27.258672 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 07:18:27.258672 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 07:18:27.258672 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 07:18:27.258672 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 07:18:27.258672 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 07:18:27.258672 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ce9a9c42-b9ed-40b1-b72c-390b85578204 could not be found. Aug 23 07:18:27.258672 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi Aug 23 07:18:27.260062 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-c5a18bf7-c4c6-40cd-9c3d-4b86fa43bdc9 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Returning 404 to user: Instance ce9a9c42-b9ed-40b1-b72c-390b85578204 could not be found. {{(pid=120799) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 07:18:27.260062 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-c5a18bf7-c4c6-40cd-9c3d-4b86fa43bdc9 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] 10.222.0.17 "GET /compute/v2.1/servers/ce9a9c42-b9ed-40b1-b72c-390b85578204" status: 404 len: 111 microversion: 2.1 time: 0.029587 Aug 23 07:18:27.260062 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 337/652] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:18:27 2022] GET /compute/v2.1/servers/ce9a9c42-b9ed-40b1-b72c-390b85578204 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 07:18:28.417768 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-2c3c447a-ded0-4a5d-bbfc-ae7b246b1f16 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Calling method '>' {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:18:28.419471 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.compute.api [None req-2c3c447a-ded0-4a5d-bbfc-ae7b246b1f16 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] [instance: 057628ba-a74f-426e-ba25-a3b79c3b6339] Fetching instance by UUID {{(pid=120798) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:18:28.430894 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-2c3c447a-ded0-4a5d-bbfc-ae7b246b1f16 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:18:28.432876 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-2c3c447a-ded0-4a5d-bbfc-ae7b246b1f16 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:18:28.433890 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-2c3c447a-ded0-4a5d-bbfc-ae7b246b1f16 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:18:28.435538 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-2c3c447a-ded0-4a5d-bbfc-ae7b246b1f16 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:18:28.436330 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-2c3c447a-ded0-4a5d-bbfc-ae7b246b1f16 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:18:28.437062 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-2c3c447a-ded0-4a5d-bbfc-ae7b246b1f16 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:18:28.452298 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.wsgi [None req-2c3c447a-ded0-4a5d-bbfc-ae7b246b1f16 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] HTTP exception thrown: Instance 057628ba-a74f-426e-ba25-a3b79c3b6339 could not be found. Aug 23 07:18:28.453901 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-2c3c447a-ded0-4a5d-bbfc-ae7b246b1f16 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Request method failure captured: Aug 23 07:18:28.453901 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: request: DELETE /compute/v2.1/servers/057628ba-a74f-426e-ba25-a3b79c3b6339 HTTP/1.1 Aug 23 07:18:28.453901 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: Accept: application/json Aug 23 07:18:28.453901 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: Accept-Encoding: identity Aug 23 07:18:28.453901 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: Connection: close Aug 23 07:18:28.453901 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: Content-Length: 0 Aug 23 07:18:28.453901 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: Content-Type: application/json Aug 23 07:18:28.453901 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: Host: 10.222.0.17 Aug 23 07:18:28.453901 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: Openstack-System-Scope: None Aug 23 07:18:28.453901 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: User-Agent: python-urllib3/1.26.11 Aug 23 07:18:28.453901 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-Auth-Token: gAAAAABjBH3ZHMVVLXoXwNDfQQNusO5G5GN02PnHIiEEKbUNElvY7Grlo8u229xKVdQ1mmEwia_EWu2jEutb1fyYPOf6jNbBH41b4mzr6zipvsQ6BtbbjaOUpVuAli-fuxu6YJZFtXM3RMEYq-CLnj1C8WH54zH3cmVnSq_F2KlyAaedAUE420Q Aug 23 07:18:28.453901 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-Domain-Id: None Aug 23 07:18:28.453901 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-Domain-Name: None Aug 23 07:18:28.453901 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-Identity-Status: Confirmed Aug 23 07:18:28.453901 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-Is-Admin-Project: True Aug 23 07:18:28.453901 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-Project-Domain-Id: default Aug 23 07:18:28.453901 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-Project-Domain-Name: Default Aug 23 07:18:28.453901 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-Project-Id: eb44f62fa62e46528712f24479cbb19f Aug 23 07:18:28.453901 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-Project-Name: tempest-AttachVolumeNegativeTest-880454297 Aug 23 07:18:28.453901 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-Role: reader,member Aug 23 07:18:28.453901 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-Roles: reader,member Aug 23 07:18:28.455469 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/eb44f62fa62e46528712f24479cbb19f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/eb44f62fa62e46528712f24479cbb19f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_eb44f62fa62e46528712f24479cbb19f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/eb44f62fa62e46528712f24479cbb19f"}]}] Aug 23 07:18:28.455469 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-Tenant: tempest-AttachVolumeNegativeTest-880454297 Aug 23 07:18:28.455469 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-Tenant-Id: eb44f62fa62e46528712f24479cbb19f Aug 23 07:18:28.455469 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-880454297 Aug 23 07:18:28.455469 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-User: tempest-AttachVolumeNegativeTest-880454297-project Aug 23 07:18:28.455469 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-User-Domain-Id: default Aug 23 07:18:28.455469 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-User-Domain-Name: Default Aug 23 07:18:28.455469 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-User-Id: 471dc5c1db64411ab1d80ad6c038e519 Aug 23 07:18:28.455469 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-User-Name: tempest-AttachVolumeNegativeTest-880454297-project Aug 23 07:18:28.455469 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: method: > Aug 23 07:18:28.455469 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: exception: Instance 057628ba-a74f-426e-ba25-a3b79c3b6339 could not be found. Aug 23 07:18:28.455469 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: action_args: {'id': '057628ba-a74f-426e-ba25-a3b79c3b6339'} Aug 23 07:18:28.456329 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 07:18:28.456329 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 07:18:28.456329 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 07:18:28.456329 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 07:18:28.456329 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 07:18:28.456329 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 07:18:28.456329 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 07:18:28.456329 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 07:18:28.456329 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 07:18:28.456329 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 07:18:28.456329 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 057628ba-a74f-426e-ba25-a3b79c3b6339 could not be found. Aug 23 07:18:28.456329 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi Aug 23 07:18:28.456329 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 07:18:28.456329 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi Aug 23 07:18:28.456329 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 07:18:28.456329 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 07:18:28.456329 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 07:18:28.456329 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 07:18:28.456329 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 07:18:28.456329 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 07:18:28.457490 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 07:18:28.457490 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 23 07:18:28.457490 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 23 07:18:28.457490 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 23 07:18:28.457490 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 23 07:18:28.457490 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 07:18:28.457490 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 07:18:28.457490 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 07:18:28.457490 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 07:18:28.457490 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 057628ba-a74f-426e-ba25-a3b79c3b6339 could not be found. Aug 23 07:18:28.457490 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi Aug 23 07:18:28.457490 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 07:18:28.457490 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi Aug 23 07:18:28.457490 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 07:18:28.457490 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 07:18:28.457490 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 07:18:28.457490 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 07:18:28.457490 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 07:18:28.457490 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 057628ba-a74f-426e-ba25-a3b79c3b6339 could not be found. Aug 23 07:18:28.457490 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi Aug 23 07:18:28.458661 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-2c3c447a-ded0-4a5d-bbfc-ae7b246b1f16 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Returning 404 to user: Instance 057628ba-a74f-426e-ba25-a3b79c3b6339 could not be found. {{(pid=120798) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 07:18:28.458661 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [None req-2c3c447a-ded0-4a5d-bbfc-ae7b246b1f16 tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] 10.222.0.17 "DELETE /compute/v2.1/servers/057628ba-a74f-426e-ba25-a3b79c3b6339" status: 404 len: 111 microversion: 2.1 time: 0.046015 Aug 23 07:18:28.458661 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 316/653] 10.222.0.17 () {58 vars in 1239 bytes} [Tue Aug 23 07:18:28 2022] DELETE /compute/v2.1/servers/057628ba-a74f-426e-ba25-a3b79c3b6339 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 07:18:28.467327 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-88176394-3a24-4de1-9921-5ab75e840c0d tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Calling method '>' {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:18:28.468066 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.compute.api [None req-88176394-3a24-4de1-9921-5ab75e840c0d tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] [instance: 057628ba-a74f-426e-ba25-a3b79c3b6339] Fetching instance by UUID {{(pid=120799) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:18:28.477759 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-88176394-3a24-4de1-9921-5ab75e840c0d tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:18:28.478438 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-88176394-3a24-4de1-9921-5ab75e840c0d tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:18:28.479055 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-88176394-3a24-4de1-9921-5ab75e840c0d tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:18:28.480094 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-88176394-3a24-4de1-9921-5ab75e840c0d tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:18:28.480723 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-88176394-3a24-4de1-9921-5ab75e840c0d tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:18:28.481315 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-88176394-3a24-4de1-9921-5ab75e840c0d tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:18:28.496032 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.wsgi [None req-88176394-3a24-4de1-9921-5ab75e840c0d tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] HTTP exception thrown: Instance 057628ba-a74f-426e-ba25-a3b79c3b6339 could not be found. Aug 23 07:18:28.497543 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-88176394-3a24-4de1-9921-5ab75e840c0d tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Request method failure captured: Aug 23 07:18:28.497543 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: request: GET /compute/v2.1/servers/057628ba-a74f-426e-ba25-a3b79c3b6339 HTTP/1.1 Aug 23 07:18:28.497543 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: Accept: application/json Aug 23 07:18:28.497543 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: Accept-Encoding: identity Aug 23 07:18:28.497543 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: Connection: close Aug 23 07:18:28.497543 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: Content-Length: 0 Aug 23 07:18:28.497543 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: Content-Type: application/json Aug 23 07:18:28.497543 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: Host: 10.222.0.17 Aug 23 07:18:28.497543 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: Openstack-System-Scope: None Aug 23 07:18:28.497543 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: User-Agent: python-urllib3/1.26.11 Aug 23 07:18:28.497543 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-Auth-Token: gAAAAABjBH3ZHMVVLXoXwNDfQQNusO5G5GN02PnHIiEEKbUNElvY7Grlo8u229xKVdQ1mmEwia_EWu2jEutb1fyYPOf6jNbBH41b4mzr6zipvsQ6BtbbjaOUpVuAli-fuxu6YJZFtXM3RMEYq-CLnj1C8WH54zH3cmVnSq_F2KlyAaedAUE420Q Aug 23 07:18:28.497543 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-Domain-Id: None Aug 23 07:18:28.497543 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-Domain-Name: None Aug 23 07:18:28.497543 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-Identity-Status: Confirmed Aug 23 07:18:28.497543 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-Is-Admin-Project: True Aug 23 07:18:28.497543 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-Project-Domain-Id: default Aug 23 07:18:28.497543 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-Project-Domain-Name: Default Aug 23 07:18:28.497543 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-Project-Id: eb44f62fa62e46528712f24479cbb19f Aug 23 07:18:28.497543 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-Project-Name: tempest-AttachVolumeNegativeTest-880454297 Aug 23 07:18:28.497543 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-Role: reader,member Aug 23 07:18:28.497543 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-Roles: reader,member Aug 23 07:18:28.498934 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/eb44f62fa62e46528712f24479cbb19f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/eb44f62fa62e46528712f24479cbb19f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_eb44f62fa62e46528712f24479cbb19f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/eb44f62fa62e46528712f24479cbb19f"}]}] Aug 23 07:18:28.498934 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-Tenant: tempest-AttachVolumeNegativeTest-880454297 Aug 23 07:18:28.498934 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-Tenant-Id: eb44f62fa62e46528712f24479cbb19f Aug 23 07:18:28.498934 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-880454297 Aug 23 07:18:28.498934 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-User: tempest-AttachVolumeNegativeTest-880454297-project Aug 23 07:18:28.498934 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-User-Domain-Id: default Aug 23 07:18:28.498934 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-User-Domain-Name: Default Aug 23 07:18:28.498934 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-User-Id: 471dc5c1db64411ab1d80ad6c038e519 Aug 23 07:18:28.498934 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-User-Name: tempest-AttachVolumeNegativeTest-880454297-project Aug 23 07:18:28.498934 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: method: > Aug 23 07:18:28.498934 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: exception: Instance 057628ba-a74f-426e-ba25-a3b79c3b6339 could not be found. Aug 23 07:18:28.498934 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: action_args: {'id': '057628ba-a74f-426e-ba25-a3b79c3b6339'} Aug 23 07:18:28.499988 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 07:18:28.499988 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 07:18:28.499988 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 07:18:28.499988 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 07:18:28.499988 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 07:18:28.499988 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 07:18:28.499988 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 07:18:28.499988 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 07:18:28.499988 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 07:18:28.499988 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 07:18:28.499988 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 057628ba-a74f-426e-ba25-a3b79c3b6339 could not be found. Aug 23 07:18:28.499988 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi Aug 23 07:18:28.499988 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 07:18:28.499988 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi Aug 23 07:18:28.499988 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 07:18:28.499988 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 07:18:28.499988 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 07:18:28.499988 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 07:18:28.499988 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 07:18:28.499988 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 07:18:28.501495 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 07:18:28.501495 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 07:18:28.501495 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 07:18:28.501495 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 07:18:28.501495 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 07:18:28.501495 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 07:18:28.501495 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 07:18:28.501495 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 057628ba-a74f-426e-ba25-a3b79c3b6339 could not be found. Aug 23 07:18:28.501495 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi Aug 23 07:18:28.501495 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 07:18:28.501495 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi Aug 23 07:18:28.501495 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 07:18:28.501495 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 07:18:28.501495 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 07:18:28.501495 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 07:18:28.501495 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 07:18:28.501495 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 057628ba-a74f-426e-ba25-a3b79c3b6339 could not be found. Aug 23 07:18:28.501495 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi Aug 23 07:18:28.502750 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-88176394-3a24-4de1-9921-5ab75e840c0d tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] Returning 404 to user: Instance 057628ba-a74f-426e-ba25-a3b79c3b6339 could not be found. {{(pid=120799) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 07:18:28.502750 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-88176394-3a24-4de1-9921-5ab75e840c0d tempest-AttachVolumeNegativeTest-880454297 tempest-AttachVolumeNegativeTest-880454297-project] 10.222.0.17 "GET /compute/v2.1/servers/057628ba-a74f-426e-ba25-a3b79c3b6339" status: 404 len: 111 microversion: 2.1 time: 0.038245 Aug 23 07:18:28.502750 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 338/654] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:18:28 2022] GET /compute/v2.1/servers/057628ba-a74f-426e-ba25-a3b79c3b6339 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 07:18:29.478892 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-7ab74062-6265-4de3-b7c9-c9ebc96acf41 tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 07:18:29.479489 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.compute.api [None req-7ab74062-6265-4de3-b7c9-c9ebc96acf41 tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] [instance: 0c761eab-49ac-4396-9907-70845ad75c64] Fetching instance by UUID {{(pid=120798) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:18:29.486478 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-7ab74062-6265-4de3-b7c9-c9ebc96acf41 tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:18:29.486962 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-7ab74062-6265-4de3-b7c9-c9ebc96acf41 tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:18:29.487404 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-7ab74062-6265-4de3-b7c9-c9ebc96acf41 tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:18:29.488133 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-7ab74062-6265-4de3-b7c9-c9ebc96acf41 tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:18:29.488577 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-7ab74062-6265-4de3-b7c9-c9ebc96acf41 tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:18:29.489032 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-7ab74062-6265-4de3-b7c9-c9ebc96acf41 tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:18:29.512893 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.objects.instance [None req-7ab74062-6265-4de3-b7c9-c9ebc96acf41 tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] Lazy-loading 'flavor' on Instance uuid 0c761eab-49ac-4396-9907-70845ad75c64 {{(pid=120798) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 07:18:29.589113 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [None req-7ab74062-6265-4de3-b7c9-c9ebc96acf41 tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] 10.222.0.17 "POST /compute/v2.1/servers/0c761eab-49ac-4396-9907-70845ad75c64/action" status: 202 len: 0 microversion: 2.1 time: 0.114090 Aug 23 07:18:29.593220 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 317/655] 10.222.0.17 () {60 vars in 1278 bytes} [Tue Aug 23 07:18:29 2022] POST /compute/v2.1/servers/0c761eab-49ac-4396-9907-70845ad75c64/action => generated 0 bytes in 116 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 23 07:18:29.600087 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-0dd9b38c-1f27-4aaa-9742-2bda2d3ab889 tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] Calling method '>' {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:18:29.600622 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.compute.api [None req-0dd9b38c-1f27-4aaa-9742-2bda2d3ab889 tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] [instance: 0c761eab-49ac-4396-9907-70845ad75c64] Fetching instance by UUID {{(pid=120799) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:18:29.611090 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-0dd9b38c-1f27-4aaa-9742-2bda2d3ab889 tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:18:29.612655 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-0dd9b38c-1f27-4aaa-9742-2bda2d3ab889 tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:18:29.613958 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-0dd9b38c-1f27-4aaa-9742-2bda2d3ab889 tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:18:29.614993 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-0dd9b38c-1f27-4aaa-9742-2bda2d3ab889 tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:18:29.615755 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-0dd9b38c-1f27-4aaa-9742-2bda2d3ab889 tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:18:29.616489 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-0dd9b38c-1f27-4aaa-9742-2bda2d3ab889 tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:18:29.777016 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.policy [None req-0dd9b38c-1f27-4aaa-9742-2bda2d3ab889 tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c26232f042844a898c19d1f63152b428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd004facbaed41a7a54a3ed6a6a44305', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120799) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:18:29.785119 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-0dd9b38c-1f27-4aaa-9742-2bda2d3ab889 tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] 10.222.0.17 "GET /compute/v2.1/servers/0c761eab-49ac-4396-9907-70845ad75c64" status: 200 len: 1565 microversion: 2.1 time: 0.189487 Aug 23 07:18:29.785687 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 339/656] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:18:29 2022] GET /compute/v2.1/servers/0c761eab-49ac-4396-9907-70845ad75c64 => generated 1565 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:18:30.807638 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-eb7911cd-95ba-4abb-8df4-b0f214e7f875 tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] Calling method '>' {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:18:30.808432 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.compute.api [None req-eb7911cd-95ba-4abb-8df4-b0f214e7f875 tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] [instance: 0c761eab-49ac-4396-9907-70845ad75c64] Fetching instance by UUID {{(pid=120798) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:18:30.815165 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-eb7911cd-95ba-4abb-8df4-b0f214e7f875 tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:18:30.815923 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-eb7911cd-95ba-4abb-8df4-b0f214e7f875 tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:18:30.816533 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-eb7911cd-95ba-4abb-8df4-b0f214e7f875 tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:18:30.817227 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-eb7911cd-95ba-4abb-8df4-b0f214e7f875 tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:18:30.817829 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-eb7911cd-95ba-4abb-8df4-b0f214e7f875 tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:18:30.818401 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-eb7911cd-95ba-4abb-8df4-b0f214e7f875 tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:18:31.036635 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.policy [None req-eb7911cd-95ba-4abb-8df4-b0f214e7f875 tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c26232f042844a898c19d1f63152b428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd004facbaed41a7a54a3ed6a6a44305', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120798) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:18:31.045397 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [None req-eb7911cd-95ba-4abb-8df4-b0f214e7f875 tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] 10.222.0.17 "GET /compute/v2.1/servers/0c761eab-49ac-4396-9907-70845ad75c64" status: 200 len: 1565 microversion: 2.1 time: 0.242593 Aug 23 07:18:31.046077 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 318/657] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:18:30 2022] GET /compute/v2.1/servers/0c761eab-49ac-4396-9907-70845ad75c64 => generated 1565 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:18:32.066718 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-afa37bdb-0d0a-4f88-ae09-619e2f39e6b8 tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] Calling method '>' {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:18:32.067878 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.compute.api [None req-afa37bdb-0d0a-4f88-ae09-619e2f39e6b8 tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] [instance: 0c761eab-49ac-4396-9907-70845ad75c64] Fetching instance by UUID {{(pid=120799) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:18:32.074213 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG dbcounter [-] [120799] Writing DB stats nova_api:SELECT=38,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120799) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:18:32.076516 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-afa37bdb-0d0a-4f88-ae09-619e2f39e6b8 tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:18:32.077418 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-afa37bdb-0d0a-4f88-ae09-619e2f39e6b8 tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:18:32.078061 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-afa37bdb-0d0a-4f88-ae09-619e2f39e6b8 tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:18:32.078761 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-afa37bdb-0d0a-4f88-ae09-619e2f39e6b8 tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:18:32.079207 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-afa37bdb-0d0a-4f88-ae09-619e2f39e6b8 tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:18:32.079653 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-afa37bdb-0d0a-4f88-ae09-619e2f39e6b8 tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:18:32.083000 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG dbcounter [-] [120799] Writing DB stats nova_cell1:SELECT=78,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120799) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:18:32.219749 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.policy [None req-afa37bdb-0d0a-4f88-ae09-619e2f39e6b8 tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c26232f042844a898c19d1f63152b428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd004facbaed41a7a54a3ed6a6a44305', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120799) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:18:32.228271 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-afa37bdb-0d0a-4f88-ae09-619e2f39e6b8 tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] 10.222.0.17 "GET /compute/v2.1/servers/0c761eab-49ac-4396-9907-70845ad75c64" status: 200 len: 1565 microversion: 2.1 time: 0.166042 Aug 23 07:18:32.229061 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 340/658] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:18:32 2022] GET /compute/v2.1/servers/0c761eab-49ac-4396-9907-70845ad75c64 => generated 1565 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:18:33.250049 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-baabd01f-060a-4211-b46d-68c1b23165d4 tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] Calling method '>' {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:18:33.250663 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.compute.api [None req-baabd01f-060a-4211-b46d-68c1b23165d4 tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] [instance: 0c761eab-49ac-4396-9907-70845ad75c64] Fetching instance by UUID {{(pid=120798) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:18:33.253146 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG dbcounter [-] [120798] Writing DB stats nova_api:SELECT=32 {{(pid=120798) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:18:33.258628 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-baabd01f-060a-4211-b46d-68c1b23165d4 tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:18:33.259108 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-baabd01f-060a-4211-b46d-68c1b23165d4 tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:18:33.259569 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-baabd01f-060a-4211-b46d-68c1b23165d4 tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:18:33.260259 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-baabd01f-060a-4211-b46d-68c1b23165d4 tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:18:33.260898 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-baabd01f-060a-4211-b46d-68c1b23165d4 tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:18:33.261317 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-baabd01f-060a-4211-b46d-68c1b23165d4 tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:18:33.407198 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.policy [None req-baabd01f-060a-4211-b46d-68c1b23165d4 tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c26232f042844a898c19d1f63152b428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd004facbaed41a7a54a3ed6a6a44305', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120798) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:18:33.415058 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [None req-baabd01f-060a-4211-b46d-68c1b23165d4 tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] 10.222.0.17 "GET /compute/v2.1/servers/0c761eab-49ac-4396-9907-70845ad75c64" status: 200 len: 1565 microversion: 2.1 time: 0.168975 Aug 23 07:18:33.415645 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 319/659] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:18:33 2022] GET /compute/v2.1/servers/0c761eab-49ac-4396-9907-70845ad75c64 => generated 1565 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:18:34.438322 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-0b518a60-c8c1-410f-81c5-f5c6e71bb938 tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] Calling method '>' {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:18:34.439217 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.compute.api [None req-0b518a60-c8c1-410f-81c5-f5c6e71bb938 tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] [instance: 0c761eab-49ac-4396-9907-70845ad75c64] Fetching instance by UUID {{(pid=120799) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:18:34.446030 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-0b518a60-c8c1-410f-81c5-f5c6e71bb938 tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:18:34.446512 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-0b518a60-c8c1-410f-81c5-f5c6e71bb938 tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:18:34.446953 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-0b518a60-c8c1-410f-81c5-f5c6e71bb938 tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:18:34.447682 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-0b518a60-c8c1-410f-81c5-f5c6e71bb938 tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:18:34.448144 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-0b518a60-c8c1-410f-81c5-f5c6e71bb938 tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:18:34.448590 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-0b518a60-c8c1-410f-81c5-f5c6e71bb938 tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:18:34.612743 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.policy [None req-0b518a60-c8c1-410f-81c5-f5c6e71bb938 tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c26232f042844a898c19d1f63152b428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd004facbaed41a7a54a3ed6a6a44305', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120799) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:18:34.620612 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-0b518a60-c8c1-410f-81c5-f5c6e71bb938 tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] 10.222.0.17 "GET /compute/v2.1/servers/0c761eab-49ac-4396-9907-70845ad75c64" status: 200 len: 1565 microversion: 2.1 time: 0.186629 Aug 23 07:18:34.621228 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 341/660] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:18:34 2022] GET /compute/v2.1/servers/0c761eab-49ac-4396-9907-70845ad75c64 => generated 1565 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:18:35.642149 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-8cdc151d-70a5-4939-ad16-2fb0fbe5c948 tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] Calling method '>' {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:18:35.642824 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.compute.api [None req-8cdc151d-70a5-4939-ad16-2fb0fbe5c948 tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] [instance: 0c761eab-49ac-4396-9907-70845ad75c64] Fetching instance by UUID {{(pid=120798) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:18:35.649267 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-8cdc151d-70a5-4939-ad16-2fb0fbe5c948 tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:18:35.649746 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-8cdc151d-70a5-4939-ad16-2fb0fbe5c948 tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:18:35.650166 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-8cdc151d-70a5-4939-ad16-2fb0fbe5c948 tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:18:35.650881 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-8cdc151d-70a5-4939-ad16-2fb0fbe5c948 tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:18:35.651322 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-8cdc151d-70a5-4939-ad16-2fb0fbe5c948 tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:18:35.651766 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-8cdc151d-70a5-4939-ad16-2fb0fbe5c948 tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:18:35.793614 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.policy [None req-8cdc151d-70a5-4939-ad16-2fb0fbe5c948 tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c26232f042844a898c19d1f63152b428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd004facbaed41a7a54a3ed6a6a44305', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120798) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:18:35.802044 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [None req-8cdc151d-70a5-4939-ad16-2fb0fbe5c948 tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] 10.222.0.17 "GET /compute/v2.1/servers/0c761eab-49ac-4396-9907-70845ad75c64" status: 200 len: 1565 microversion: 2.1 time: 0.163801 Aug 23 07:18:35.802662 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 320/661] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:18:35 2022] GET /compute/v2.1/servers/0c761eab-49ac-4396-9907-70845ad75c64 => generated 1565 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:18:36.823325 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-7e2162c0-6ba8-4241-8b1a-d77ae5ea9515 tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] Calling method '>' {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:18:36.824084 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.compute.api [None req-7e2162c0-6ba8-4241-8b1a-d77ae5ea9515 tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] [instance: 0c761eab-49ac-4396-9907-70845ad75c64] Fetching instance by UUID {{(pid=120799) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:18:36.832420 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-7e2162c0-6ba8-4241-8b1a-d77ae5ea9515 tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:18:36.832865 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-7e2162c0-6ba8-4241-8b1a-d77ae5ea9515 tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:18:36.833617 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-7e2162c0-6ba8-4241-8b1a-d77ae5ea9515 tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:18:36.834355 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-7e2162c0-6ba8-4241-8b1a-d77ae5ea9515 tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:18:36.834840 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-7e2162c0-6ba8-4241-8b1a-d77ae5ea9515 tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:18:36.835492 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-7e2162c0-6ba8-4241-8b1a-d77ae5ea9515 tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:18:36.969322 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.policy [None req-7e2162c0-6ba8-4241-8b1a-d77ae5ea9515 tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c26232f042844a898c19d1f63152b428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd004facbaed41a7a54a3ed6a6a44305', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120799) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:18:36.977838 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-7e2162c0-6ba8-4241-8b1a-d77ae5ea9515 tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] 10.222.0.17 "GET /compute/v2.1/servers/0c761eab-49ac-4396-9907-70845ad75c64" status: 200 len: 1565 microversion: 2.1 time: 0.158378 Aug 23 07:18:36.978485 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 342/662] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:18:36 2022] GET /compute/v2.1/servers/0c761eab-49ac-4396-9907-70845ad75c64 => generated 1565 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:18:37.376703 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-53052de6-14f4-45e0-b1e8-0f9155cb6bdc tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Calling method '>' {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:18:37.377199 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.compute.api [None req-53052de6-14f4-45e0-b1e8-0f9155cb6bdc tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] [instance: 74919866-69a0-460a-999a-b344d1cbc336] Fetching instance by UUID {{(pid=120798) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:18:37.383290 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-53052de6-14f4-45e0-b1e8-0f9155cb6bdc tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:18:37.383726 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-53052de6-14f4-45e0-b1e8-0f9155cb6bdc tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:18:37.384153 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-53052de6-14f4-45e0-b1e8-0f9155cb6bdc tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:18:37.384828 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-53052de6-14f4-45e0-b1e8-0f9155cb6bdc tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:18:37.385269 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-53052de6-14f4-45e0-b1e8-0f9155cb6bdc tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:18:37.385679 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-53052de6-14f4-45e0-b1e8-0f9155cb6bdc tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:18:37.413188 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.compute.api [None req-53052de6-14f4-45e0-b1e8-0f9155cb6bdc tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] [instance: 74919866-69a0-460a-999a-b344d1cbc336] Going to try to terminate instance {{(pid=120798) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 07:18:37.494711 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [None req-53052de6-14f4-45e0-b1e8-0f9155cb6bdc tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] 10.222.0.17 "DELETE /compute/v2.1/servers/74919866-69a0-460a-999a-b344d1cbc336" status: 204 len: 0 microversion: 2.1 time: 0.121622 Aug 23 07:18:37.495549 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 321/663] 10.222.0.17 () {58 vars in 1239 bytes} [Tue Aug 23 07:18:37 2022] DELETE /compute/v2.1/servers/74919866-69a0-460a-999a-b344d1cbc336 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 23 07:18:37.506042 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-63a293d9-70ff-49b0-865b-55d9374b44cf tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Calling method '>' {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:18:37.506654 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.compute.api [None req-63a293d9-70ff-49b0-865b-55d9374b44cf tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] [instance: 74919866-69a0-460a-999a-b344d1cbc336] Fetching instance by UUID {{(pid=120799) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:18:37.513235 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-63a293d9-70ff-49b0-865b-55d9374b44cf tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:18:37.513722 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-63a293d9-70ff-49b0-865b-55d9374b44cf tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:18:37.514158 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-63a293d9-70ff-49b0-865b-55d9374b44cf tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:18:37.514893 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-63a293d9-70ff-49b0-865b-55d9374b44cf tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:18:37.515346 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-63a293d9-70ff-49b0-865b-55d9374b44cf tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:18:37.515795 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-63a293d9-70ff-49b0-865b-55d9374b44cf tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:18:37.655638 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.policy [None req-63a293d9-70ff-49b0-865b-55d9374b44cf tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffd12f09606b4e6ba12f63b976df1884', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43b271d00f74eb7aa3d0719315c5a99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120799) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:18:37.663868 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-63a293d9-70ff-49b0-865b-55d9374b44cf tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] 10.222.0.17 "GET /compute/v2.1/servers/74919866-69a0-460a-999a-b344d1cbc336" status: 200 len: 1578 microversion: 2.1 time: 0.163254 Aug 23 07:18:37.664588 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 343/664] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:18:37 2022] GET /compute/v2.1/servers/74919866-69a0-460a-999a-b344d1cbc336 => generated 1578 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:18:38.002029 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-4ce30515-9b3d-4aaf-b03c-40ad2a35a126 tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] Calling method '>' {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:18:38.002808 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.compute.api [None req-4ce30515-9b3d-4aaf-b03c-40ad2a35a126 tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] [instance: 0c761eab-49ac-4396-9907-70845ad75c64] Fetching instance by UUID {{(pid=120798) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:18:38.009497 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-4ce30515-9b3d-4aaf-b03c-40ad2a35a126 tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:18:38.009981 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-4ce30515-9b3d-4aaf-b03c-40ad2a35a126 tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:18:38.010413 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-4ce30515-9b3d-4aaf-b03c-40ad2a35a126 tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:18:38.011139 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-4ce30515-9b3d-4aaf-b03c-40ad2a35a126 tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:18:38.011688 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-4ce30515-9b3d-4aaf-b03c-40ad2a35a126 tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:18:38.012110 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-4ce30515-9b3d-4aaf-b03c-40ad2a35a126 tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:18:38.157040 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.policy [None req-4ce30515-9b3d-4aaf-b03c-40ad2a35a126 tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c26232f042844a898c19d1f63152b428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd004facbaed41a7a54a3ed6a6a44305', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120798) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:18:38.165140 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [None req-4ce30515-9b3d-4aaf-b03c-40ad2a35a126 tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] 10.222.0.17 "GET /compute/v2.1/servers/0c761eab-49ac-4396-9907-70845ad75c64" status: 200 len: 1565 microversion: 2.1 time: 0.169469 Aug 23 07:18:38.165707 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 322/665] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:18:37 2022] GET /compute/v2.1/servers/0c761eab-49ac-4396-9907-70845ad75c64 => generated 1565 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:18:38.686447 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-f4e33bee-cfa3-4594-b2c3-92b8953216c5 tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Calling method '>' {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:18:38.687058 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.compute.api [None req-f4e33bee-cfa3-4594-b2c3-92b8953216c5 tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] [instance: 74919866-69a0-460a-999a-b344d1cbc336] Fetching instance by UUID {{(pid=120799) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:18:38.694325 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-f4e33bee-cfa3-4594-b2c3-92b8953216c5 tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:18:38.694839 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-f4e33bee-cfa3-4594-b2c3-92b8953216c5 tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:18:38.695269 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-f4e33bee-cfa3-4594-b2c3-92b8953216c5 tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:18:38.696027 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-f4e33bee-cfa3-4594-b2c3-92b8953216c5 tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:18:38.696479 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-f4e33bee-cfa3-4594-b2c3-92b8953216c5 tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:18:38.696894 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-f4e33bee-cfa3-4594-b2c3-92b8953216c5 tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:18:38.848883 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.policy [None req-f4e33bee-cfa3-4594-b2c3-92b8953216c5 tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffd12f09606b4e6ba12f63b976df1884', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43b271d00f74eb7aa3d0719315c5a99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120799) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:18:38.856559 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-f4e33bee-cfa3-4594-b2c3-92b8953216c5 tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] 10.222.0.17 "GET /compute/v2.1/servers/74919866-69a0-460a-999a-b344d1cbc336" status: 200 len: 1578 microversion: 2.1 time: 0.174582 Aug 23 07:18:38.857176 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 344/666] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:18:38 2022] GET /compute/v2.1/servers/74919866-69a0-460a-999a-b344d1cbc336 => generated 1578 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:18:39.191099 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-54216025-80f6-4964-a96c-e405f92d2161 tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] Calling method '>' {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:18:39.192507 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.compute.api [None req-54216025-80f6-4964-a96c-e405f92d2161 tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] [instance: 0c761eab-49ac-4396-9907-70845ad75c64] Fetching instance by UUID {{(pid=120798) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:18:39.199119 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-54216025-80f6-4964-a96c-e405f92d2161 tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:18:39.199635 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-54216025-80f6-4964-a96c-e405f92d2161 tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:18:39.200059 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-54216025-80f6-4964-a96c-e405f92d2161 tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:18:39.200712 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-54216025-80f6-4964-a96c-e405f92d2161 tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:18:39.201184 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-54216025-80f6-4964-a96c-e405f92d2161 tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:18:39.201593 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-54216025-80f6-4964-a96c-e405f92d2161 tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:18:39.340786 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.policy [None req-54216025-80f6-4964-a96c-e405f92d2161 tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c26232f042844a898c19d1f63152b428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd004facbaed41a7a54a3ed6a6a44305', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120798) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:18:39.349374 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [None req-54216025-80f6-4964-a96c-e405f92d2161 tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] 10.222.0.17 "GET /compute/v2.1/servers/0c761eab-49ac-4396-9907-70845ad75c64" status: 200 len: 1565 microversion: 2.1 time: 0.163373 Aug 23 07:18:39.350038 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 323/667] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:18:39 2022] GET /compute/v2.1/servers/0c761eab-49ac-4396-9907-70845ad75c64 => generated 1565 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:18:39.878379 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-616994d0-9368-4cd8-a81e-9879a84d8c7a tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Calling method '>' {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:18:39.878995 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.compute.api [None req-616994d0-9368-4cd8-a81e-9879a84d8c7a tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] [instance: 74919866-69a0-460a-999a-b344d1cbc336] Fetching instance by UUID {{(pid=120799) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:18:39.887240 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-616994d0-9368-4cd8-a81e-9879a84d8c7a tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:18:39.887741 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-616994d0-9368-4cd8-a81e-9879a84d8c7a tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:18:39.888166 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-616994d0-9368-4cd8-a81e-9879a84d8c7a tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:18:39.890867 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-616994d0-9368-4cd8-a81e-9879a84d8c7a tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:18:39.891272 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-616994d0-9368-4cd8-a81e-9879a84d8c7a tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:18:39.891722 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-616994d0-9368-4cd8-a81e-9879a84d8c7a tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:18:40.002594 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.policy [None req-616994d0-9368-4cd8-a81e-9879a84d8c7a tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffd12f09606b4e6ba12f63b976df1884', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43b271d00f74eb7aa3d0719315c5a99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120799) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:18:40.013119 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-616994d0-9368-4cd8-a81e-9879a84d8c7a tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] 10.222.0.17 "GET /compute/v2.1/servers/74919866-69a0-460a-999a-b344d1cbc336" status: 200 len: 1510 microversion: 2.1 time: 0.138784 Aug 23 07:18:40.013948 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 345/668] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:18:39 2022] GET /compute/v2.1/servers/74919866-69a0-460a-999a-b344d1cbc336 => generated 1510 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:18:40.375779 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-f856c160-7520-4b3b-bac1-cea6e1ffaa2d tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] Calling method '>' {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:18:40.377035 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.compute.api [None req-f856c160-7520-4b3b-bac1-cea6e1ffaa2d tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] [instance: 0c761eab-49ac-4396-9907-70845ad75c64] Fetching instance by UUID {{(pid=120798) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:18:40.384276 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-f856c160-7520-4b3b-bac1-cea6e1ffaa2d tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:18:40.384999 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-f856c160-7520-4b3b-bac1-cea6e1ffaa2d tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:18:40.385719 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-f856c160-7520-4b3b-bac1-cea6e1ffaa2d tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:18:40.386674 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-f856c160-7520-4b3b-bac1-cea6e1ffaa2d tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:18:40.387291 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-f856c160-7520-4b3b-bac1-cea6e1ffaa2d tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:18:40.387888 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-f856c160-7520-4b3b-bac1-cea6e1ffaa2d tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:18:40.502340 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [req-0dea21ce-e318-4ace-b034-5597373bce5e req-2854d751-8aca-40fa-b8d0-cb37b5cbed36 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "74919866-69a0-460a-999a-b344d1cbc336", "name": "network-vif-deleted", "tag": "4f3c189e-8afd-49e5-a4c7-60407c13730e"}]} {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 07:18:40.517858 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [req-0dea21ce-e318-4ace-b034-5597373bce5e req-2854d751-8aca-40fa-b8d0-cb37b5cbed36 service nova] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:18:40.518455 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [req-0dea21ce-e318-4ace-b034-5597373bce5e req-2854d751-8aca-40fa-b8d0-cb37b5cbed36 service nova] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:18:40.527801 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [req-0dea21ce-e318-4ace-b034-5597373bce5e req-2854d751-8aca-40fa-b8d0-cb37b5cbed36 service nova] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:18:40.549754 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.compute.server_external_events [req-0dea21ce-e318-4ace-b034-5597373bce5e req-2854d751-8aca-40fa-b8d0-cb37b5cbed36 service nova] Creating event network-vif-deleted:4f3c189e-8afd-49e5-a4c7-60407c13730e for instance 74919866-69a0-460a-999a-b344d1cbc336 on hv-cinder-85409 Aug 23 07:18:40.556151 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [req-0dea21ce-e318-4ace-b034-5597373bce5e req-2854d751-8aca-40fa-b8d0-cb37b5cbed36 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057770 Aug 23 07:18:40.557353 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 346/669] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Aug 23 07:18:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 07:18:40.602395 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.policy [None req-f856c160-7520-4b3b-bac1-cea6e1ffaa2d tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c26232f042844a898c19d1f63152b428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd004facbaed41a7a54a3ed6a6a44305', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120798) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:18:40.611989 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [None req-f856c160-7520-4b3b-bac1-cea6e1ffaa2d tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] 10.222.0.17 "GET /compute/v2.1/servers/0c761eab-49ac-4396-9907-70845ad75c64" status: 200 len: 1565 microversion: 2.1 time: 0.241670 Aug 23 07:18:40.612556 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 324/670] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:18:40 2022] GET /compute/v2.1/servers/0c761eab-49ac-4396-9907-70845ad75c64 => generated 1565 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:18:41.036032 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-3c86d74d-f3c1-4309-a822-0d3b066eee5e tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Calling method '>' {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:18:41.036945 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.compute.api [None req-3c86d74d-f3c1-4309-a822-0d3b066eee5e tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] [instance: 74919866-69a0-460a-999a-b344d1cbc336] Fetching instance by UUID {{(pid=120799) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:18:41.043294 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-3c86d74d-f3c1-4309-a822-0d3b066eee5e tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:18:41.043918 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-3c86d74d-f3c1-4309-a822-0d3b066eee5e tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:18:41.044422 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-3c86d74d-f3c1-4309-a822-0d3b066eee5e tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:18:41.045356 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-3c86d74d-f3c1-4309-a822-0d3b066eee5e tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:18:41.045888 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-3c86d74d-f3c1-4309-a822-0d3b066eee5e tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:18:41.046401 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-3c86d74d-f3c1-4309-a822-0d3b066eee5e tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:18:41.116812 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.policy [None req-3c86d74d-f3c1-4309-a822-0d3b066eee5e tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffd12f09606b4e6ba12f63b976df1884', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43b271d00f74eb7aa3d0719315c5a99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120799) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:18:41.125150 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-3c86d74d-f3c1-4309-a822-0d3b066eee5e tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] 10.222.0.17 "GET /compute/v2.1/servers/74919866-69a0-460a-999a-b344d1cbc336" status: 200 len: 1225 microversion: 2.1 time: 0.094293 Aug 23 07:18:41.125736 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 347/671] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:18:41 2022] GET /compute/v2.1/servers/74919866-69a0-460a-999a-b344d1cbc336 => generated 1225 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:18:41.634068 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-d91edb36-9516-4ecb-8302-d316e4910c4b tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] Calling method '>' {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:18:41.635496 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.compute.api [None req-d91edb36-9516-4ecb-8302-d316e4910c4b tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] [instance: 0c761eab-49ac-4396-9907-70845ad75c64] Fetching instance by UUID {{(pid=120798) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:18:41.657204 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-d91edb36-9516-4ecb-8302-d316e4910c4b tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:18:41.658049 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-d91edb36-9516-4ecb-8302-d316e4910c4b tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:18:41.660306 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-d91edb36-9516-4ecb-8302-d316e4910c4b tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:18:41.661002 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-d91edb36-9516-4ecb-8302-d316e4910c4b tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:18:41.661611 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-d91edb36-9516-4ecb-8302-d316e4910c4b tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:18:41.662220 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-d91edb36-9516-4ecb-8302-d316e4910c4b tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:18:41.801894 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.policy [None req-d91edb36-9516-4ecb-8302-d316e4910c4b tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c26232f042844a898c19d1f63152b428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd004facbaed41a7a54a3ed6a6a44305', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120798) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:18:41.809804 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [None req-d91edb36-9516-4ecb-8302-d316e4910c4b tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] 10.222.0.17 "GET /compute/v2.1/servers/0c761eab-49ac-4396-9907-70845ad75c64" status: 200 len: 1565 microversion: 2.1 time: 0.179754 Aug 23 07:18:41.810373 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 325/672] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:18:41 2022] GET /compute/v2.1/servers/0c761eab-49ac-4396-9907-70845ad75c64 => generated 1565 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:18:42.147348 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-2d640a64-c5c4-4c2b-b6f7-88f25f553ac4 tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Calling method '>' {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:18:42.148413 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.compute.api [None req-2d640a64-c5c4-4c2b-b6f7-88f25f553ac4 tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] [instance: 74919866-69a0-460a-999a-b344d1cbc336] Fetching instance by UUID {{(pid=120799) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:18:42.156670 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-2d640a64-c5c4-4c2b-b6f7-88f25f553ac4 tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:18:42.157168 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-2d640a64-c5c4-4c2b-b6f7-88f25f553ac4 tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:18:42.157589 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-2d640a64-c5c4-4c2b-b6f7-88f25f553ac4 tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:18:42.158295 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-2d640a64-c5c4-4c2b-b6f7-88f25f553ac4 tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:18:42.158854 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-2d640a64-c5c4-4c2b-b6f7-88f25f553ac4 tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:18:42.159348 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-2d640a64-c5c4-4c2b-b6f7-88f25f553ac4 tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:18:42.196890 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-2d640a64-c5c4-4c2b-b6f7-88f25f553ac4 tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:18:42.197358 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-2d640a64-c5c4-4c2b-b6f7-88f25f553ac4 tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:18:42.197787 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-2d640a64-c5c4-4c2b-b6f7-88f25f553ac4 tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:18:42.198227 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.objects.instance [None req-2d640a64-c5c4-4c2b-b6f7-88f25f553ac4 tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Lazy-loading 'fault' on Instance uuid 74919866-69a0-460a-999a-b344d1cbc336 {{(pid=120799) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 07:18:42.243454 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.policy [None req-2d640a64-c5c4-4c2b-b6f7-88f25f553ac4 tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffd12f09606b4e6ba12f63b976df1884', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43b271d00f74eb7aa3d0719315c5a99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120799) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:18:42.251733 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-2d640a64-c5c4-4c2b-b6f7-88f25f553ac4 tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] 10.222.0.17 "GET /compute/v2.1/servers/74919866-69a0-460a-999a-b344d1cbc336" status: 200 len: 1230 microversion: 2.1 time: 0.108920 Aug 23 07:18:42.252482 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 348/673] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:18:42 2022] GET /compute/v2.1/servers/74919866-69a0-460a-999a-b344d1cbc336 => generated 1230 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:18:42.830964 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-908ed68a-12e4-49ed-abef-794ef6db4cae tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] Calling method '>' {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:18:42.831803 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.compute.api [None req-908ed68a-12e4-49ed-abef-794ef6db4cae tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] [instance: 0c761eab-49ac-4396-9907-70845ad75c64] Fetching instance by UUID {{(pid=120798) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:18:42.838525 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-908ed68a-12e4-49ed-abef-794ef6db4cae tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:18:42.839074 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-908ed68a-12e4-49ed-abef-794ef6db4cae tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:18:42.839592 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-908ed68a-12e4-49ed-abef-794ef6db4cae tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:18:42.840369 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-908ed68a-12e4-49ed-abef-794ef6db4cae tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:18:42.841048 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-908ed68a-12e4-49ed-abef-794ef6db4cae tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:18:42.841473 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-908ed68a-12e4-49ed-abef-794ef6db4cae tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:18:42.984985 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.policy [None req-908ed68a-12e4-49ed-abef-794ef6db4cae tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c26232f042844a898c19d1f63152b428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd004facbaed41a7a54a3ed6a6a44305', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120798) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:18:42.993506 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [None req-908ed68a-12e4-49ed-abef-794ef6db4cae tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] 10.222.0.17 "GET /compute/v2.1/servers/0c761eab-49ac-4396-9907-70845ad75c64" status: 200 len: 1506 microversion: 2.1 time: 0.166682 Aug 23 07:18:42.994462 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 326/674] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:18:42 2022] GET /compute/v2.1/servers/0c761eab-49ac-4396-9907-70845ad75c64 => generated 1506 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:18:43.016514 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-b2f4d35d-84c4-44a8-ab29-178516bed4a5 tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 07:18:43.017101 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.compute.api [None req-b2f4d35d-84c4-44a8-ab29-178516bed4a5 tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] [instance: 0c761eab-49ac-4396-9907-70845ad75c64] Fetching instance by UUID {{(pid=120799) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:18:43.023339 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-b2f4d35d-84c4-44a8-ab29-178516bed4a5 tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:18:43.023848 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-b2f4d35d-84c4-44a8-ab29-178516bed4a5 tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:18:43.024270 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-b2f4d35d-84c4-44a8-ab29-178516bed4a5 tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:18:43.024940 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-b2f4d35d-84c4-44a8-ab29-178516bed4a5 tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:18:43.025380 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-b2f4d35d-84c4-44a8-ab29-178516bed4a5 tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:18:43.025792 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-b2f4d35d-84c4-44a8-ab29-178516bed4a5 tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:18:43.068955 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.compute.api [None req-b2f4d35d-84c4-44a8-ab29-178516bed4a5 tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] [instance: 0c761eab-49ac-4396-9907-70845ad75c64] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120799) unshelve /opt/stack/nova/nova/compute/api.py:4578}} Aug 23 07:18:43.140061 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-b2f4d35d-84c4-44a8-ab29-178516bed4a5 tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] 10.222.0.17 "POST /compute/v2.1/servers/0c761eab-49ac-4396-9907-70845ad75c64/action" status: 202 len: 0 microversion: 2.1 time: 0.127509 Aug 23 07:18:43.140951 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 349/675] 10.222.0.17 () {60 vars in 1278 bytes} [Tue Aug 23 07:18:43 2022] POST /compute/v2.1/servers/0c761eab-49ac-4396-9907-70845ad75c64/action => generated 0 bytes in 129 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 07:18:43.149987 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-aa78c258-0d46-45af-be09-b7b2e9a2b281 tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] Calling method '>' {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:18:43.150818 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.compute.api [None req-aa78c258-0d46-45af-be09-b7b2e9a2b281 tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] [instance: 0c761eab-49ac-4396-9907-70845ad75c64] Fetching instance by UUID {{(pid=120798) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:18:43.157293 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-aa78c258-0d46-45af-be09-b7b2e9a2b281 tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:18:43.157785 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-aa78c258-0d46-45af-be09-b7b2e9a2b281 tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:18:43.158242 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-aa78c258-0d46-45af-be09-b7b2e9a2b281 tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:18:43.158975 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-aa78c258-0d46-45af-be09-b7b2e9a2b281 tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:18:43.159442 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-aa78c258-0d46-45af-be09-b7b2e9a2b281 tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:18:43.159887 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-aa78c258-0d46-45af-be09-b7b2e9a2b281 tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:18:43.273579 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-22723904-a6c4-4e36-add2-94b9dda5fd73 tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Calling method '>' {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:18:43.274170 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.compute.api [None req-22723904-a6c4-4e36-add2-94b9dda5fd73 tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] [instance: 74919866-69a0-460a-999a-b344d1cbc336] Fetching instance by UUID {{(pid=120799) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:18:43.282436 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-22723904-a6c4-4e36-add2-94b9dda5fd73 tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:18:43.283189 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-22723904-a6c4-4e36-add2-94b9dda5fd73 tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:18:43.283925 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-22723904-a6c4-4e36-add2-94b9dda5fd73 tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:18:43.284816 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-22723904-a6c4-4e36-add2-94b9dda5fd73 tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:18:43.292268 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-22723904-a6c4-4e36-add2-94b9dda5fd73 tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:18:43.292785 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-22723904-a6c4-4e36-add2-94b9dda5fd73 tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:18:43.314935 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.wsgi [None req-22723904-a6c4-4e36-add2-94b9dda5fd73 tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] HTTP exception thrown: Instance 74919866-69a0-460a-999a-b344d1cbc336 could not be found. Aug 23 07:18:43.319767 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.policy [None req-aa78c258-0d46-45af-be09-b7b2e9a2b281 tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c26232f042844a898c19d1f63152b428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd004facbaed41a7a54a3ed6a6a44305', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120798) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:18:43.319939 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-22723904-a6c4-4e36-add2-94b9dda5fd73 tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Request method failure captured: Aug 23 07:18:43.319939 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: request: GET /compute/v2.1/servers/74919866-69a0-460a-999a-b344d1cbc336 HTTP/1.1 Aug 23 07:18:43.319939 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: Accept: application/json Aug 23 07:18:43.319939 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: Accept-Encoding: identity Aug 23 07:18:43.319939 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: Connection: close Aug 23 07:18:43.319939 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: Content-Length: 0 Aug 23 07:18:43.319939 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: Content-Type: application/json Aug 23 07:18:43.319939 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: Host: 10.222.0.17 Aug 23 07:18:43.319939 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: Openstack-System-Scope: None Aug 23 07:18:43.319939 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: User-Agent: python-urllib3/1.26.11 Aug 23 07:18:43.319939 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-Auth-Token: gAAAAABjBH6P-jieul6AKjLkQNxUQwwgT2fi8Bci5j8MffQf2AuPopMIy52WWi9L58wzK15-su-lWN-ZQ9-gsTbwBITO3GTIew5NLlk5lc5ISYP5453RzZuvVuMnc-3ttHjqotPkrTBqzUxKdCeedTYXi_LdjHTI3SusmhIkqFZ-BB_c7Wz6nIY Aug 23 07:18:43.319939 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-Domain-Id: None Aug 23 07:18:43.319939 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-Domain-Name: None Aug 23 07:18:43.319939 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-Identity-Status: Confirmed Aug 23 07:18:43.319939 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-Is-Admin-Project: True Aug 23 07:18:43.319939 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-Project-Domain-Id: default Aug 23 07:18:43.319939 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-Project-Domain-Name: Default Aug 23 07:18:43.319939 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-Project-Id: f43b271d00f74eb7aa3d0719315c5a99 Aug 23 07:18:43.319939 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-Project-Name: tempest-TestVolumeBootPattern-1818187997 Aug 23 07:18:43.319939 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-Role: reader,member Aug 23 07:18:43.319939 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-Roles: reader,member Aug 23 07:18:43.321527 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/f43b271d00f74eb7aa3d0719315c5a99"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/f43b271d00f74eb7aa3d0719315c5a99"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_f43b271d00f74eb7aa3d0719315c5a99"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/f43b271d00f74eb7aa3d0719315c5a99"}]}] Aug 23 07:18:43.321527 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-Tenant: tempest-TestVolumeBootPattern-1818187997 Aug 23 07:18:43.321527 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-Tenant-Id: f43b271d00f74eb7aa3d0719315c5a99 Aug 23 07:18:43.321527 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-Tenant-Name: tempest-TestVolumeBootPattern-1818187997 Aug 23 07:18:43.321527 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-User: tempest-TestVolumeBootPattern-1818187997-project Aug 23 07:18:43.321527 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-User-Domain-Id: default Aug 23 07:18:43.321527 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-User-Domain-Name: Default Aug 23 07:18:43.321527 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-User-Id: ffd12f09606b4e6ba12f63b976df1884 Aug 23 07:18:43.321527 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-User-Name: tempest-TestVolumeBootPattern-1818187997-project Aug 23 07:18:43.321527 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: method: > Aug 23 07:18:43.321527 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: exception: Instance 74919866-69a0-460a-999a-b344d1cbc336 could not be found. Aug 23 07:18:43.321527 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: action_args: {'id': '74919866-69a0-460a-999a-b344d1cbc336'} Aug 23 07:18:43.322561 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 07:18:43.322561 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 07:18:43.322561 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 07:18:43.322561 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 07:18:43.322561 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 07:18:43.322561 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 07:18:43.322561 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 07:18:43.322561 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 07:18:43.322561 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 07:18:43.322561 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 07:18:43.322561 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 74919866-69a0-460a-999a-b344d1cbc336 could not be found. Aug 23 07:18:43.322561 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi Aug 23 07:18:43.322561 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 07:18:43.322561 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi Aug 23 07:18:43.322561 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 07:18:43.322561 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 07:18:43.322561 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 07:18:43.322561 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 07:18:43.322561 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 07:18:43.322561 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 07:18:43.324204 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 07:18:43.324204 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 07:18:43.324204 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 07:18:43.324204 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 07:18:43.324204 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 07:18:43.324204 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 07:18:43.324204 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 07:18:43.324204 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 74919866-69a0-460a-999a-b344d1cbc336 could not be found. Aug 23 07:18:43.324204 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi Aug 23 07:18:43.324204 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 07:18:43.324204 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi Aug 23 07:18:43.324204 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 07:18:43.324204 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 07:18:43.324204 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 07:18:43.324204 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 07:18:43.324204 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 07:18:43.324204 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 74919866-69a0-460a-999a-b344d1cbc336 could not be found. Aug 23 07:18:43.324204 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi Aug 23 07:18:43.325651 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-22723904-a6c4-4e36-add2-94b9dda5fd73 tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Returning 404 to user: Instance 74919866-69a0-460a-999a-b344d1cbc336 could not be found. {{(pid=120799) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 07:18:43.325651 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-22723904-a6c4-4e36-add2-94b9dda5fd73 tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] 10.222.0.17 "GET /compute/v2.1/servers/74919866-69a0-460a-999a-b344d1cbc336" status: 404 len: 111 microversion: 2.1 time: 0.051620 Aug 23 07:18:43.325651 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 350/676] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:18:43 2022] GET /compute/v2.1/servers/74919866-69a0-460a-999a-b344d1cbc336 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 07:18:43.334758 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [None req-aa78c258-0d46-45af-be09-b7b2e9a2b281 tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] 10.222.0.17 "GET /compute/v2.1/servers/0c761eab-49ac-4396-9907-70845ad75c64" status: 200 len: 1514 microversion: 2.1 time: 0.189243 Aug 23 07:18:43.335714 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 327/677] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:18:43 2022] GET /compute/v2.1/servers/0c761eab-49ac-4396-9907-70845ad75c64 => generated 1514 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 07:18:43.522720 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-f86d7d57-f3d3-499b-939e-45e3f0d1b6d7 tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-813969847", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1565151740", "security_groups": [{"name": "tempest-secgroup-smoke-1052235560"}], "block_device_mapping_v2": [{"uuid": "d4aaf0ae-c4ba-4b81-85c9-e14f1875f049", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "6a0a58c3-07f3-4091-814d-8e4792f5ba82"}]}} {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 07:18:43.655600 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.network.neutron [None req-f86d7d57-f3d3-499b-939e-45e3f0d1b6d7 tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] validate_networks() for [('6a0a58c3-07f3-4091-814d-8e4792f5ba82', None, None, None, None, None)] {{(pid=120799) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 23 07:18:44.311537 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.virt.hardware [None req-f86d7d57-f3d3-499b-939e-45e3f0d1b6d7 tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Flavor limits 0:0:0 {{(pid=120799) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 07:18:44.312229 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.virt.hardware [None req-f86d7d57-f3d3-499b-939e-45e3f0d1b6d7 tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Image limits 0:0:0 {{(pid=120799) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 07:18:44.312407 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.virt.hardware [None req-f86d7d57-f3d3-499b-939e-45e3f0d1b6d7 tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Flavor pref 0:0:0 {{(pid=120799) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 07:18:44.312806 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.virt.hardware [None req-f86d7d57-f3d3-499b-939e-45e3f0d1b6d7 tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Image pref 0:0:0 {{(pid=120799) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 07:18:44.313208 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.virt.hardware [None req-f86d7d57-f3d3-499b-939e-45e3f0d1b6d7 tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120799) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 07:18:44.322355 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-f86d7d57-f3d3-499b-939e-45e3f0d1b6d7 tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:18:44.322826 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-f86d7d57-f3d3-499b-939e-45e3f0d1b6d7 tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:18:44.323307 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-f86d7d57-f3d3-499b-939e-45e3f0d1b6d7 tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:18:44.324062 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-f86d7d57-f3d3-499b-939e-45e3f0d1b6d7 tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:18:44.324508 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-f86d7d57-f3d3-499b-939e-45e3f0d1b6d7 tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:18:44.324978 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-f86d7d57-f3d3-499b-939e-45e3f0d1b6d7 tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:18:44.343963 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.quota [None req-f86d7d57-f3d3-499b-939e-45e3f0d1b6d7 tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Getting quotas for project f43b271d00f74eb7aa3d0719315c5a99. Resources: {'ram', 'instances', 'cores'} {{(pid=120799) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 07:18:44.348178 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.quota [None req-f86d7d57-f3d3-499b-939e-45e3f0d1b6d7 tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Getting quotas for user ffd12f09606b4e6ba12f63b976df1884 and project f43b271d00f74eb7aa3d0719315c5a99. Resources: {'ram', 'instances', 'cores'} {{(pid=120799) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 07:18:44.359036 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-25489e8b-077e-4f8b-9610-426e07afcf80 tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] Calling method '>' {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:18:44.359670 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.compute.api [None req-25489e8b-077e-4f8b-9610-426e07afcf80 tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] [instance: 0c761eab-49ac-4396-9907-70845ad75c64] Fetching instance by UUID {{(pid=120798) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:18:44.366374 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-25489e8b-077e-4f8b-9610-426e07afcf80 tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:18:44.366880 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-25489e8b-077e-4f8b-9610-426e07afcf80 tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:18:44.367289 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-25489e8b-077e-4f8b-9610-426e07afcf80 tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:18:44.367994 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-25489e8b-077e-4f8b-9610-426e07afcf80 tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:18:44.368458 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-25489e8b-077e-4f8b-9610-426e07afcf80 tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:18:44.368869 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-25489e8b-077e-4f8b-9610-426e07afcf80 tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:18:44.406652 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.compute.api [None req-f86d7d57-f3d3-499b-939e-45e3f0d1b6d7 tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Going to run 1 instances... {{(pid=120799) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 23 07:18:44.408908 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.compute.api [None req-f86d7d57-f3d3-499b-939e-45e3f0d1b6d7 tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] [instance: 19beb62f-fdd9-4e6c-9d20-2abc3b5dfd16] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='d4aaf0ae-c4ba-4b81-85c9-e14f1875f049',volume_size=None,volume_type=None)] {{(pid=120799) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 07:18:44.509625 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.policy [None req-25489e8b-077e-4f8b-9610-426e07afcf80 tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c26232f042844a898c19d1f63152b428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd004facbaed41a7a54a3ed6a6a44305', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120798) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:18:44.511986 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG dbcounter [-] [120798] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120798) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:18:44.521425 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [None req-25489e8b-077e-4f8b-9610-426e07afcf80 tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] 10.222.0.17 "GET /compute/v2.1/servers/0c761eab-49ac-4396-9907-70845ad75c64" status: 200 len: 1516 microversion: 2.1 time: 0.166194 Aug 23 07:18:44.522660 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 328/678] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:18:44 2022] GET /compute/v2.1/servers/0c761eab-49ac-4396-9907-70845ad75c64 => generated 1516 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:18:44.543738 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-f86d7d57-f3d3-499b-939e-45e3f0d1b6d7 tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.024971 Aug 23 07:18:44.544466 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 351/679] 10.222.0.17 () {60 vars in 1147 bytes} [Tue Aug 23 07:18:43 2022] POST /compute/v2.1/servers => generated 406 bytes in 1027 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 23 07:18:44.559297 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-85a31e93-1c09-4d53-afa8-a2427bde10d6 tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Calling method '>' {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:18:44.559926 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.compute.api [None req-85a31e93-1c09-4d53-afa8-a2427bde10d6 tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] [instance: 19beb62f-fdd9-4e6c-9d20-2abc3b5dfd16] Fetching instance by UUID {{(pid=120798) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:18:44.627707 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.policy [None req-85a31e93-1c09-4d53-afa8-a2427bde10d6 tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffd12f09606b4e6ba12f63b976df1884', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43b271d00f74eb7aa3d0719315c5a99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120798) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:18:44.635234 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [None req-85a31e93-1c09-4d53-afa8-a2427bde10d6 tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] 10.222.0.17 "GET /compute/v2.1/servers/19beb62f-fdd9-4e6c-9d20-2abc3b5dfd16" status: 200 len: 1094 microversion: 2.1 time: 0.079839 Aug 23 07:18:44.639463 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 329/680] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:18:44 2022] GET /compute/v2.1/servers/19beb62f-fdd9-4e6c-9d20-2abc3b5dfd16 => generated 1094 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:18:45.548055 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-d8c9c539-d942-43c1-a14a-f5b86102833f tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] Calling method '>' {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:18:45.549374 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.compute.api [None req-d8c9c539-d942-43c1-a14a-f5b86102833f tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] [instance: 0c761eab-49ac-4396-9907-70845ad75c64] Fetching instance by UUID {{(pid=120799) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:18:45.558661 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-d8c9c539-d942-43c1-a14a-f5b86102833f tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:18:45.559566 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-d8c9c539-d942-43c1-a14a-f5b86102833f tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:18:45.560153 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-d8c9c539-d942-43c1-a14a-f5b86102833f tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:18:45.561286 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-d8c9c539-d942-43c1-a14a-f5b86102833f tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:18:45.562154 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-d8c9c539-d942-43c1-a14a-f5b86102833f tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:18:45.563286 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-d8c9c539-d942-43c1-a14a-f5b86102833f tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:18:45.668663 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-d0373a8d-ec9c-4257-ae1d-46530f579d17 tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Calling method '>' {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:18:45.670259 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.compute.api [None req-d0373a8d-ec9c-4257-ae1d-46530f579d17 tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] [instance: 19beb62f-fdd9-4e6c-9d20-2abc3b5dfd16] Fetching instance by UUID {{(pid=120798) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:18:45.688421 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-d0373a8d-ec9c-4257-ae1d-46530f579d17 tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:18:45.688920 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-d0373a8d-ec9c-4257-ae1d-46530f579d17 tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:18:45.692018 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-d0373a8d-ec9c-4257-ae1d-46530f579d17 tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:18:45.694431 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-d0373a8d-ec9c-4257-ae1d-46530f579d17 tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:18:45.696630 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-d0373a8d-ec9c-4257-ae1d-46530f579d17 tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:18:45.697080 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-d0373a8d-ec9c-4257-ae1d-46530f579d17 tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:18:45.831112 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.policy [None req-d8c9c539-d942-43c1-a14a-f5b86102833f tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c26232f042844a898c19d1f63152b428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd004facbaed41a7a54a3ed6a6a44305', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120799) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:18:45.839430 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-d8c9c539-d942-43c1-a14a-f5b86102833f tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] 10.222.0.17 "GET /compute/v2.1/servers/0c761eab-49ac-4396-9907-70845ad75c64" status: 200 len: 1572 microversion: 2.1 time: 0.297678 Aug 23 07:18:45.840885 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 352/681] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:18:45 2022] GET /compute/v2.1/servers/0c761eab-49ac-4396-9907-70845ad75c64 => generated 1572 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:18:45.846662 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.policy [None req-d0373a8d-ec9c-4257-ae1d-46530f579d17 tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffd12f09606b4e6ba12f63b976df1884', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43b271d00f74eb7aa3d0719315c5a99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120798) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:18:45.847793 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-7608eb06-d7e5-471b-a2d2-b46b3871f582 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Calling method '>' {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:18:45.848508 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.compute.api [None req-7608eb06-d7e5-471b-a2d2-b46b3871f582 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] [instance: d1a4fd6e-9323-416e-b844-5e526565774e] Fetching instance by UUID {{(pid=120799) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:18:45.856821 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-7608eb06-d7e5-471b-a2d2-b46b3871f582 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:18:45.858237 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-7608eb06-d7e5-471b-a2d2-b46b3871f582 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:18:45.859030 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-7608eb06-d7e5-471b-a2d2-b46b3871f582 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:18:45.860434 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-7608eb06-d7e5-471b-a2d2-b46b3871f582 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:18:45.861184 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-7608eb06-d7e5-471b-a2d2-b46b3871f582 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:18:45.861922 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-7608eb06-d7e5-471b-a2d2-b46b3871f582 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:18:45.872984 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [None req-d0373a8d-ec9c-4257-ae1d-46530f579d17 tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] 10.222.0.17 "GET /compute/v2.1/servers/19beb62f-fdd9-4e6c-9d20-2abc3b5dfd16" status: 200 len: 1210 microversion: 2.1 time: 0.211732 Aug 23 07:18:45.873848 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 330/682] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:18:45 2022] GET /compute/v2.1/servers/19beb62f-fdd9-4e6c-9d20-2abc3b5dfd16 => generated 1210 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:18:45.890590 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-7608eb06-d7e5-471b-a2d2-b46b3871f582 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] 10.222.0.17 "GET /compute/v2.1/servers/d1a4fd6e-9323-416e-b844-5e526565774e/ips" status: 200 len: 150 microversion: 2.20 time: 0.047845 Aug 23 07:18:45.891268 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 353/683] 10.222.0.17 () {60 vars in 1289 bytes} [Tue Aug 23 07:18:45 2022] GET /compute/v2.1/servers/d1a4fd6e-9323-416e-b844-5e526565774e/ips => generated 150 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 23 07:18:46.873561 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [req-9a3590b2-1697-415f-9720-ba6e36b41b59 req-a692dfd0-cf2f-4e8e-b339-fedeb1c9bebb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0c761eab-49ac-4396-9907-70845ad75c64", "name": "network-vif-unplugged", "status": "completed", "tag": "bb18fb15-817d-4f8a-9e7c-652d111e0cd7"}]} {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 07:18:46.875565 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-6fad33d9-3383-4670-b756-0b8d79ad6b73 tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] Calling method '>' {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:18:46.878316 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.compute.api [None req-6fad33d9-3383-4670-b756-0b8d79ad6b73 tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] [instance: 0c761eab-49ac-4396-9907-70845ad75c64] Fetching instance by UUID {{(pid=120798) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:18:46.891918 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-6fad33d9-3383-4670-b756-0b8d79ad6b73 tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:18:46.892403 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-6fad33d9-3383-4670-b756-0b8d79ad6b73 tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:18:46.892875 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-6fad33d9-3383-4670-b756-0b8d79ad6b73 tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:18:46.893626 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-6fad33d9-3383-4670-b756-0b8d79ad6b73 tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:18:46.894166 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-6fad33d9-3383-4670-b756-0b8d79ad6b73 tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:18:46.894603 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-6fad33d9-3383-4670-b756-0b8d79ad6b73 tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:18:46.900471 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [req-9a3590b2-1697-415f-9720-ba6e36b41b59 req-a692dfd0-cf2f-4e8e-b339-fedeb1c9bebb service nova] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:18:46.901002 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [req-9a3590b2-1697-415f-9720-ba6e36b41b59 req-a692dfd0-cf2f-4e8e-b339-fedeb1c9bebb service nova] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:18:46.906526 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [req-9a3590b2-1697-415f-9720-ba6e36b41b59 req-a692dfd0-cf2f-4e8e-b339-fedeb1c9bebb service nova] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:18:46.936429 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.compute.server_external_events [req-9a3590b2-1697-415f-9720-ba6e36b41b59 req-a692dfd0-cf2f-4e8e-b339-fedeb1c9bebb service nova] Creating event network-vif-unplugged:bb18fb15-817d-4f8a-9e7c-652d111e0cd7 for instance 0c761eab-49ac-4396-9907-70845ad75c64 on hv-cinder-85409 Aug 23 07:18:46.945856 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [req-9a3590b2-1697-415f-9720-ba6e36b41b59 req-a692dfd0-cf2f-4e8e-b339-fedeb1c9bebb service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.080120 Aug 23 07:18:46.947290 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 354/684] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Aug 23 07:18:46 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 07:18:46.959588 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-5f403f9d-ec75-47eb-aa31-398d07ea9267 tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Calling method '>' {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:18:46.960531 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.compute.api [None req-5f403f9d-ec75-47eb-aa31-398d07ea9267 tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] [instance: 19beb62f-fdd9-4e6c-9d20-2abc3b5dfd16] Fetching instance by UUID {{(pid=120799) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:18:46.968568 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-5f403f9d-ec75-47eb-aa31-398d07ea9267 tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:18:46.969128 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-5f403f9d-ec75-47eb-aa31-398d07ea9267 tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:18:46.970128 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-5f403f9d-ec75-47eb-aa31-398d07ea9267 tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:18:46.971170 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-5f403f9d-ec75-47eb-aa31-398d07ea9267 tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:18:46.972037 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-5f403f9d-ec75-47eb-aa31-398d07ea9267 tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:18:46.972663 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-5f403f9d-ec75-47eb-aa31-398d07ea9267 tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:18:47.167927 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.policy [None req-6fad33d9-3383-4670-b756-0b8d79ad6b73 tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c26232f042844a898c19d1f63152b428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd004facbaed41a7a54a3ed6a6a44305', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120798) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:18:47.177739 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [None req-6fad33d9-3383-4670-b756-0b8d79ad6b73 tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] 10.222.0.17 "GET /compute/v2.1/servers/0c761eab-49ac-4396-9907-70845ad75c64" status: 200 len: 1572 microversion: 2.1 time: 0.316274 Aug 23 07:18:47.178484 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 331/685] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:18:46 2022] GET /compute/v2.1/servers/0c761eab-49ac-4396-9907-70845ad75c64 => generated 1572 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:18:47.238316 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.policy [None req-5f403f9d-ec75-47eb-aa31-398d07ea9267 tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffd12f09606b4e6ba12f63b976df1884', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43b271d00f74eb7aa3d0719315c5a99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120799) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:18:47.246449 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-5f403f9d-ec75-47eb-aa31-398d07ea9267 tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] 10.222.0.17 "GET /compute/v2.1/servers/19beb62f-fdd9-4e6c-9d20-2abc3b5dfd16" status: 200 len: 1266 microversion: 2.1 time: 0.297788 Aug 23 07:18:47.247112 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 355/686] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:18:46 2022] GET /compute/v2.1/servers/19beb62f-fdd9-4e6c-9d20-2abc3b5dfd16 => generated 1266 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:18:47.489355 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [req-2d255b0d-beb4-4817-a020-e15c2f84622d req-ec5bfe9c-77c0-4ae9-a86c-56d307dc8e72 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "19beb62f-fdd9-4e6c-9d20-2abc3b5dfd16", "tag": "22874e03-587e-473a-8f08-37ed4393d34c"}]} {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 07:18:47.499500 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [req-2d255b0d-beb4-4817-a020-e15c2f84622d req-ec5bfe9c-77c0-4ae9-a86c-56d307dc8e72 service nova] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:18:47.500382 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [req-2d255b0d-beb4-4817-a020-e15c2f84622d req-ec5bfe9c-77c0-4ae9-a86c-56d307dc8e72 service nova] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:18:47.501018 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [req-2d255b0d-beb4-4817-a020-e15c2f84622d req-ec5bfe9c-77c0-4ae9-a86c-56d307dc8e72 service nova] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:18:47.518052 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.compute.server_external_events [req-2d255b0d-beb4-4817-a020-e15c2f84622d req-ec5bfe9c-77c0-4ae9-a86c-56d307dc8e72 service nova] Creating event network-changed:22874e03-587e-473a-8f08-37ed4393d34c for instance 19beb62f-fdd9-4e6c-9d20-2abc3b5dfd16 on hv-cinder-85409 Aug 23 07:18:47.523666 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [req-2d255b0d-beb4-4817-a020-e15c2f84622d req-ec5bfe9c-77c0-4ae9-a86c-56d307dc8e72 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037796 Aug 23 07:18:47.524330 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 332/687] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Aug 23 07:18:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 07:18:47.823127 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-80c84c73-380e-48d3-8f93-116842186e12 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 07:18:47.824171 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.compute.api [None req-80c84c73-380e-48d3-8f93-116842186e12 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] [instance: d1a4fd6e-9323-416e-b844-5e526565774e] Fetching instance by UUID {{(pid=120799) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:18:47.830413 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-80c84c73-380e-48d3-8f93-116842186e12 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:18:47.831468 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-80c84c73-380e-48d3-8f93-116842186e12 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:18:47.831892 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-80c84c73-380e-48d3-8f93-116842186e12 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:18:47.832816 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-80c84c73-380e-48d3-8f93-116842186e12 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:18:47.833453 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-80c84c73-380e-48d3-8f93-116842186e12 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:18:47.834723 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-80c84c73-380e-48d3-8f93-116842186e12 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:18:47.867211 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.objects.instance [None req-80c84c73-380e-48d3-8f93-116842186e12 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lazy-loading 'flavor' on Instance uuid d1a4fd6e-9323-416e-b844-5e526565774e {{(pid=120799) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 07:18:47.935265 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG dbcounter [-] [120799] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=120799) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:18:48.061983 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-80c84c73-380e-48d3-8f93-116842186e12 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] 10.222.0.17 "POST /compute/v2.1/servers/d1a4fd6e-9323-416e-b844-5e526565774e/action" status: 202 len: 0 microversion: 2.20 time: 0.242608 Aug 23 07:18:48.065999 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 356/688] 10.222.0.17 () {62 vars in 1319 bytes} [Tue Aug 23 07:18:47 2022] POST /compute/v2.1/servers/d1a4fd6e-9323-416e-b844-5e526565774e/action => generated 0 bytes in 244 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 23 07:18:48.073059 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-62e3061c-01a6-4b63-a0e2-a2df1e5388ad tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Calling method '>' {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:18:48.073757 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.compute.api [None req-62e3061c-01a6-4b63-a0e2-a2df1e5388ad tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] [instance: d1a4fd6e-9323-416e-b844-5e526565774e] Fetching instance by UUID {{(pid=120798) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:18:48.080114 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-62e3061c-01a6-4b63-a0e2-a2df1e5388ad tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:18:48.080642 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-62e3061c-01a6-4b63-a0e2-a2df1e5388ad tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:18:48.081076 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-62e3061c-01a6-4b63-a0e2-a2df1e5388ad tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:18:48.081778 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-62e3061c-01a6-4b63-a0e2-a2df1e5388ad tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:18:48.082214 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-62e3061c-01a6-4b63-a0e2-a2df1e5388ad tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:18:48.082622 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-62e3061c-01a6-4b63-a0e2-a2df1e5388ad tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:18:48.199779 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-010078e6-cba9-4c4f-99fe-1db444e7f1ed tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] Calling method '>' {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:18:48.203959 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.compute.api [None req-010078e6-cba9-4c4f-99fe-1db444e7f1ed tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] [instance: 0c761eab-49ac-4396-9907-70845ad75c64] Fetching instance by UUID {{(pid=120799) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:18:48.211508 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-010078e6-cba9-4c4f-99fe-1db444e7f1ed tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:18:48.212769 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-010078e6-cba9-4c4f-99fe-1db444e7f1ed tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:18:48.213200 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-010078e6-cba9-4c4f-99fe-1db444e7f1ed tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:18:48.213895 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-010078e6-cba9-4c4f-99fe-1db444e7f1ed tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:18:48.214339 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-010078e6-cba9-4c4f-99fe-1db444e7f1ed tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:18:48.214749 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-010078e6-cba9-4c4f-99fe-1db444e7f1ed tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:18:48.298706 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.policy [None req-62e3061c-01a6-4b63-a0e2-a2df1e5388ad tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb28547f4b54c4097d2ffc3c533ca67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42af08ef367945939b1f59ffa8af351a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120798) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:18:48.308225 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.policy [None req-62e3061c-01a6-4b63-a0e2-a2df1e5388ad tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4fb28547f4b54c4097d2ffc3c533ca67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42af08ef367945939b1f59ffa8af351a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120798) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:18:48.310110 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.policy [None req-62e3061c-01a6-4b63-a0e2-a2df1e5388ad tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4fb28547f4b54c4097d2ffc3c533ca67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42af08ef367945939b1f59ffa8af351a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120798) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:18:48.311310 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [None req-62e3061c-01a6-4b63-a0e2-a2df1e5388ad tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] 10.222.0.17 "GET /compute/v2.1/servers/d1a4fd6e-9323-416e-b844-5e526565774e" status: 200 len: 1720 microversion: 2.20 time: 0.243463 Aug 23 07:18:48.311899 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 333/689] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Aug 23 07:18:48 2022] GET /compute/v2.1/servers/d1a4fd6e-9323-416e-b844-5e526565774e => generated 1720 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 07:18:48.317223 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-cebbdbe7-22f6-4088-a626-3a43ffdb7bcb tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Calling method '>' {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:18:48.317839 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.compute.api [None req-cebbdbe7-22f6-4088-a626-3a43ffdb7bcb tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] [instance: 19beb62f-fdd9-4e6c-9d20-2abc3b5dfd16] Fetching instance by UUID {{(pid=120798) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:18:48.323953 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-cebbdbe7-22f6-4088-a626-3a43ffdb7bcb tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:18:48.324830 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-cebbdbe7-22f6-4088-a626-3a43ffdb7bcb tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:18:48.325493 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-cebbdbe7-22f6-4088-a626-3a43ffdb7bcb tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:18:48.326411 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-cebbdbe7-22f6-4088-a626-3a43ffdb7bcb tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:18:48.327309 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-cebbdbe7-22f6-4088-a626-3a43ffdb7bcb tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:18:48.328037 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-cebbdbe7-22f6-4088-a626-3a43ffdb7bcb tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:18:48.530563 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.policy [None req-010078e6-cba9-4c4f-99fe-1db444e7f1ed tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c26232f042844a898c19d1f63152b428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd004facbaed41a7a54a3ed6a6a44305', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120799) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:18:48.538981 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-010078e6-cba9-4c4f-99fe-1db444e7f1ed tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] 10.222.0.17 "GET /compute/v2.1/servers/0c761eab-49ac-4396-9907-70845ad75c64" status: 200 len: 1572 microversion: 2.1 time: 0.344178 Aug 23 07:18:48.539612 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 357/690] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:18:48 2022] GET /compute/v2.1/servers/0c761eab-49ac-4396-9907-70845ad75c64 => generated 1572 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 07:18:48.596153 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.policy [None req-cebbdbe7-22f6-4088-a626-3a43ffdb7bcb tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffd12f09606b4e6ba12f63b976df1884', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43b271d00f74eb7aa3d0719315c5a99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120798) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:18:48.611011 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [None req-cebbdbe7-22f6-4088-a626-3a43ffdb7bcb tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] 10.222.0.17 "GET /compute/v2.1/servers/19beb62f-fdd9-4e6c-9d20-2abc3b5dfd16" status: 200 len: 1266 microversion: 2.1 time: 0.293258 Aug 23 07:18:48.611011 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 334/691] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:18:48 2022] GET /compute/v2.1/servers/19beb62f-fdd9-4e6c-9d20-2abc3b5dfd16 => generated 1266 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:18:49.337223 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-81f5c248-4280-4529-a748-758a69928ee6 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Calling method '>' {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:18:49.338110 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.compute.api [None req-81f5c248-4280-4529-a748-758a69928ee6 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] [instance: d1a4fd6e-9323-416e-b844-5e526565774e] Fetching instance by UUID {{(pid=120799) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:18:49.344749 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-81f5c248-4280-4529-a748-758a69928ee6 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:18:49.345160 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-81f5c248-4280-4529-a748-758a69928ee6 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:18:49.345612 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-81f5c248-4280-4529-a748-758a69928ee6 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:18:49.346517 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-81f5c248-4280-4529-a748-758a69928ee6 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:18:49.346987 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-81f5c248-4280-4529-a748-758a69928ee6 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:18:49.347434 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-81f5c248-4280-4529-a748-758a69928ee6 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:18:49.484575 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.policy [None req-81f5c248-4280-4529-a748-758a69928ee6 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb28547f4b54c4097d2ffc3c533ca67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42af08ef367945939b1f59ffa8af351a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120799) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:18:49.493037 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.policy [None req-81f5c248-4280-4529-a748-758a69928ee6 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4fb28547f4b54c4097d2ffc3c533ca67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42af08ef367945939b1f59ffa8af351a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120799) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:18:49.494517 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.policy [None req-81f5c248-4280-4529-a748-758a69928ee6 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4fb28547f4b54c4097d2ffc3c533ca67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42af08ef367945939b1f59ffa8af351a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120799) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:18:49.495719 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-81f5c248-4280-4529-a748-758a69928ee6 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] 10.222.0.17 "GET /compute/v2.1/servers/d1a4fd6e-9323-416e-b844-5e526565774e" status: 200 len: 1720 microversion: 2.20 time: 0.162472 Aug 23 07:18:49.496262 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 358/692] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Aug 23 07:18:49 2022] GET /compute/v2.1/servers/d1a4fd6e-9323-416e-b844-5e526565774e => generated 1720 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 07:18:49.561529 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-4901a484-1899-409b-bbff-ec0ba3079ad6 tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] Calling method '>' {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:18:49.562120 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.compute.api [None req-4901a484-1899-409b-bbff-ec0ba3079ad6 tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] [instance: 0c761eab-49ac-4396-9907-70845ad75c64] Fetching instance by UUID {{(pid=120798) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:18:49.569779 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-4901a484-1899-409b-bbff-ec0ba3079ad6 tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:18:49.570264 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-4901a484-1899-409b-bbff-ec0ba3079ad6 tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:18:49.570700 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-4901a484-1899-409b-bbff-ec0ba3079ad6 tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:18:49.571398 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-4901a484-1899-409b-bbff-ec0ba3079ad6 tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:18:49.571884 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-4901a484-1899-409b-bbff-ec0ba3079ad6 tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:18:49.572304 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-4901a484-1899-409b-bbff-ec0ba3079ad6 tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:18:49.627919 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-b097fa58-72d0-4487-8863-14c62d6f087d tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Calling method '>' {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:18:49.628528 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.compute.api [None req-b097fa58-72d0-4487-8863-14c62d6f087d tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] [instance: 19beb62f-fdd9-4e6c-9d20-2abc3b5dfd16] Fetching instance by UUID {{(pid=120799) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:18:49.634823 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-b097fa58-72d0-4487-8863-14c62d6f087d tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:18:49.635270 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-b097fa58-72d0-4487-8863-14c62d6f087d tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:18:49.635719 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-b097fa58-72d0-4487-8863-14c62d6f087d tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:18:49.636410 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-b097fa58-72d0-4487-8863-14c62d6f087d tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:18:49.636843 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-b097fa58-72d0-4487-8863-14c62d6f087d tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:18:49.637282 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-b097fa58-72d0-4487-8863-14c62d6f087d tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:18:49.753564 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.policy [None req-4901a484-1899-409b-bbff-ec0ba3079ad6 tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c26232f042844a898c19d1f63152b428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd004facbaed41a7a54a3ed6a6a44305', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120798) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:18:49.761815 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [None req-4901a484-1899-409b-bbff-ec0ba3079ad6 tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] 10.222.0.17 "GET /compute/v2.1/servers/0c761eab-49ac-4396-9907-70845ad75c64" status: 200 len: 1572 microversion: 2.1 time: 0.204429 Aug 23 07:18:49.762414 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 335/693] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:18:49 2022] GET /compute/v2.1/servers/0c761eab-49ac-4396-9907-70845ad75c64 => generated 1572 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:18:49.803107 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.policy [None req-b097fa58-72d0-4487-8863-14c62d6f087d tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffd12f09606b4e6ba12f63b976df1884', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43b271d00f74eb7aa3d0719315c5a99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120799) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:18:49.814825 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-b097fa58-72d0-4487-8863-14c62d6f087d tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] 10.222.0.17 "GET /compute/v2.1/servers/19beb62f-fdd9-4e6c-9d20-2abc3b5dfd16" status: 200 len: 1266 microversion: 2.1 time: 0.190859 Aug 23 07:18:49.815720 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 359/694] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:18:49 2022] GET /compute/v2.1/servers/19beb62f-fdd9-4e6c-9d20-2abc3b5dfd16 => generated 1266 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:18:50.518313 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-345bb8c8-87b6-4d3e-92c3-fa1922e75487 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Calling method '>' {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:18:50.518920 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.compute.api [None req-345bb8c8-87b6-4d3e-92c3-fa1922e75487 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] [instance: d1a4fd6e-9323-416e-b844-5e526565774e] Fetching instance by UUID {{(pid=120798) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:18:50.525616 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-345bb8c8-87b6-4d3e-92c3-fa1922e75487 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:18:50.526080 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-345bb8c8-87b6-4d3e-92c3-fa1922e75487 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:18:50.526545 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-345bb8c8-87b6-4d3e-92c3-fa1922e75487 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:18:50.527307 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-345bb8c8-87b6-4d3e-92c3-fa1922e75487 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:18:50.527774 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-345bb8c8-87b6-4d3e-92c3-fa1922e75487 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:18:50.528310 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-345bb8c8-87b6-4d3e-92c3-fa1922e75487 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:18:50.680146 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.policy [None req-345bb8c8-87b6-4d3e-92c3-fa1922e75487 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb28547f4b54c4097d2ffc3c533ca67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42af08ef367945939b1f59ffa8af351a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120798) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:18:50.688706 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.policy [None req-345bb8c8-87b6-4d3e-92c3-fa1922e75487 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4fb28547f4b54c4097d2ffc3c533ca67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42af08ef367945939b1f59ffa8af351a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120798) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:18:50.690834 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.policy [None req-345bb8c8-87b6-4d3e-92c3-fa1922e75487 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4fb28547f4b54c4097d2ffc3c533ca67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42af08ef367945939b1f59ffa8af351a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120798) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:18:50.692585 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [None req-345bb8c8-87b6-4d3e-92c3-fa1922e75487 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] 10.222.0.17 "GET /compute/v2.1/servers/d1a4fd6e-9323-416e-b844-5e526565774e" status: 200 len: 1720 microversion: 2.20 time: 0.178263 Aug 23 07:18:50.693164 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 336/695] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Aug 23 07:18:50 2022] GET /compute/v2.1/servers/d1a4fd6e-9323-416e-b844-5e526565774e => generated 1720 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 07:18:50.783443 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-25d328ce-f670-4f57-a4ab-a846359ae1a4 tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] Calling method '>' {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:18:50.784086 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.compute.api [None req-25d328ce-f670-4f57-a4ab-a846359ae1a4 tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] [instance: 0c761eab-49ac-4396-9907-70845ad75c64] Fetching instance by UUID {{(pid=120799) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:18:50.790866 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-25d328ce-f670-4f57-a4ab-a846359ae1a4 tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:18:50.791347 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-25d328ce-f670-4f57-a4ab-a846359ae1a4 tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:18:50.791793 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-25d328ce-f670-4f57-a4ab-a846359ae1a4 tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:18:50.792474 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-25d328ce-f670-4f57-a4ab-a846359ae1a4 tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:18:50.792913 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-25d328ce-f670-4f57-a4ab-a846359ae1a4 tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:18:50.793328 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-25d328ce-f670-4f57-a4ab-a846359ae1a4 tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:18:50.836438 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-001a208a-b2ca-46f9-8f82-e26a45312817 tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Calling method '>' {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:18:50.837034 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.compute.api [None req-001a208a-b2ca-46f9-8f82-e26a45312817 tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] [instance: 19beb62f-fdd9-4e6c-9d20-2abc3b5dfd16] Fetching instance by UUID {{(pid=120798) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:18:50.843745 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-001a208a-b2ca-46f9-8f82-e26a45312817 tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:18:50.844228 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-001a208a-b2ca-46f9-8f82-e26a45312817 tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:18:50.844656 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-001a208a-b2ca-46f9-8f82-e26a45312817 tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:18:50.845339 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-001a208a-b2ca-46f9-8f82-e26a45312817 tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:18:50.846091 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-001a208a-b2ca-46f9-8f82-e26a45312817 tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:18:50.846326 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-001a208a-b2ca-46f9-8f82-e26a45312817 tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:18:50.971306 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.policy [None req-25d328ce-f670-4f57-a4ab-a846359ae1a4 tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c26232f042844a898c19d1f63152b428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd004facbaed41a7a54a3ed6a6a44305', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120799) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:18:50.980167 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-25d328ce-f670-4f57-a4ab-a846359ae1a4 tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] 10.222.0.17 "GET /compute/v2.1/servers/0c761eab-49ac-4396-9907-70845ad75c64" status: 200 len: 1572 microversion: 2.1 time: 0.200727 Aug 23 07:18:50.980718 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 360/696] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:18:50 2022] GET /compute/v2.1/servers/0c761eab-49ac-4396-9907-70845ad75c64 => generated 1572 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:18:51.008380 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.policy [None req-001a208a-b2ca-46f9-8f82-e26a45312817 tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffd12f09606b4e6ba12f63b976df1884', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43b271d00f74eb7aa3d0719315c5a99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120798) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:18:51.016553 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [None req-001a208a-b2ca-46f9-8f82-e26a45312817 tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] 10.222.0.17 "GET /compute/v2.1/servers/19beb62f-fdd9-4e6c-9d20-2abc3b5dfd16" status: 200 len: 1266 microversion: 2.1 time: 0.184187 Aug 23 07:18:51.017109 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 337/697] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:18:50 2022] GET /compute/v2.1/servers/19beb62f-fdd9-4e6c-9d20-2abc3b5dfd16 => generated 1266 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:18:51.716241 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-2163b08f-8e28-4ae4-bae1-b3b2f8a499d9 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Calling method '>' {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:18:51.716746 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.compute.api [None req-2163b08f-8e28-4ae4-bae1-b3b2f8a499d9 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] [instance: d1a4fd6e-9323-416e-b844-5e526565774e] Fetching instance by UUID {{(pid=120799) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:18:51.723138 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-2163b08f-8e28-4ae4-bae1-b3b2f8a499d9 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:18:51.723718 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-2163b08f-8e28-4ae4-bae1-b3b2f8a499d9 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:18:51.724147 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-2163b08f-8e28-4ae4-bae1-b3b2f8a499d9 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:18:51.724831 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-2163b08f-8e28-4ae4-bae1-b3b2f8a499d9 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:18:51.725299 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-2163b08f-8e28-4ae4-bae1-b3b2f8a499d9 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:18:51.725701 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-2163b08f-8e28-4ae4-bae1-b3b2f8a499d9 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:18:51.861004 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.policy [None req-2163b08f-8e28-4ae4-bae1-b3b2f8a499d9 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb28547f4b54c4097d2ffc3c533ca67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42af08ef367945939b1f59ffa8af351a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120799) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:18:51.871473 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.policy [None req-2163b08f-8e28-4ae4-bae1-b3b2f8a499d9 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4fb28547f4b54c4097d2ffc3c533ca67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42af08ef367945939b1f59ffa8af351a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120799) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:18:51.873042 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.policy [None req-2163b08f-8e28-4ae4-bae1-b3b2f8a499d9 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4fb28547f4b54c4097d2ffc3c533ca67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42af08ef367945939b1f59ffa8af351a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120799) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:18:51.874205 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-2163b08f-8e28-4ae4-bae1-b3b2f8a499d9 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] 10.222.0.17 "GET /compute/v2.1/servers/d1a4fd6e-9323-416e-b844-5e526565774e" status: 200 len: 1720 microversion: 2.20 time: 0.162318 Aug 23 07:18:51.874761 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 361/698] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Aug 23 07:18:51 2022] GET /compute/v2.1/servers/d1a4fd6e-9323-416e-b844-5e526565774e => generated 1720 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 07:18:52.000996 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-47f3a634-c337-43f1-9d79-183f9dc8799e tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] Calling method '>' {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:18:52.002163 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.compute.api [None req-47f3a634-c337-43f1-9d79-183f9dc8799e tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] [instance: 0c761eab-49ac-4396-9907-70845ad75c64] Fetching instance by UUID {{(pid=120798) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:18:52.009557 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-47f3a634-c337-43f1-9d79-183f9dc8799e tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:18:52.010263 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-47f3a634-c337-43f1-9d79-183f9dc8799e tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:18:52.010970 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-47f3a634-c337-43f1-9d79-183f9dc8799e tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:18:52.011684 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-47f3a634-c337-43f1-9d79-183f9dc8799e tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:18:52.012304 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-47f3a634-c337-43f1-9d79-183f9dc8799e tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:18:52.012720 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-47f3a634-c337-43f1-9d79-183f9dc8799e tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:18:52.038162 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-10d64778-b6cd-4773-8504-3642d3e285c0 tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Calling method '>' {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:18:52.038769 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.compute.api [None req-10d64778-b6cd-4773-8504-3642d3e285c0 tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] [instance: 19beb62f-fdd9-4e6c-9d20-2abc3b5dfd16] Fetching instance by UUID {{(pid=120799) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:18:52.044812 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-10d64778-b6cd-4773-8504-3642d3e285c0 tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:18:52.045291 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-10d64778-b6cd-4773-8504-3642d3e285c0 tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:18:52.045718 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-10d64778-b6cd-4773-8504-3642d3e285c0 tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:18:52.046422 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-10d64778-b6cd-4773-8504-3642d3e285c0 tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:18:52.046870 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-10d64778-b6cd-4773-8504-3642d3e285c0 tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:18:52.047287 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-10d64778-b6cd-4773-8504-3642d3e285c0 tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:18:52.290269 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.policy [None req-47f3a634-c337-43f1-9d79-183f9dc8799e tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c26232f042844a898c19d1f63152b428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd004facbaed41a7a54a3ed6a6a44305', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120798) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:18:52.293683 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.policy [None req-10d64778-b6cd-4773-8504-3642d3e285c0 tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffd12f09606b4e6ba12f63b976df1884', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43b271d00f74eb7aa3d0719315c5a99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120799) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:18:52.302930 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-10d64778-b6cd-4773-8504-3642d3e285c0 tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] 10.222.0.17 "GET /compute/v2.1/servers/19beb62f-fdd9-4e6c-9d20-2abc3b5dfd16" status: 200 len: 1266 microversion: 2.1 time: 0.268966 Aug 23 07:18:52.315449 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 362/699] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:18:52 2022] GET /compute/v2.1/servers/19beb62f-fdd9-4e6c-9d20-2abc3b5dfd16 => generated 1266 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 07:18:52.320872 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [None req-47f3a634-c337-43f1-9d79-183f9dc8799e tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] 10.222.0.17 "GET /compute/v2.1/servers/0c761eab-49ac-4396-9907-70845ad75c64" status: 200 len: 1572 microversion: 2.1 time: 0.322855 Aug 23 07:18:52.321479 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 338/700] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:18:51 2022] GET /compute/v2.1/servers/0c761eab-49ac-4396-9907-70845ad75c64 => generated 1572 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:18:52.897377 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-59496ce2-67bd-47ec-aeb2-b53357367a8d tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Calling method '>' {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:18:52.898054 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.compute.api [None req-59496ce2-67bd-47ec-aeb2-b53357367a8d tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] [instance: d1a4fd6e-9323-416e-b844-5e526565774e] Fetching instance by UUID {{(pid=120799) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:18:52.905453 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-59496ce2-67bd-47ec-aeb2-b53357367a8d tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:18:52.905936 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-59496ce2-67bd-47ec-aeb2-b53357367a8d tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:18:52.906366 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-59496ce2-67bd-47ec-aeb2-b53357367a8d tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:18:52.907060 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-59496ce2-67bd-47ec-aeb2-b53357367a8d tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:18:52.907534 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-59496ce2-67bd-47ec-aeb2-b53357367a8d tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:18:52.907956 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-59496ce2-67bd-47ec-aeb2-b53357367a8d tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:18:53.091750 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.policy [None req-59496ce2-67bd-47ec-aeb2-b53357367a8d tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb28547f4b54c4097d2ffc3c533ca67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42af08ef367945939b1f59ffa8af351a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120799) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:18:53.100657 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.policy [None req-59496ce2-67bd-47ec-aeb2-b53357367a8d tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4fb28547f4b54c4097d2ffc3c533ca67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42af08ef367945939b1f59ffa8af351a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120799) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:18:53.102192 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.policy [None req-59496ce2-67bd-47ec-aeb2-b53357367a8d tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4fb28547f4b54c4097d2ffc3c533ca67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42af08ef367945939b1f59ffa8af351a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120799) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:18:53.103324 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-59496ce2-67bd-47ec-aeb2-b53357367a8d tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] 10.222.0.17 "GET /compute/v2.1/servers/d1a4fd6e-9323-416e-b844-5e526565774e" status: 200 len: 1720 microversion: 2.20 time: 0.210111 Aug 23 07:18:53.103930 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 363/701] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Aug 23 07:18:52 2022] GET /compute/v2.1/servers/d1a4fd6e-9323-416e-b844-5e526565774e => generated 1720 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 07:18:53.327477 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-da4d0d7a-cd0b-4b9a-a384-cfb5013fa15b tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Calling method '>' {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:18:53.328119 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.compute.api [None req-da4d0d7a-cd0b-4b9a-a384-cfb5013fa15b tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] [instance: 19beb62f-fdd9-4e6c-9d20-2abc3b5dfd16] Fetching instance by UUID {{(pid=120798) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:18:53.339078 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-da4d0d7a-cd0b-4b9a-a384-cfb5013fa15b tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:18:53.339960 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-da4d0d7a-cd0b-4b9a-a384-cfb5013fa15b tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:18:53.340765 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-da4d0d7a-cd0b-4b9a-a384-cfb5013fa15b tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:18:53.341725 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-da4d0d7a-cd0b-4b9a-a384-cfb5013fa15b tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:18:53.342376 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-da4d0d7a-cd0b-4b9a-a384-cfb5013fa15b tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:18:53.342581 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-5ba1f91c-fa2a-484d-a1c2-7a56ef3c7f45 tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] Calling method '>' {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:18:53.343139 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-da4d0d7a-cd0b-4b9a-a384-cfb5013fa15b tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:18:53.343668 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.compute.api [None req-5ba1f91c-fa2a-484d-a1c2-7a56ef3c7f45 tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] [instance: 0c761eab-49ac-4396-9907-70845ad75c64] Fetching instance by UUID {{(pid=120799) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:18:53.350228 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-5ba1f91c-fa2a-484d-a1c2-7a56ef3c7f45 tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:18:53.350733 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-5ba1f91c-fa2a-484d-a1c2-7a56ef3c7f45 tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:18:53.351244 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-5ba1f91c-fa2a-484d-a1c2-7a56ef3c7f45 tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:18:53.351968 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-5ba1f91c-fa2a-484d-a1c2-7a56ef3c7f45 tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:18:53.352610 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-5ba1f91c-fa2a-484d-a1c2-7a56ef3c7f45 tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:18:53.353036 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-5ba1f91c-fa2a-484d-a1c2-7a56ef3c7f45 tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:18:53.552691 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.policy [None req-da4d0d7a-cd0b-4b9a-a384-cfb5013fa15b tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffd12f09606b4e6ba12f63b976df1884', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43b271d00f74eb7aa3d0719315c5a99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120798) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:18:53.560783 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [None req-da4d0d7a-cd0b-4b9a-a384-cfb5013fa15b tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] 10.222.0.17 "GET /compute/v2.1/servers/19beb62f-fdd9-4e6c-9d20-2abc3b5dfd16" status: 200 len: 1266 microversion: 2.1 time: 0.237224 Aug 23 07:18:53.561361 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 339/702] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:18:53 2022] GET /compute/v2.1/servers/19beb62f-fdd9-4e6c-9d20-2abc3b5dfd16 => generated 1266 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:18:53.563269 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.policy [None req-5ba1f91c-fa2a-484d-a1c2-7a56ef3c7f45 tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c26232f042844a898c19d1f63152b428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd004facbaed41a7a54a3ed6a6a44305', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120799) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:18:53.580877 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-5ba1f91c-fa2a-484d-a1c2-7a56ef3c7f45 tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] 10.222.0.17 "GET /compute/v2.1/servers/0c761eab-49ac-4396-9907-70845ad75c64" status: 200 len: 1559 microversion: 2.1 time: 0.242274 Aug 23 07:18:53.581601 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 364/703] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:18:53 2022] GET /compute/v2.1/servers/0c761eab-49ac-4396-9907-70845ad75c64 => generated 1559 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:18:54.126644 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-14f7b7b7-acb6-490a-8d83-92ed9e66d6bc tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Calling method '>' {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:18:54.127262 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.compute.api [None req-14f7b7b7-acb6-490a-8d83-92ed9e66d6bc tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] [instance: d1a4fd6e-9323-416e-b844-5e526565774e] Fetching instance by UUID {{(pid=120798) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:18:54.133681 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-14f7b7b7-acb6-490a-8d83-92ed9e66d6bc tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:18:54.134163 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-14f7b7b7-acb6-490a-8d83-92ed9e66d6bc tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:18:54.134596 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-14f7b7b7-acb6-490a-8d83-92ed9e66d6bc tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:18:54.135449 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-14f7b7b7-acb6-490a-8d83-92ed9e66d6bc tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:18:54.135909 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-14f7b7b7-acb6-490a-8d83-92ed9e66d6bc tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:18:54.136326 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-14f7b7b7-acb6-490a-8d83-92ed9e66d6bc tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:18:54.270614 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.policy [None req-14f7b7b7-acb6-490a-8d83-92ed9e66d6bc tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb28547f4b54c4097d2ffc3c533ca67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42af08ef367945939b1f59ffa8af351a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120798) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:18:54.278945 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.policy [None req-14f7b7b7-acb6-490a-8d83-92ed9e66d6bc tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4fb28547f4b54c4097d2ffc3c533ca67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42af08ef367945939b1f59ffa8af351a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120798) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:18:54.280458 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.policy [None req-14f7b7b7-acb6-490a-8d83-92ed9e66d6bc tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4fb28547f4b54c4097d2ffc3c533ca67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42af08ef367945939b1f59ffa8af351a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120798) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:18:54.281653 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [None req-14f7b7b7-acb6-490a-8d83-92ed9e66d6bc tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] 10.222.0.17 "GET /compute/v2.1/servers/d1a4fd6e-9323-416e-b844-5e526565774e" status: 200 len: 1720 microversion: 2.20 time: 0.159095 Aug 23 07:18:54.282425 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 340/704] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Aug 23 07:18:54 2022] GET /compute/v2.1/servers/d1a4fd6e-9323-416e-b844-5e526565774e => generated 1720 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 07:18:54.582288 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-591cc1d0-224b-4b75-8d50-904119d85608 tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Calling method '>' {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:18:54.582900 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.compute.api [None req-591cc1d0-224b-4b75-8d50-904119d85608 tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] [instance: 19beb62f-fdd9-4e6c-9d20-2abc3b5dfd16] Fetching instance by UUID {{(pid=120799) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:18:54.585522 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG dbcounter [-] [120799] Writing DB stats nova_cell0:SELECT=2 {{(pid=120799) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:18:54.586174 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG dbcounter [-] [120799] Writing DB stats nova_cell0:SELECT=6 {{(pid=120799) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:18:54.592116 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-591cc1d0-224b-4b75-8d50-904119d85608 tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:18:54.592597 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-591cc1d0-224b-4b75-8d50-904119d85608 tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:18:54.593023 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-591cc1d0-224b-4b75-8d50-904119d85608 tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:18:54.593713 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-591cc1d0-224b-4b75-8d50-904119d85608 tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:18:54.594145 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-591cc1d0-224b-4b75-8d50-904119d85608 tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:18:54.594583 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-591cc1d0-224b-4b75-8d50-904119d85608 tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:18:54.732909 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.policy [None req-591cc1d0-224b-4b75-8d50-904119d85608 tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffd12f09606b4e6ba12f63b976df1884', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43b271d00f74eb7aa3d0719315c5a99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120799) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:18:54.741472 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-591cc1d0-224b-4b75-8d50-904119d85608 tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] 10.222.0.17 "GET /compute/v2.1/servers/19beb62f-fdd9-4e6c-9d20-2abc3b5dfd16" status: 200 len: 1266 microversion: 2.1 time: 0.163298 Aug 23 07:18:54.742052 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 365/705] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:18:54 2022] GET /compute/v2.1/servers/19beb62f-fdd9-4e6c-9d20-2abc3b5dfd16 => generated 1266 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:18:55.306377 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-65c1ad5a-514d-4370-812c-51dd92189712 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Calling method '>' {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:18:55.307919 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.compute.api [None req-65c1ad5a-514d-4370-812c-51dd92189712 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] [instance: d1a4fd6e-9323-416e-b844-5e526565774e] Fetching instance by UUID {{(pid=120798) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:18:55.315063 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG dbcounter [-] [120798] Writing DB stats nova_cell0:SELECT=2 {{(pid=120798) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:18:55.316817 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-65c1ad5a-514d-4370-812c-51dd92189712 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:18:55.317817 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-65c1ad5a-514d-4370-812c-51dd92189712 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:18:55.318109 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-65c1ad5a-514d-4370-812c-51dd92189712 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:18:55.318823 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-65c1ad5a-514d-4370-812c-51dd92189712 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:18:55.319441 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-65c1ad5a-514d-4370-812c-51dd92189712 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:18:55.320247 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-65c1ad5a-514d-4370-812c-51dd92189712 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:18:55.470429 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.policy [None req-65c1ad5a-514d-4370-812c-51dd92189712 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb28547f4b54c4097d2ffc3c533ca67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42af08ef367945939b1f59ffa8af351a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120798) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:18:55.479590 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.policy [None req-65c1ad5a-514d-4370-812c-51dd92189712 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4fb28547f4b54c4097d2ffc3c533ca67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42af08ef367945939b1f59ffa8af351a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120798) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:18:55.481073 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.policy [None req-65c1ad5a-514d-4370-812c-51dd92189712 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4fb28547f4b54c4097d2ffc3c533ca67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42af08ef367945939b1f59ffa8af351a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120798) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:18:55.482231 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [None req-65c1ad5a-514d-4370-812c-51dd92189712 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] 10.222.0.17 "GET /compute/v2.1/servers/d1a4fd6e-9323-416e-b844-5e526565774e" status: 200 len: 1720 microversion: 2.20 time: 0.181112 Aug 23 07:18:55.482768 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 341/706] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Aug 23 07:18:55 2022] GET /compute/v2.1/servers/d1a4fd6e-9323-416e-b844-5e526565774e => generated 1720 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 07:18:55.765677 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-b5c3b54e-920b-4525-ab9b-932d8be84c93 tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Calling method '>' {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:18:55.766418 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.compute.api [None req-b5c3b54e-920b-4525-ab9b-932d8be84c93 tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] [instance: 19beb62f-fdd9-4e6c-9d20-2abc3b5dfd16] Fetching instance by UUID {{(pid=120799) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:18:55.773183 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-b5c3b54e-920b-4525-ab9b-932d8be84c93 tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:18:55.773661 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-b5c3b54e-920b-4525-ab9b-932d8be84c93 tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:18:55.774090 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-b5c3b54e-920b-4525-ab9b-932d8be84c93 tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:18:55.774782 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-b5c3b54e-920b-4525-ab9b-932d8be84c93 tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:18:55.775231 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-b5c3b54e-920b-4525-ab9b-932d8be84c93 tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:18:55.775862 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-b5c3b54e-920b-4525-ab9b-932d8be84c93 tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:18:55.921566 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.policy [None req-b5c3b54e-920b-4525-ab9b-932d8be84c93 tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffd12f09606b4e6ba12f63b976df1884', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43b271d00f74eb7aa3d0719315c5a99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120799) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:18:55.930048 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-b5c3b54e-920b-4525-ab9b-932d8be84c93 tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] 10.222.0.17 "GET /compute/v2.1/servers/19beb62f-fdd9-4e6c-9d20-2abc3b5dfd16" status: 200 len: 1266 microversion: 2.1 time: 0.169220 Aug 23 07:18:55.930618 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 366/707] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:18:55 2022] GET /compute/v2.1/servers/19beb62f-fdd9-4e6c-9d20-2abc3b5dfd16 => generated 1266 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:18:56.505682 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-9cd9a755-7a2d-442a-a480-2d10a3b93f54 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Calling method '>' {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:18:56.506310 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.compute.api [None req-9cd9a755-7a2d-442a-a480-2d10a3b93f54 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] [instance: d1a4fd6e-9323-416e-b844-5e526565774e] Fetching instance by UUID {{(pid=120798) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:18:56.512836 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-9cd9a755-7a2d-442a-a480-2d10a3b93f54 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:18:56.513315 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-9cd9a755-7a2d-442a-a480-2d10a3b93f54 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:18:56.513739 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-9cd9a755-7a2d-442a-a480-2d10a3b93f54 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:18:56.514422 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-9cd9a755-7a2d-442a-a480-2d10a3b93f54 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:18:56.514864 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-9cd9a755-7a2d-442a-a480-2d10a3b93f54 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:18:56.515279 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-9cd9a755-7a2d-442a-a480-2d10a3b93f54 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:18:56.654667 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.policy [None req-9cd9a755-7a2d-442a-a480-2d10a3b93f54 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb28547f4b54c4097d2ffc3c533ca67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42af08ef367945939b1f59ffa8af351a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120798) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:18:56.663046 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.policy [None req-9cd9a755-7a2d-442a-a480-2d10a3b93f54 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4fb28547f4b54c4097d2ffc3c533ca67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42af08ef367945939b1f59ffa8af351a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120798) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:18:56.664567 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.policy [None req-9cd9a755-7a2d-442a-a480-2d10a3b93f54 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4fb28547f4b54c4097d2ffc3c533ca67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42af08ef367945939b1f59ffa8af351a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120798) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:18:56.665808 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [None req-9cd9a755-7a2d-442a-a480-2d10a3b93f54 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] 10.222.0.17 "GET /compute/v2.1/servers/d1a4fd6e-9323-416e-b844-5e526565774e" status: 200 len: 1720 microversion: 2.20 time: 0.164213 Aug 23 07:18:56.666362 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 342/708] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Aug 23 07:18:56 2022] GET /compute/v2.1/servers/d1a4fd6e-9323-416e-b844-5e526565774e => generated 1720 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 07:18:56.950737 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-ce8fcf4f-bf22-4466-8398-9efeb3b10632 tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Calling method '>' {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:18:56.952039 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.compute.api [None req-ce8fcf4f-bf22-4466-8398-9efeb3b10632 tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] [instance: 19beb62f-fdd9-4e6c-9d20-2abc3b5dfd16] Fetching instance by UUID {{(pid=120799) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:18:56.959359 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-ce8fcf4f-bf22-4466-8398-9efeb3b10632 tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:18:56.960280 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-ce8fcf4f-bf22-4466-8398-9efeb3b10632 tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:18:56.961184 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-ce8fcf4f-bf22-4466-8398-9efeb3b10632 tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:18:56.962072 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-ce8fcf4f-bf22-4466-8398-9efeb3b10632 tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:18:56.963130 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-ce8fcf4f-bf22-4466-8398-9efeb3b10632 tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:18:56.963795 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-ce8fcf4f-bf22-4466-8398-9efeb3b10632 tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:18:57.148240 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.policy [None req-ce8fcf4f-bf22-4466-8398-9efeb3b10632 tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffd12f09606b4e6ba12f63b976df1884', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43b271d00f74eb7aa3d0719315c5a99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120799) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:18:57.157168 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-ce8fcf4f-bf22-4466-8398-9efeb3b10632 tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] 10.222.0.17 "GET /compute/v2.1/servers/19beb62f-fdd9-4e6c-9d20-2abc3b5dfd16" status: 200 len: 1266 microversion: 2.1 time: 0.210710 Aug 23 07:18:57.158284 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 367/709] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:18:56 2022] GET /compute/v2.1/servers/19beb62f-fdd9-4e6c-9d20-2abc3b5dfd16 => generated 1266 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:18:57.213120 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [req-ddc2fcdb-a888-45d0-adec-77aa2286ba6d req-2aebff57-0d2a-49df-b39a-ff1fc4a9485d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0c761eab-49ac-4396-9907-70845ad75c64", "name": "network-vif-plugged", "status": "completed", "tag": "bb18fb15-817d-4f8a-9e7c-652d111e0cd7"}]} {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 07:18:57.222603 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [req-ddc2fcdb-a888-45d0-adec-77aa2286ba6d req-2aebff57-0d2a-49df-b39a-ff1fc4a9485d service nova] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:18:57.223241 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [req-ddc2fcdb-a888-45d0-adec-77aa2286ba6d req-2aebff57-0d2a-49df-b39a-ff1fc4a9485d service nova] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:18:57.223856 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [req-ddc2fcdb-a888-45d0-adec-77aa2286ba6d req-2aebff57-0d2a-49df-b39a-ff1fc4a9485d service nova] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:18:57.238499 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.compute.server_external_events [req-ddc2fcdb-a888-45d0-adec-77aa2286ba6d req-2aebff57-0d2a-49df-b39a-ff1fc4a9485d service nova] Creating event network-vif-plugged:bb18fb15-817d-4f8a-9e7c-652d111e0cd7 for instance 0c761eab-49ac-4396-9907-70845ad75c64 on hv-cinder-85409 Aug 23 07:18:57.244300 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [req-ddc2fcdb-a888-45d0-adec-77aa2286ba6d req-2aebff57-0d2a-49df-b39a-ff1fc4a9485d service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035722 Aug 23 07:18:57.245184 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 343/710] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Aug 23 07:18:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 07:18:57.693199 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-38ea4cee-40ae-4428-b6ee-55e1c97c38e3 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Calling method '>' {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:18:57.694151 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.compute.api [None req-38ea4cee-40ae-4428-b6ee-55e1c97c38e3 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] [instance: d1a4fd6e-9323-416e-b844-5e526565774e] Fetching instance by UUID {{(pid=120799) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:18:57.700695 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-38ea4cee-40ae-4428-b6ee-55e1c97c38e3 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:18:57.701178 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-38ea4cee-40ae-4428-b6ee-55e1c97c38e3 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:18:57.701614 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-38ea4cee-40ae-4428-b6ee-55e1c97c38e3 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:18:57.702298 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-38ea4cee-40ae-4428-b6ee-55e1c97c38e3 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:18:57.702917 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-38ea4cee-40ae-4428-b6ee-55e1c97c38e3 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:18:57.703334 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-38ea4cee-40ae-4428-b6ee-55e1c97c38e3 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:18:57.858054 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.policy [None req-38ea4cee-40ae-4428-b6ee-55e1c97c38e3 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb28547f4b54c4097d2ffc3c533ca67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42af08ef367945939b1f59ffa8af351a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120799) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:18:57.867158 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.policy [None req-38ea4cee-40ae-4428-b6ee-55e1c97c38e3 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4fb28547f4b54c4097d2ffc3c533ca67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42af08ef367945939b1f59ffa8af351a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120799) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:18:57.871373 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.policy [None req-38ea4cee-40ae-4428-b6ee-55e1c97c38e3 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4fb28547f4b54c4097d2ffc3c533ca67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42af08ef367945939b1f59ffa8af351a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120799) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:18:57.871373 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-38ea4cee-40ae-4428-b6ee-55e1c97c38e3 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] 10.222.0.17 "GET /compute/v2.1/servers/d1a4fd6e-9323-416e-b844-5e526565774e" status: 200 len: 1720 microversion: 2.20 time: 0.183275 Aug 23 07:18:57.871373 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 368/711] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Aug 23 07:18:57 2022] GET /compute/v2.1/servers/d1a4fd6e-9323-416e-b844-5e526565774e => generated 1720 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 07:18:58.181830 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-b707b537-4750-466d-8bbe-04e0e8089541 tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Calling method '>' {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:18:58.182470 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.compute.api [None req-b707b537-4750-466d-8bbe-04e0e8089541 tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] [instance: 19beb62f-fdd9-4e6c-9d20-2abc3b5dfd16] Fetching instance by UUID {{(pid=120798) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:18:58.192385 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-b707b537-4750-466d-8bbe-04e0e8089541 tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:18:58.193102 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-b707b537-4750-466d-8bbe-04e0e8089541 tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:18:58.193855 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-b707b537-4750-466d-8bbe-04e0e8089541 tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:18:58.194726 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-b707b537-4750-466d-8bbe-04e0e8089541 tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:18:58.195201 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-b707b537-4750-466d-8bbe-04e0e8089541 tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:18:58.195805 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-b707b537-4750-466d-8bbe-04e0e8089541 tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:18:58.426315 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.policy [None req-b707b537-4750-466d-8bbe-04e0e8089541 tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffd12f09606b4e6ba12f63b976df1884', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43b271d00f74eb7aa3d0719315c5a99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120798) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:18:58.434879 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [None req-b707b537-4750-466d-8bbe-04e0e8089541 tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] 10.222.0.17 "GET /compute/v2.1/servers/19beb62f-fdd9-4e6c-9d20-2abc3b5dfd16" status: 200 len: 1266 microversion: 2.1 time: 0.259651 Aug 23 07:18:58.435730 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 344/712] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:18:58 2022] GET /compute/v2.1/servers/19beb62f-fdd9-4e6c-9d20-2abc3b5dfd16 => generated 1266 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:18:58.893962 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-42e09834-e9c6-4a6a-a559-57ffccffd425 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Calling method '>' {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:18:58.896104 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.compute.api [None req-42e09834-e9c6-4a6a-a559-57ffccffd425 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] [instance: d1a4fd6e-9323-416e-b844-5e526565774e] Fetching instance by UUID {{(pid=120799) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:18:58.902806 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-42e09834-e9c6-4a6a-a559-57ffccffd425 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:18:58.903453 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-42e09834-e9c6-4a6a-a559-57ffccffd425 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:18:58.903839 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-42e09834-e9c6-4a6a-a559-57ffccffd425 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:18:58.904544 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-42e09834-e9c6-4a6a-a559-57ffccffd425 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:18:58.905194 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-42e09834-e9c6-4a6a-a559-57ffccffd425 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:18:58.905764 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-42e09834-e9c6-4a6a-a559-57ffccffd425 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:18:59.062655 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.policy [None req-42e09834-e9c6-4a6a-a559-57ffccffd425 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb28547f4b54c4097d2ffc3c533ca67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42af08ef367945939b1f59ffa8af351a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120799) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:18:59.073431 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.policy [None req-42e09834-e9c6-4a6a-a559-57ffccffd425 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4fb28547f4b54c4097d2ffc3c533ca67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42af08ef367945939b1f59ffa8af351a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120799) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:18:59.076783 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.policy [None req-42e09834-e9c6-4a6a-a559-57ffccffd425 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4fb28547f4b54c4097d2ffc3c533ca67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42af08ef367945939b1f59ffa8af351a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120799) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:18:59.078157 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-42e09834-e9c6-4a6a-a559-57ffccffd425 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] 10.222.0.17 "GET /compute/v2.1/servers/d1a4fd6e-9323-416e-b844-5e526565774e" status: 200 len: 1741 microversion: 2.20 time: 0.188584 Aug 23 07:18:59.079358 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 369/713] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Aug 23 07:18:58 2022] GET /compute/v2.1/servers/d1a4fd6e-9323-416e-b844-5e526565774e => generated 1741 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 07:18:59.262687 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [req-06d556f5-d295-48b3-819f-a00ed3cec930 req-7dafa705-4d0d-4752-b727-6dc62232a1bd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "19beb62f-fdd9-4e6c-9d20-2abc3b5dfd16", "name": "network-vif-plugged", "status": "completed", "tag": "22874e03-587e-473a-8f08-37ed4393d34c"}]} {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 07:18:59.272669 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [req-06d556f5-d295-48b3-819f-a00ed3cec930 req-7dafa705-4d0d-4752-b727-6dc62232a1bd service nova] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:18:59.273160 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [req-06d556f5-d295-48b3-819f-a00ed3cec930 req-7dafa705-4d0d-4752-b727-6dc62232a1bd service nova] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:18:59.273602 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [req-06d556f5-d295-48b3-819f-a00ed3cec930 req-7dafa705-4d0d-4752-b727-6dc62232a1bd service nova] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:18:59.284362 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.compute.server_external_events [req-06d556f5-d295-48b3-819f-a00ed3cec930 req-7dafa705-4d0d-4752-b727-6dc62232a1bd service nova] Creating event network-vif-plugged:22874e03-587e-473a-8f08-37ed4393d34c for instance 19beb62f-fdd9-4e6c-9d20-2abc3b5dfd16 on hv-cinder-85409 Aug 23 07:18:59.289663 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [req-06d556f5-d295-48b3-819f-a00ed3cec930 req-7dafa705-4d0d-4752-b727-6dc62232a1bd service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030848 Aug 23 07:18:59.290314 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 345/714] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Aug 23 07:18:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 07:18:59.459531 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-6391217c-f8b0-4ae0-aa31-e3f4150c8983 tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Calling method '>' {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:18:59.460202 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.compute.api [None req-6391217c-f8b0-4ae0-aa31-e3f4150c8983 tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] [instance: 19beb62f-fdd9-4e6c-9d20-2abc3b5dfd16] Fetching instance by UUID {{(pid=120799) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:18:59.466603 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-6391217c-f8b0-4ae0-aa31-e3f4150c8983 tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:18:59.467349 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-6391217c-f8b0-4ae0-aa31-e3f4150c8983 tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:18:59.467796 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-6391217c-f8b0-4ae0-aa31-e3f4150c8983 tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:18:59.468484 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-6391217c-f8b0-4ae0-aa31-e3f4150c8983 tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:18:59.468925 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-6391217c-f8b0-4ae0-aa31-e3f4150c8983 tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:18:59.469335 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-6391217c-f8b0-4ae0-aa31-e3f4150c8983 tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:18:59.735571 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.policy [None req-6391217c-f8b0-4ae0-aa31-e3f4150c8983 tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffd12f09606b4e6ba12f63b976df1884', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43b271d00f74eb7aa3d0719315c5a99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120799) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:18:59.743854 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-6391217c-f8b0-4ae0-aa31-e3f4150c8983 tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] 10.222.0.17 "GET /compute/v2.1/servers/19beb62f-fdd9-4e6c-9d20-2abc3b5dfd16" status: 200 len: 1266 microversion: 2.1 time: 0.288778 Aug 23 07:18:59.744555 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 370/715] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:18:59 2022] GET /compute/v2.1/servers/19beb62f-fdd9-4e6c-9d20-2abc3b5dfd16 => generated 1266 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:19:00.109678 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-eb6891db-ac71-46cb-8e2a-55a3f9b4e027 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Calling method '>' {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:19:00.110840 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.compute.api [None req-eb6891db-ac71-46cb-8e2a-55a3f9b4e027 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] [instance: d1a4fd6e-9323-416e-b844-5e526565774e] Fetching instance by UUID {{(pid=120798) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:19:00.126085 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-eb6891db-ac71-46cb-8e2a-55a3f9b4e027 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:19:00.126573 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-eb6891db-ac71-46cb-8e2a-55a3f9b4e027 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:19:00.127060 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-eb6891db-ac71-46cb-8e2a-55a3f9b4e027 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:19:00.127972 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-eb6891db-ac71-46cb-8e2a-55a3f9b4e027 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:19:00.128440 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-eb6891db-ac71-46cb-8e2a-55a3f9b4e027 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:19:00.128969 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-eb6891db-ac71-46cb-8e2a-55a3f9b4e027 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:19:00.275922 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.policy [None req-eb6891db-ac71-46cb-8e2a-55a3f9b4e027 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb28547f4b54c4097d2ffc3c533ca67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42af08ef367945939b1f59ffa8af351a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120798) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:19:00.287773 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.policy [None req-eb6891db-ac71-46cb-8e2a-55a3f9b4e027 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4fb28547f4b54c4097d2ffc3c533ca67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42af08ef367945939b1f59ffa8af351a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120798) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:19:00.289501 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.policy [None req-eb6891db-ac71-46cb-8e2a-55a3f9b4e027 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4fb28547f4b54c4097d2ffc3c533ca67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42af08ef367945939b1f59ffa8af351a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120798) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:19:00.290959 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [None req-eb6891db-ac71-46cb-8e2a-55a3f9b4e027 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] 10.222.0.17 "GET /compute/v2.1/servers/d1a4fd6e-9323-416e-b844-5e526565774e" status: 200 len: 1741 microversion: 2.20 time: 0.189831 Aug 23 07:19:00.304420 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 346/716] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Aug 23 07:19:00 2022] GET /compute/v2.1/servers/d1a4fd6e-9323-416e-b844-5e526565774e => generated 1741 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 07:19:00.779208 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-2aed33f6-74ba-401e-8ba9-188816e049aa tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Calling method '>' {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:19:00.779900 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.compute.api [None req-2aed33f6-74ba-401e-8ba9-188816e049aa tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] [instance: 19beb62f-fdd9-4e6c-9d20-2abc3b5dfd16] Fetching instance by UUID {{(pid=120799) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:19:00.787358 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-2aed33f6-74ba-401e-8ba9-188816e049aa tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:19:00.788047 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-2aed33f6-74ba-401e-8ba9-188816e049aa tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:19:00.788812 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-2aed33f6-74ba-401e-8ba9-188816e049aa tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:19:00.789684 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-2aed33f6-74ba-401e-8ba9-188816e049aa tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:19:00.790283 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-2aed33f6-74ba-401e-8ba9-188816e049aa tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:19:00.790853 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-2aed33f6-74ba-401e-8ba9-188816e049aa tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:19:00.930416 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.policy [None req-2aed33f6-74ba-401e-8ba9-188816e049aa tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffd12f09606b4e6ba12f63b976df1884', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43b271d00f74eb7aa3d0719315c5a99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120799) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:19:00.938211 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-2aed33f6-74ba-401e-8ba9-188816e049aa tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] 10.222.0.17 "GET /compute/v2.1/servers/19beb62f-fdd9-4e6c-9d20-2abc3b5dfd16" status: 200 len: 1266 microversion: 2.1 time: 0.176346 Aug 23 07:19:00.938958 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 371/717] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:19:00 2022] GET /compute/v2.1/servers/19beb62f-fdd9-4e6c-9d20-2abc3b5dfd16 => generated 1266 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:19:01.314380 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-e21d917d-be3b-4b82-b6e9-7e5b9e46e287 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Calling method '>' {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:19:01.314984 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.compute.api [None req-e21d917d-be3b-4b82-b6e9-7e5b9e46e287 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] [instance: d1a4fd6e-9323-416e-b844-5e526565774e] Fetching instance by UUID {{(pid=120798) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:19:01.322216 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-e21d917d-be3b-4b82-b6e9-7e5b9e46e287 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:19:01.322706 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-e21d917d-be3b-4b82-b6e9-7e5b9e46e287 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:19:01.323136 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-e21d917d-be3b-4b82-b6e9-7e5b9e46e287 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:19:01.323872 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-e21d917d-be3b-4b82-b6e9-7e5b9e46e287 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:19:01.324315 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-e21d917d-be3b-4b82-b6e9-7e5b9e46e287 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:19:01.324726 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-e21d917d-be3b-4b82-b6e9-7e5b9e46e287 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:19:01.469954 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.policy [None req-e21d917d-be3b-4b82-b6e9-7e5b9e46e287 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb28547f4b54c4097d2ffc3c533ca67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42af08ef367945939b1f59ffa8af351a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120798) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:19:01.478652 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.policy [None req-e21d917d-be3b-4b82-b6e9-7e5b9e46e287 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4fb28547f4b54c4097d2ffc3c533ca67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42af08ef367945939b1f59ffa8af351a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120798) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:19:01.480185 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.policy [None req-e21d917d-be3b-4b82-b6e9-7e5b9e46e287 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4fb28547f4b54c4097d2ffc3c533ca67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42af08ef367945939b1f59ffa8af351a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120798) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:19:01.481424 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [None req-e21d917d-be3b-4b82-b6e9-7e5b9e46e287 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] 10.222.0.17 "GET /compute/v2.1/servers/d1a4fd6e-9323-416e-b844-5e526565774e" status: 200 len: 1736 microversion: 2.20 time: 0.171036 Aug 23 07:19:01.481892 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 347/718] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Aug 23 07:19:01 2022] GET /compute/v2.1/servers/d1a4fd6e-9323-416e-b844-5e526565774e => generated 1736 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 07:19:01.959442 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-3e6685b0-22bc-4205-a8b8-874cecc52101 tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Calling method '>' {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:19:01.960039 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.compute.api [None req-3e6685b0-22bc-4205-a8b8-874cecc52101 tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] [instance: 19beb62f-fdd9-4e6c-9d20-2abc3b5dfd16] Fetching instance by UUID {{(pid=120799) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:19:01.967813 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-3e6685b0-22bc-4205-a8b8-874cecc52101 tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:19:01.968452 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-3e6685b0-22bc-4205-a8b8-874cecc52101 tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:19:01.969030 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-3e6685b0-22bc-4205-a8b8-874cecc52101 tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:19:01.969880 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-3e6685b0-22bc-4205-a8b8-874cecc52101 tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:19:01.970461 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-3e6685b0-22bc-4205-a8b8-874cecc52101 tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:19:01.971024 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-3e6685b0-22bc-4205-a8b8-874cecc52101 tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:19:02.423225 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.policy [None req-3e6685b0-22bc-4205-a8b8-874cecc52101 tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffd12f09606b4e6ba12f63b976df1884', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43b271d00f74eb7aa3d0719315c5a99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120799) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:19:02.432439 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-3e6685b0-22bc-4205-a8b8-874cecc52101 tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] 10.222.0.17 "GET /compute/v2.1/servers/19beb62f-fdd9-4e6c-9d20-2abc3b5dfd16" status: 200 len: 1454 microversion: 2.1 time: 0.476760 Aug 23 07:19:02.433314 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 372/719] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:19:01 2022] GET /compute/v2.1/servers/19beb62f-fdd9-4e6c-9d20-2abc3b5dfd16 => generated 1454 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:19:02.456173 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-7e1620a5-431d-4d96-930b-c94f5df11c0b tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Calling method '>' {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:19:02.457479 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.compute.api [None req-7e1620a5-431d-4d96-930b-c94f5df11c0b tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] [instance: 19beb62f-fdd9-4e6c-9d20-2abc3b5dfd16] Fetching instance by UUID {{(pid=120798) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:19:02.465201 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-7e1620a5-431d-4d96-930b-c94f5df11c0b tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:19:02.465764 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-7e1620a5-431d-4d96-930b-c94f5df11c0b tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:19:02.466265 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-7e1620a5-431d-4d96-930b-c94f5df11c0b tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:19:02.467023 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-7e1620a5-431d-4d96-930b-c94f5df11c0b tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:19:02.467569 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-7e1620a5-431d-4d96-930b-c94f5df11c0b tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:19:02.468255 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-7e1620a5-431d-4d96-930b-c94f5df11c0b tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:19:02.484411 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG dbcounter [-] [120798] Writing DB stats nova_cell1:SELECT=100 {{(pid=120798) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:19:02.506302 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-9f8d0a43-35dd-4f38-9a46-f913ea6a9401 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Calling method '>' {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:19:02.509298 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.compute.api [None req-9f8d0a43-35dd-4f38-9a46-f913ea6a9401 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] [instance: d1a4fd6e-9323-416e-b844-5e526565774e] Fetching instance by UUID {{(pid=120799) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:19:02.512526 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG dbcounter [-] [120799] Writing DB stats nova_api:SELECT=85,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=120799) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:19:02.516817 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-9f8d0a43-35dd-4f38-9a46-f913ea6a9401 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:19:02.517504 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-9f8d0a43-35dd-4f38-9a46-f913ea6a9401 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:19:02.518102 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-9f8d0a43-35dd-4f38-9a46-f913ea6a9401 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:19:02.518949 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-9f8d0a43-35dd-4f38-9a46-f913ea6a9401 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:19:02.519778 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-9f8d0a43-35dd-4f38-9a46-f913ea6a9401 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:19:02.520368 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-9f8d0a43-35dd-4f38-9a46-f913ea6a9401 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:19:02.526697 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG dbcounter [-] [120799] Writing DB stats nova_cell1:INSERT=1,nova_cell1:SELECT=99 {{(pid=120799) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:19:02.677621 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.policy [None req-7e1620a5-431d-4d96-930b-c94f5df11c0b tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffd12f09606b4e6ba12f63b976df1884', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43b271d00f74eb7aa3d0719315c5a99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120798) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:19:02.690800 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [None req-7e1620a5-431d-4d96-930b-c94f5df11c0b tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] 10.222.0.17 "GET /compute/v2.1/servers/19beb62f-fdd9-4e6c-9d20-2abc3b5dfd16" status: 200 len: 1454 microversion: 2.1 time: 0.238703 Aug 23 07:19:02.708341 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 348/720] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:19:02 2022] GET /compute/v2.1/servers/19beb62f-fdd9-4e6c-9d20-2abc3b5dfd16 => generated 1454 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:19:02.735971 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.policy [None req-9f8d0a43-35dd-4f38-9a46-f913ea6a9401 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb28547f4b54c4097d2ffc3c533ca67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42af08ef367945939b1f59ffa8af351a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120799) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:19:02.747852 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.policy [None req-9f8d0a43-35dd-4f38-9a46-f913ea6a9401 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4fb28547f4b54c4097d2ffc3c533ca67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42af08ef367945939b1f59ffa8af351a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120799) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:19:02.749409 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.policy [None req-9f8d0a43-35dd-4f38-9a46-f913ea6a9401 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4fb28547f4b54c4097d2ffc3c533ca67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42af08ef367945939b1f59ffa8af351a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120799) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:19:02.750956 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-9f8d0a43-35dd-4f38-9a46-f913ea6a9401 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] 10.222.0.17 "GET /compute/v2.1/servers/d1a4fd6e-9323-416e-b844-5e526565774e" status: 200 len: 1736 microversion: 2.20 time: 0.249323 Aug 23 07:19:02.755457 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 373/721] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Aug 23 07:19:02 2022] GET /compute/v2.1/servers/d1a4fd6e-9323-416e-b844-5e526565774e => generated 1736 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 07:19:03.077647 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [req-6c893ac0-40bc-4c9b-a71e-f20b38a322bb req-0807a55a-65ec-44db-b8c8-b3153e7a6dc9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d1a4fd6e-9323-416e-b844-5e526565774e", "name": "network-vif-plugged", "status": "completed", "tag": "4e45252a-a4b1-488a-9f32-2c668277cefd"}]} {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 07:19:03.104230 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [req-6c893ac0-40bc-4c9b-a71e-f20b38a322bb req-0807a55a-65ec-44db-b8c8-b3153e7a6dc9 service nova] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:19:03.104585 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [req-6c893ac0-40bc-4c9b-a71e-f20b38a322bb req-0807a55a-65ec-44db-b8c8-b3153e7a6dc9 service nova] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:19:03.105317 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [req-6c893ac0-40bc-4c9b-a71e-f20b38a322bb req-0807a55a-65ec-44db-b8c8-b3153e7a6dc9 service nova] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:19:03.123463 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.compute.server_external_events [req-6c893ac0-40bc-4c9b-a71e-f20b38a322bb req-0807a55a-65ec-44db-b8c8-b3153e7a6dc9 service nova] Creating event network-vif-plugged:4e45252a-a4b1-488a-9f32-2c668277cefd for instance d1a4fd6e-9323-416e-b844-5e526565774e on hv-cinder-85409 Aug 23 07:19:03.133785 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [req-6c893ac0-40bc-4c9b-a71e-f20b38a322bb req-0807a55a-65ec-44db-b8c8-b3153e7a6dc9 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066403 Aug 23 07:19:03.135633 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 349/722] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Aug 23 07:19:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 07:19:03.783187 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-229cdc72-4722-4f54-9628-cfe0b5bd8c9a tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Calling method '>' {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:19:03.784788 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.compute.api [None req-229cdc72-4722-4f54-9628-cfe0b5bd8c9a tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] [instance: d1a4fd6e-9323-416e-b844-5e526565774e] Fetching instance by UUID {{(pid=120799) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:19:03.791773 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-229cdc72-4722-4f54-9628-cfe0b5bd8c9a tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:19:03.792313 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-229cdc72-4722-4f54-9628-cfe0b5bd8c9a tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:19:03.792987 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-229cdc72-4722-4f54-9628-cfe0b5bd8c9a tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:19:03.793729 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-229cdc72-4722-4f54-9628-cfe0b5bd8c9a tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:19:03.794359 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-229cdc72-4722-4f54-9628-cfe0b5bd8c9a tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:19:03.794977 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-229cdc72-4722-4f54-9628-cfe0b5bd8c9a tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:19:04.043471 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.policy [None req-229cdc72-4722-4f54-9628-cfe0b5bd8c9a tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb28547f4b54c4097d2ffc3c533ca67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42af08ef367945939b1f59ffa8af351a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120799) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:19:04.057639 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.policy [None req-229cdc72-4722-4f54-9628-cfe0b5bd8c9a tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4fb28547f4b54c4097d2ffc3c533ca67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42af08ef367945939b1f59ffa8af351a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120799) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:19:04.059760 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.policy [None req-229cdc72-4722-4f54-9628-cfe0b5bd8c9a tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4fb28547f4b54c4097d2ffc3c533ca67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42af08ef367945939b1f59ffa8af351a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120799) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:19:04.061446 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-229cdc72-4722-4f54-9628-cfe0b5bd8c9a tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] 10.222.0.17 "GET /compute/v2.1/servers/d1a4fd6e-9323-416e-b844-5e526565774e" status: 200 len: 1736 microversion: 2.20 time: 0.282954 Aug 23 07:19:04.062194 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 374/723] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Aug 23 07:19:03 2022] GET /compute/v2.1/servers/d1a4fd6e-9323-416e-b844-5e526565774e => generated 1736 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 07:19:04.764598 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [req-a55c4c7e-be3d-435c-9033-f5de8b30bd77 req-9f759337-f259-4368-b70b-35c70f2a20a8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "19beb62f-fdd9-4e6c-9d20-2abc3b5dfd16", "tag": "22874e03-587e-473a-8f08-37ed4393d34c"}]} {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 07:19:04.776967 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG dbcounter [-] [120798] Writing DB stats nova_api:SELECT=69,nova_api:UPDATE=1 {{(pid=120798) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:19:04.780097 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [req-a55c4c7e-be3d-435c-9033-f5de8b30bd77 req-9f759337-f259-4368-b70b-35c70f2a20a8 service nova] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:19:04.780573 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [req-a55c4c7e-be3d-435c-9033-f5de8b30bd77 req-9f759337-f259-4368-b70b-35c70f2a20a8 service nova] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:19:04.781002 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [req-a55c4c7e-be3d-435c-9033-f5de8b30bd77 req-9f759337-f259-4368-b70b-35c70f2a20a8 service nova] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:19:04.799443 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.compute.server_external_events [req-a55c4c7e-be3d-435c-9033-f5de8b30bd77 req-9f759337-f259-4368-b70b-35c70f2a20a8 service nova] Creating event network-changed:22874e03-587e-473a-8f08-37ed4393d34c for instance 19beb62f-fdd9-4e6c-9d20-2abc3b5dfd16 on hv-cinder-85409 Aug 23 07:19:04.807126 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [req-a55c4c7e-be3d-435c-9033-f5de8b30bd77 req-9f759337-f259-4368-b70b-35c70f2a20a8 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047096 Aug 23 07:19:04.807964 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 350/724] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Aug 23 07:19:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 07:19:05.090811 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-3ba49bf7-cd05-4ed8-b68b-aa37f0d11784 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Calling method '>' {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:19:05.092828 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.compute.api [None req-3ba49bf7-cd05-4ed8-b68b-aa37f0d11784 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] [instance: d1a4fd6e-9323-416e-b844-5e526565774e] Fetching instance by UUID {{(pid=120799) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:19:05.102197 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-3ba49bf7-cd05-4ed8-b68b-aa37f0d11784 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:19:05.103050 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-3ba49bf7-cd05-4ed8-b68b-aa37f0d11784 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:19:05.103669 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-3ba49bf7-cd05-4ed8-b68b-aa37f0d11784 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:19:05.104603 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-3ba49bf7-cd05-4ed8-b68b-aa37f0d11784 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:19:05.105255 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-3ba49bf7-cd05-4ed8-b68b-aa37f0d11784 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:19:05.105826 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-3ba49bf7-cd05-4ed8-b68b-aa37f0d11784 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:19:05.362957 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.policy [None req-3ba49bf7-cd05-4ed8-b68b-aa37f0d11784 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb28547f4b54c4097d2ffc3c533ca67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42af08ef367945939b1f59ffa8af351a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120799) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:19:05.388021 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.policy [None req-3ba49bf7-cd05-4ed8-b68b-aa37f0d11784 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4fb28547f4b54c4097d2ffc3c533ca67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42af08ef367945939b1f59ffa8af351a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120799) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:19:05.390641 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.policy [None req-3ba49bf7-cd05-4ed8-b68b-aa37f0d11784 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4fb28547f4b54c4097d2ffc3c533ca67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42af08ef367945939b1f59ffa8af351a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120799) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:19:05.392261 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-3ba49bf7-cd05-4ed8-b68b-aa37f0d11784 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] 10.222.0.17 "GET /compute/v2.1/servers/d1a4fd6e-9323-416e-b844-5e526565774e" status: 200 len: 1736 microversion: 2.20 time: 0.308736 Aug 23 07:19:05.422719 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 375/725] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Aug 23 07:19:05 2022] GET /compute/v2.1/servers/d1a4fd6e-9323-416e-b844-5e526565774e => generated 1736 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 07:19:06.427959 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-7b3dba41-1fda-4c7f-8839-77ed313db428 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Calling method '>' {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:19:06.428653 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.compute.api [None req-7b3dba41-1fda-4c7f-8839-77ed313db428 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] [instance: d1a4fd6e-9323-416e-b844-5e526565774e] Fetching instance by UUID {{(pid=120798) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:19:06.452622 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-7b3dba41-1fda-4c7f-8839-77ed313db428 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:19:06.453111 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-7b3dba41-1fda-4c7f-8839-77ed313db428 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:19:06.453733 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-7b3dba41-1fda-4c7f-8839-77ed313db428 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:19:06.454441 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-7b3dba41-1fda-4c7f-8839-77ed313db428 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:19:06.454894 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-7b3dba41-1fda-4c7f-8839-77ed313db428 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:19:06.455318 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-7b3dba41-1fda-4c7f-8839-77ed313db428 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:19:06.613229 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.policy [None req-7b3dba41-1fda-4c7f-8839-77ed313db428 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb28547f4b54c4097d2ffc3c533ca67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42af08ef367945939b1f59ffa8af351a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120798) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:19:06.622082 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.policy [None req-7b3dba41-1fda-4c7f-8839-77ed313db428 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4fb28547f4b54c4097d2ffc3c533ca67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42af08ef367945939b1f59ffa8af351a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120798) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:19:06.623627 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.policy [None req-7b3dba41-1fda-4c7f-8839-77ed313db428 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4fb28547f4b54c4097d2ffc3c533ca67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42af08ef367945939b1f59ffa8af351a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120798) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:19:06.625172 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [None req-7b3dba41-1fda-4c7f-8839-77ed313db428 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] 10.222.0.17 "GET /compute/v2.1/servers/d1a4fd6e-9323-416e-b844-5e526565774e" status: 200 len: 1736 microversion: 2.20 time: 0.201724 Aug 23 07:19:06.625753 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 351/726] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Aug 23 07:19:06 2022] GET /compute/v2.1/servers/d1a4fd6e-9323-416e-b844-5e526565774e => generated 1736 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 07:19:07.649673 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-7047d008-8a1a-4c09-a600-4835f6a22763 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Calling method '>' {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:19:07.655121 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.compute.api [None req-7047d008-8a1a-4c09-a600-4835f6a22763 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] [instance: d1a4fd6e-9323-416e-b844-5e526565774e] Fetching instance by UUID {{(pid=120799) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:19:07.658549 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-7047d008-8a1a-4c09-a600-4835f6a22763 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:19:07.659383 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-7047d008-8a1a-4c09-a600-4835f6a22763 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:19:07.659806 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-7047d008-8a1a-4c09-a600-4835f6a22763 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:19:07.661500 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-7047d008-8a1a-4c09-a600-4835f6a22763 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:19:07.662091 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-7047d008-8a1a-4c09-a600-4835f6a22763 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:19:07.662594 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-7047d008-8a1a-4c09-a600-4835f6a22763 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:19:07.825662 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.policy [None req-7047d008-8a1a-4c09-a600-4835f6a22763 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb28547f4b54c4097d2ffc3c533ca67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42af08ef367945939b1f59ffa8af351a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120799) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:19:07.844928 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.policy [None req-7047d008-8a1a-4c09-a600-4835f6a22763 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4fb28547f4b54c4097d2ffc3c533ca67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42af08ef367945939b1f59ffa8af351a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120799) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:19:07.846604 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.policy [None req-7047d008-8a1a-4c09-a600-4835f6a22763 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4fb28547f4b54c4097d2ffc3c533ca67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42af08ef367945939b1f59ffa8af351a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120799) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:19:07.848522 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-7047d008-8a1a-4c09-a600-4835f6a22763 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] 10.222.0.17 "GET /compute/v2.1/servers/d1a4fd6e-9323-416e-b844-5e526565774e" status: 200 len: 1736 microversion: 2.20 time: 0.203788 Aug 23 07:19:07.850438 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 376/727] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Aug 23 07:19:07 2022] GET /compute/v2.1/servers/d1a4fd6e-9323-416e-b844-5e526565774e => generated 1736 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 07:19:08.878184 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-4d7e5f5b-5cc7-407d-97a7-bccd267b933c tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Calling method '>' {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:19:08.879891 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.compute.api [None req-4d7e5f5b-5cc7-407d-97a7-bccd267b933c tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] [instance: d1a4fd6e-9323-416e-b844-5e526565774e] Fetching instance by UUID {{(pid=120798) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:19:08.887459 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-4d7e5f5b-5cc7-407d-97a7-bccd267b933c tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:19:08.888151 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-4d7e5f5b-5cc7-407d-97a7-bccd267b933c tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:19:08.889149 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-4d7e5f5b-5cc7-407d-97a7-bccd267b933c tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:19:08.890027 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-4d7e5f5b-5cc7-407d-97a7-bccd267b933c tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:19:08.890640 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-4d7e5f5b-5cc7-407d-97a7-bccd267b933c tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:19:08.891562 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-4d7e5f5b-5cc7-407d-97a7-bccd267b933c tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:19:09.060637 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.policy [None req-4d7e5f5b-5cc7-407d-97a7-bccd267b933c tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb28547f4b54c4097d2ffc3c533ca67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42af08ef367945939b1f59ffa8af351a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120798) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:19:09.074197 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.policy [None req-4d7e5f5b-5cc7-407d-97a7-bccd267b933c tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4fb28547f4b54c4097d2ffc3c533ca67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42af08ef367945939b1f59ffa8af351a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120798) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:19:09.077436 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.policy [None req-4d7e5f5b-5cc7-407d-97a7-bccd267b933c tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4fb28547f4b54c4097d2ffc3c533ca67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42af08ef367945939b1f59ffa8af351a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120798) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:19:09.078874 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [None req-4d7e5f5b-5cc7-407d-97a7-bccd267b933c tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] 10.222.0.17 "GET /compute/v2.1/servers/d1a4fd6e-9323-416e-b844-5e526565774e" status: 200 len: 1736 microversion: 2.20 time: 0.204675 Aug 23 07:19:09.106713 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 352/728] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Aug 23 07:19:08 2022] GET /compute/v2.1/servers/d1a4fd6e-9323-416e-b844-5e526565774e => generated 1736 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 07:19:10.106414 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-4c2e7ccb-a147-47bc-91d4-be70c63027e2 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Calling method '>' {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:19:10.107264 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.compute.api [None req-4c2e7ccb-a147-47bc-91d4-be70c63027e2 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] [instance: d1a4fd6e-9323-416e-b844-5e526565774e] Fetching instance by UUID {{(pid=120799) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:19:10.116393 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-4c2e7ccb-a147-47bc-91d4-be70c63027e2 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:19:10.117166 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-4c2e7ccb-a147-47bc-91d4-be70c63027e2 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:19:10.117865 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-4c2e7ccb-a147-47bc-91d4-be70c63027e2 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:19:10.118842 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-4c2e7ccb-a147-47bc-91d4-be70c63027e2 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:19:10.119305 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-4c2e7ccb-a147-47bc-91d4-be70c63027e2 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:19:10.119764 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-4c2e7ccb-a147-47bc-91d4-be70c63027e2 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:19:10.325952 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.policy [None req-4c2e7ccb-a147-47bc-91d4-be70c63027e2 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb28547f4b54c4097d2ffc3c533ca67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42af08ef367945939b1f59ffa8af351a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120799) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:19:10.338424 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.policy [None req-4c2e7ccb-a147-47bc-91d4-be70c63027e2 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4fb28547f4b54c4097d2ffc3c533ca67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42af08ef367945939b1f59ffa8af351a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120799) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:19:10.340137 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.policy [None req-4c2e7ccb-a147-47bc-91d4-be70c63027e2 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4fb28547f4b54c4097d2ffc3c533ca67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42af08ef367945939b1f59ffa8af351a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120799) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:19:10.342130 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-4c2e7ccb-a147-47bc-91d4-be70c63027e2 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] 10.222.0.17 "GET /compute/v2.1/servers/d1a4fd6e-9323-416e-b844-5e526565774e" status: 200 len: 1736 microversion: 2.20 time: 0.239857 Aug 23 07:19:10.342757 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 377/729] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Aug 23 07:19:10 2022] GET /compute/v2.1/servers/d1a4fd6e-9323-416e-b844-5e526565774e => generated 1736 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 07:19:11.372867 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-2f873ad7-1400-4001-bb2b-1a99b4c35f0a tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Calling method '>' {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:19:11.373542 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.compute.api [None req-2f873ad7-1400-4001-bb2b-1a99b4c35f0a tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] [instance: d1a4fd6e-9323-416e-b844-5e526565774e] Fetching instance by UUID {{(pid=120798) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:19:11.383116 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-2f873ad7-1400-4001-bb2b-1a99b4c35f0a tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:19:11.383962 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-2f873ad7-1400-4001-bb2b-1a99b4c35f0a tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:19:11.384287 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-2f873ad7-1400-4001-bb2b-1a99b4c35f0a tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:19:11.385176 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-2f873ad7-1400-4001-bb2b-1a99b4c35f0a tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:19:11.385717 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-2f873ad7-1400-4001-bb2b-1a99b4c35f0a tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:19:11.386138 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-2f873ad7-1400-4001-bb2b-1a99b4c35f0a tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:19:11.519466 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.policy [None req-2f873ad7-1400-4001-bb2b-1a99b4c35f0a tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb28547f4b54c4097d2ffc3c533ca67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42af08ef367945939b1f59ffa8af351a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120798) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:19:11.531876 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.policy [None req-2f873ad7-1400-4001-bb2b-1a99b4c35f0a tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4fb28547f4b54c4097d2ffc3c533ca67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42af08ef367945939b1f59ffa8af351a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120798) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:19:11.534163 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.policy [None req-2f873ad7-1400-4001-bb2b-1a99b4c35f0a tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4fb28547f4b54c4097d2ffc3c533ca67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42af08ef367945939b1f59ffa8af351a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120798) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:19:11.535637 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [None req-2f873ad7-1400-4001-bb2b-1a99b4c35f0a tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] 10.222.0.17 "GET /compute/v2.1/servers/d1a4fd6e-9323-416e-b844-5e526565774e" status: 200 len: 1736 microversion: 2.20 time: 0.169329 Aug 23 07:19:11.536195 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 353/730] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Aug 23 07:19:11 2022] GET /compute/v2.1/servers/d1a4fd6e-9323-416e-b844-5e526565774e => generated 1736 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 07:19:12.562722 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-8e1b6a04-f900-4013-bea8-582f371f6053 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Calling method '>' {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:19:12.563646 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.compute.api [None req-8e1b6a04-f900-4013-bea8-582f371f6053 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] [instance: d1a4fd6e-9323-416e-b844-5e526565774e] Fetching instance by UUID {{(pid=120799) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:19:12.575021 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-8e1b6a04-f900-4013-bea8-582f371f6053 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:19:12.575900 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-8e1b6a04-f900-4013-bea8-582f371f6053 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:19:12.576611 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-8e1b6a04-f900-4013-bea8-582f371f6053 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:19:12.577716 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-8e1b6a04-f900-4013-bea8-582f371f6053 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:19:12.578449 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-8e1b6a04-f900-4013-bea8-582f371f6053 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:19:12.579187 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-8e1b6a04-f900-4013-bea8-582f371f6053 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:19:12.726847 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.policy [None req-8e1b6a04-f900-4013-bea8-582f371f6053 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb28547f4b54c4097d2ffc3c533ca67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42af08ef367945939b1f59ffa8af351a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120799) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:19:12.735073 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.policy [None req-8e1b6a04-f900-4013-bea8-582f371f6053 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4fb28547f4b54c4097d2ffc3c533ca67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42af08ef367945939b1f59ffa8af351a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120799) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:19:12.736578 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.policy [None req-8e1b6a04-f900-4013-bea8-582f371f6053 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4fb28547f4b54c4097d2ffc3c533ca67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42af08ef367945939b1f59ffa8af351a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120799) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:19:12.737711 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-8e1b6a04-f900-4013-bea8-582f371f6053 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] 10.222.0.17 "GET /compute/v2.1/servers/d1a4fd6e-9323-416e-b844-5e526565774e" status: 200 len: 1718 microversion: 2.20 time: 0.181646 Aug 23 07:19:12.738520 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 378/731] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Aug 23 07:19:12 2022] GET /compute/v2.1/servers/d1a4fd6e-9323-416e-b844-5e526565774e => generated 1718 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 07:19:13.761637 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-d02b3c5f-e81f-42d1-a117-3166cce397af tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Calling method '>' {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:19:13.762301 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.compute.api [None req-d02b3c5f-e81f-42d1-a117-3166cce397af tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] [instance: d1a4fd6e-9323-416e-b844-5e526565774e] Fetching instance by UUID {{(pid=120798) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:19:13.769358 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-d02b3c5f-e81f-42d1-a117-3166cce397af tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:19:13.769841 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-d02b3c5f-e81f-42d1-a117-3166cce397af tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:19:13.770273 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-d02b3c5f-e81f-42d1-a117-3166cce397af tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:19:13.770976 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-d02b3c5f-e81f-42d1-a117-3166cce397af tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:19:13.771456 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-d02b3c5f-e81f-42d1-a117-3166cce397af tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:19:13.771884 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-d02b3c5f-e81f-42d1-a117-3166cce397af tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:19:13.916776 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.policy [None req-d02b3c5f-e81f-42d1-a117-3166cce397af tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb28547f4b54c4097d2ffc3c533ca67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42af08ef367945939b1f59ffa8af351a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120798) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:19:13.930647 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.policy [None req-d02b3c5f-e81f-42d1-a117-3166cce397af tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4fb28547f4b54c4097d2ffc3c533ca67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42af08ef367945939b1f59ffa8af351a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120798) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:19:13.932297 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.policy [None req-d02b3c5f-e81f-42d1-a117-3166cce397af tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4fb28547f4b54c4097d2ffc3c533ca67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42af08ef367945939b1f59ffa8af351a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120798) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:19:13.933459 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [None req-d02b3c5f-e81f-42d1-a117-3166cce397af tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] 10.222.0.17 "GET /compute/v2.1/servers/d1a4fd6e-9323-416e-b844-5e526565774e" status: 200 len: 1718 microversion: 2.20 time: 0.176017 Aug 23 07:19:13.934031 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 354/732] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Aug 23 07:19:13 2022] GET /compute/v2.1/servers/d1a4fd6e-9323-416e-b844-5e526565774e => generated 1718 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 07:19:14.958765 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-a96b96b8-ebed-4fe9-9bcd-f915a076165f tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Calling method '>' {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:19:14.959384 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.compute.api [None req-a96b96b8-ebed-4fe9-9bcd-f915a076165f tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] [instance: d1a4fd6e-9323-416e-b844-5e526565774e] Fetching instance by UUID {{(pid=120799) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:19:14.966458 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-a96b96b8-ebed-4fe9-9bcd-f915a076165f tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:19:14.966919 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-a96b96b8-ebed-4fe9-9bcd-f915a076165f tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:19:14.967337 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-a96b96b8-ebed-4fe9-9bcd-f915a076165f tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:19:14.968466 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-a96b96b8-ebed-4fe9-9bcd-f915a076165f tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:19:14.968466 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-a96b96b8-ebed-4fe9-9bcd-f915a076165f tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:19:14.968881 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-a96b96b8-ebed-4fe9-9bcd-f915a076165f tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:19:15.437705 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.policy [None req-a96b96b8-ebed-4fe9-9bcd-f915a076165f tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb28547f4b54c4097d2ffc3c533ca67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42af08ef367945939b1f59ffa8af351a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120799) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:19:15.446377 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.policy [None req-a96b96b8-ebed-4fe9-9bcd-f915a076165f tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4fb28547f4b54c4097d2ffc3c533ca67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42af08ef367945939b1f59ffa8af351a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120799) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:19:15.447904 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.policy [None req-a96b96b8-ebed-4fe9-9bcd-f915a076165f tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4fb28547f4b54c4097d2ffc3c533ca67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42af08ef367945939b1f59ffa8af351a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120799) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:19:15.449069 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-a96b96b8-ebed-4fe9-9bcd-f915a076165f tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] 10.222.0.17 "GET /compute/v2.1/servers/d1a4fd6e-9323-416e-b844-5e526565774e" status: 200 len: 1661 microversion: 2.20 time: 0.494737 Aug 23 07:19:15.449631 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 379/733] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Aug 23 07:19:14 2022] GET /compute/v2.1/servers/d1a4fd6e-9323-416e-b844-5e526565774e => generated 1661 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 07:19:15.471835 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-b511f471-1a7f-480b-9c45-f1c700ec25af tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5181d549-b979-400c-aa21-c60f0f0b4c39"}} {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 07:19:15.474482 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.compute.api [None req-b511f471-1a7f-480b-9c45-f1c700ec25af tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] [instance: d1a4fd6e-9323-416e-b844-5e526565774e] Fetching instance by UUID {{(pid=120798) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:19:15.481555 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-b511f471-1a7f-480b-9c45-f1c700ec25af tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:19:15.482361 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-b511f471-1a7f-480b-9c45-f1c700ec25af tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:19:15.482970 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-b511f471-1a7f-480b-9c45-f1c700ec25af tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:19:15.484160 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-b511f471-1a7f-480b-9c45-f1c700ec25af tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:19:15.485153 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-b511f471-1a7f-480b-9c45-f1c700ec25af tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:19:15.485896 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-b511f471-1a7f-480b-9c45-f1c700ec25af tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:19:15.787825 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [None req-b511f471-1a7f-480b-9c45-f1c700ec25af tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] 10.222.0.17 "POST /compute/v2.1/servers/d1a4fd6e-9323-416e-b844-5e526565774e/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.319969 Aug 23 07:19:15.788469 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 355/734] 10.222.0.17 () {62 vars in 1364 bytes} [Tue Aug 23 07:19:15 2022] POST /compute/v2.1/servers/d1a4fd6e-9323-416e-b844-5e526565774e/os-volume_attachments => generated 188 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 23 07:19:15.912454 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-35a0ad96-df4f-471c-8ce7-bc8fee34173a tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 07:19:15.912966 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.compute.api [None req-35a0ad96-df4f-471c-8ce7-bc8fee34173a tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] [instance: d1a4fd6e-9323-416e-b844-5e526565774e] Fetching instance by UUID {{(pid=120799) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:19:15.919073 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-35a0ad96-df4f-471c-8ce7-bc8fee34173a tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:19:15.919581 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-35a0ad96-df4f-471c-8ce7-bc8fee34173a tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:19:15.920013 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-35a0ad96-df4f-471c-8ce7-bc8fee34173a tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:19:15.920691 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-35a0ad96-df4f-471c-8ce7-bc8fee34173a tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:19:15.921138 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-35a0ad96-df4f-471c-8ce7-bc8fee34173a tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:19:15.921554 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-35a0ad96-df4f-471c-8ce7-bc8fee34173a tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:19:15.951997 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.compute.api [None req-35a0ad96-df4f-471c-8ce7-bc8fee34173a tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] [instance: d1a4fd6e-9323-416e-b844-5e526565774e] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120799) unshelve /opt/stack/nova/nova/compute/api.py:4578}} Aug 23 07:19:16.027957 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-35a0ad96-df4f-471c-8ce7-bc8fee34173a tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] 10.222.0.17 "POST /compute/v2.1/servers/d1a4fd6e-9323-416e-b844-5e526565774e/action" status: 202 len: 0 microversion: 2.20 time: 0.119467 Aug 23 07:19:16.031609 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 380/735] 10.222.0.17 () {62 vars in 1319 bytes} [Tue Aug 23 07:19:15 2022] POST /compute/v2.1/servers/d1a4fd6e-9323-416e-b844-5e526565774e/action => generated 0 bytes in 121 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 23 07:19:16.037116 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-5e995e66-598a-4fa5-bcdc-0939d86982be tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Calling method '>' {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:19:16.037760 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.compute.api [None req-5e995e66-598a-4fa5-bcdc-0939d86982be tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] [instance: d1a4fd6e-9323-416e-b844-5e526565774e] Fetching instance by UUID {{(pid=120798) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:19:16.049527 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-5e995e66-598a-4fa5-bcdc-0939d86982be tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:19:16.050038 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-5e995e66-598a-4fa5-bcdc-0939d86982be tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:19:16.050486 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-5e995e66-598a-4fa5-bcdc-0939d86982be tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:19:16.051196 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-5e995e66-598a-4fa5-bcdc-0939d86982be tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:19:16.051716 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-5e995e66-598a-4fa5-bcdc-0939d86982be tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:19:16.052130 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-5e995e66-598a-4fa5-bcdc-0939d86982be tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:19:16.204386 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.policy [None req-5e995e66-598a-4fa5-bcdc-0939d86982be tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb28547f4b54c4097d2ffc3c533ca67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42af08ef367945939b1f59ffa8af351a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120798) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:19:16.214078 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.policy [None req-5e995e66-598a-4fa5-bcdc-0939d86982be tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4fb28547f4b54c4097d2ffc3c533ca67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42af08ef367945939b1f59ffa8af351a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120798) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:19:16.215610 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.policy [None req-5e995e66-598a-4fa5-bcdc-0939d86982be tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4fb28547f4b54c4097d2ffc3c533ca67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42af08ef367945939b1f59ffa8af351a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120798) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:19:16.216773 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [None req-5e995e66-598a-4fa5-bcdc-0939d86982be tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] 10.222.0.17 "GET /compute/v2.1/servers/d1a4fd6e-9323-416e-b844-5e526565774e" status: 200 len: 1747 microversion: 2.20 time: 0.183882 Aug 23 07:19:16.217323 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 356/736] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Aug 23 07:19:16 2022] GET /compute/v2.1/servers/d1a4fd6e-9323-416e-b844-5e526565774e => generated 1747 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 07:19:17.000011 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [req-66d63af5-1ccd-44d4-90e2-15487019829a req-3a69a133-ffc1-46cb-9812-4d20d4705d51 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d1a4fd6e-9323-416e-b844-5e526565774e", "name": "network-vif-unplugged", "status": "completed", "tag": "4e45252a-a4b1-488a-9f32-2c668277cefd"}]} {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 07:19:17.011725 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [req-66d63af5-1ccd-44d4-90e2-15487019829a req-3a69a133-ffc1-46cb-9812-4d20d4705d51 service nova] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:19:17.016000 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [req-66d63af5-1ccd-44d4-90e2-15487019829a req-3a69a133-ffc1-46cb-9812-4d20d4705d51 service nova] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:19:17.017157 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [req-66d63af5-1ccd-44d4-90e2-15487019829a req-3a69a133-ffc1-46cb-9812-4d20d4705d51 service nova] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:19:17.032452 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.compute.server_external_events [req-66d63af5-1ccd-44d4-90e2-15487019829a req-3a69a133-ffc1-46cb-9812-4d20d4705d51 service nova] Unable to find a host for instance d1a4fd6e-9323-416e-b844-5e526565774e. Dropping event network-vif-unplugged {{(pid=120799) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 23 07:19:17.033382 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [req-66d63af5-1ccd-44d4-90e2-15487019829a req-3a69a133-ffc1-46cb-9812-4d20d4705d51 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.038409 Aug 23 07:19:17.033986 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 381/737] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Aug 23 07:19:16 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 40 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Aug 23 07:19:17.240709 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-d3e6f8e1-7da9-4e78-92b4-88517079961f tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Calling method '>' {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:19:17.241241 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.compute.api [None req-d3e6f8e1-7da9-4e78-92b4-88517079961f tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] [instance: d1a4fd6e-9323-416e-b844-5e526565774e] Fetching instance by UUID {{(pid=120798) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:19:17.248005 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-d3e6f8e1-7da9-4e78-92b4-88517079961f tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:19:17.248495 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-d3e6f8e1-7da9-4e78-92b4-88517079961f tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:19:17.248927 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-d3e6f8e1-7da9-4e78-92b4-88517079961f tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:19:17.249615 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-d3e6f8e1-7da9-4e78-92b4-88517079961f tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:19:17.250060 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-d3e6f8e1-7da9-4e78-92b4-88517079961f tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:19:17.250498 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-d3e6f8e1-7da9-4e78-92b4-88517079961f tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:19:17.401921 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.policy [None req-d3e6f8e1-7da9-4e78-92b4-88517079961f tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb28547f4b54c4097d2ffc3c533ca67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42af08ef367945939b1f59ffa8af351a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120798) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:19:17.410947 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.policy [None req-d3e6f8e1-7da9-4e78-92b4-88517079961f tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4fb28547f4b54c4097d2ffc3c533ca67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42af08ef367945939b1f59ffa8af351a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120798) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:19:17.412477 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.policy [None req-d3e6f8e1-7da9-4e78-92b4-88517079961f tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4fb28547f4b54c4097d2ffc3c533ca67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42af08ef367945939b1f59ffa8af351a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120798) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:19:17.413636 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [None req-d3e6f8e1-7da9-4e78-92b4-88517079961f tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] 10.222.0.17 "GET /compute/v2.1/servers/d1a4fd6e-9323-416e-b844-5e526565774e" status: 200 len: 1749 microversion: 2.20 time: 0.177154 Aug 23 07:19:17.414494 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 357/738] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Aug 23 07:19:17 2022] GET /compute/v2.1/servers/d1a4fd6e-9323-416e-b844-5e526565774e => generated 1749 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 07:19:18.440322 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-e3ff9fa1-b958-4b52-973b-a500c36aca48 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Calling method '>' {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:19:18.442018 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.compute.api [None req-e3ff9fa1-b958-4b52-973b-a500c36aca48 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] [instance: d1a4fd6e-9323-416e-b844-5e526565774e] Fetching instance by UUID {{(pid=120799) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:19:18.465315 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-e3ff9fa1-b958-4b52-973b-a500c36aca48 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:19:18.466363 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-e3ff9fa1-b958-4b52-973b-a500c36aca48 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:19:18.467018 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-e3ff9fa1-b958-4b52-973b-a500c36aca48 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:19:18.468224 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-e3ff9fa1-b958-4b52-973b-a500c36aca48 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:19:18.468877 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-e3ff9fa1-b958-4b52-973b-a500c36aca48 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:19:18.469574 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-e3ff9fa1-b958-4b52-973b-a500c36aca48 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:19:18.693562 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.policy [None req-e3ff9fa1-b958-4b52-973b-a500c36aca48 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb28547f4b54c4097d2ffc3c533ca67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42af08ef367945939b1f59ffa8af351a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120799) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:19:18.703173 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.policy [None req-e3ff9fa1-b958-4b52-973b-a500c36aca48 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4fb28547f4b54c4097d2ffc3c533ca67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42af08ef367945939b1f59ffa8af351a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120799) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:19:18.705052 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.policy [None req-e3ff9fa1-b958-4b52-973b-a500c36aca48 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4fb28547f4b54c4097d2ffc3c533ca67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42af08ef367945939b1f59ffa8af351a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120799) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:19:18.706672 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-e3ff9fa1-b958-4b52-973b-a500c36aca48 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] 10.222.0.17 "GET /compute/v2.1/servers/d1a4fd6e-9323-416e-b844-5e526565774e" status: 200 len: 1805 microversion: 2.20 time: 0.272617 Aug 23 07:19:18.707766 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 382/739] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Aug 23 07:19:18 2022] GET /compute/v2.1/servers/d1a4fd6e-9323-416e-b844-5e526565774e => generated 1805 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 07:19:19.732680 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-66f904d0-0df3-473b-90c1-62f4f25ae40e tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Calling method '>' {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:19:19.733346 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.compute.api [None req-66f904d0-0df3-473b-90c1-62f4f25ae40e tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] [instance: d1a4fd6e-9323-416e-b844-5e526565774e] Fetching instance by UUID {{(pid=120798) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:19:19.740307 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-66f904d0-0df3-473b-90c1-62f4f25ae40e tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:19:19.741126 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-66f904d0-0df3-473b-90c1-62f4f25ae40e tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:19:19.741777 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-66f904d0-0df3-473b-90c1-62f4f25ae40e tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:19:19.742719 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-66f904d0-0df3-473b-90c1-62f4f25ae40e tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:19:19.743402 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-66f904d0-0df3-473b-90c1-62f4f25ae40e tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:19:19.744103 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-66f904d0-0df3-473b-90c1-62f4f25ae40e tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:19:19.878416 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.policy [None req-66f904d0-0df3-473b-90c1-62f4f25ae40e tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb28547f4b54c4097d2ffc3c533ca67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42af08ef367945939b1f59ffa8af351a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120798) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:19:19.887470 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.policy [None req-66f904d0-0df3-473b-90c1-62f4f25ae40e tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4fb28547f4b54c4097d2ffc3c533ca67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42af08ef367945939b1f59ffa8af351a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120798) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:19:19.889025 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.policy [None req-66f904d0-0df3-473b-90c1-62f4f25ae40e tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4fb28547f4b54c4097d2ffc3c533ca67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42af08ef367945939b1f59ffa8af351a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120798) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:19:19.890191 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [None req-66f904d0-0df3-473b-90c1-62f4f25ae40e tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] 10.222.0.17 "GET /compute/v2.1/servers/d1a4fd6e-9323-416e-b844-5e526565774e" status: 200 len: 1805 microversion: 2.20 time: 0.161573 Aug 23 07:19:19.890744 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 358/740] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Aug 23 07:19:19 2022] GET /compute/v2.1/servers/d1a4fd6e-9323-416e-b844-5e526565774e => generated 1805 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 07:19:20.913577 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-ed0e2e28-5b19-499b-ab9c-951207168255 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Calling method '>' {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:19:20.914626 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.compute.api [None req-ed0e2e28-5b19-499b-ab9c-951207168255 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] [instance: d1a4fd6e-9323-416e-b844-5e526565774e] Fetching instance by UUID {{(pid=120799) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:19:20.921499 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-ed0e2e28-5b19-499b-ab9c-951207168255 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:19:20.921977 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-ed0e2e28-5b19-499b-ab9c-951207168255 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:19:20.922382 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-ed0e2e28-5b19-499b-ab9c-951207168255 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:19:20.923085 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-ed0e2e28-5b19-499b-ab9c-951207168255 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:19:20.923559 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-ed0e2e28-5b19-499b-ab9c-951207168255 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:19:20.923975 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-ed0e2e28-5b19-499b-ab9c-951207168255 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:19:21.065682 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.policy [None req-ed0e2e28-5b19-499b-ab9c-951207168255 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb28547f4b54c4097d2ffc3c533ca67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42af08ef367945939b1f59ffa8af351a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120799) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:19:21.075594 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.policy [None req-ed0e2e28-5b19-499b-ab9c-951207168255 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4fb28547f4b54c4097d2ffc3c533ca67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42af08ef367945939b1f59ffa8af351a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120799) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:19:21.077077 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.policy [None req-ed0e2e28-5b19-499b-ab9c-951207168255 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4fb28547f4b54c4097d2ffc3c533ca67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42af08ef367945939b1f59ffa8af351a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120799) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:19:21.078230 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-ed0e2e28-5b19-499b-ab9c-951207168255 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] 10.222.0.17 "GET /compute/v2.1/servers/d1a4fd6e-9323-416e-b844-5e526565774e" status: 200 len: 1805 microversion: 2.20 time: 0.168879 Aug 23 07:19:21.078788 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 383/741] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Aug 23 07:19:20 2022] GET /compute/v2.1/servers/d1a4fd6e-9323-416e-b844-5e526565774e => generated 1805 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 07:19:22.102771 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-52a1efae-c5b4-4e68-aaf1-ac55c52d6503 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Calling method '>' {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:19:22.103398 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.compute.api [None req-52a1efae-c5b4-4e68-aaf1-ac55c52d6503 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] [instance: d1a4fd6e-9323-416e-b844-5e526565774e] Fetching instance by UUID {{(pid=120798) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:19:22.119245 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-52a1efae-c5b4-4e68-aaf1-ac55c52d6503 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:19:22.119772 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-52a1efae-c5b4-4e68-aaf1-ac55c52d6503 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:19:22.120221 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-52a1efae-c5b4-4e68-aaf1-ac55c52d6503 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:19:22.120925 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-52a1efae-c5b4-4e68-aaf1-ac55c52d6503 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:19:22.121375 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-52a1efae-c5b4-4e68-aaf1-ac55c52d6503 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:19:22.121793 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-52a1efae-c5b4-4e68-aaf1-ac55c52d6503 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:19:22.272328 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.policy [None req-52a1efae-c5b4-4e68-aaf1-ac55c52d6503 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb28547f4b54c4097d2ffc3c533ca67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42af08ef367945939b1f59ffa8af351a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120798) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:19:22.300906 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.policy [None req-52a1efae-c5b4-4e68-aaf1-ac55c52d6503 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4fb28547f4b54c4097d2ffc3c533ca67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42af08ef367945939b1f59ffa8af351a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120798) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:19:22.302928 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.policy [None req-52a1efae-c5b4-4e68-aaf1-ac55c52d6503 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4fb28547f4b54c4097d2ffc3c533ca67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42af08ef367945939b1f59ffa8af351a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120798) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:19:22.304810 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [None req-52a1efae-c5b4-4e68-aaf1-ac55c52d6503 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] 10.222.0.17 "GET /compute/v2.1/servers/d1a4fd6e-9323-416e-b844-5e526565774e" status: 200 len: 1805 microversion: 2.20 time: 0.206222 Aug 23 07:19:22.305394 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 359/742] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Aug 23 07:19:22 2022] GET /compute/v2.1/servers/d1a4fd6e-9323-416e-b844-5e526565774e => generated 1805 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 07:19:23.328971 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-4a02bbda-b038-4e74-8aac-dc5bbc1f5a07 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Calling method '>' {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:19:23.329958 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.compute.api [None req-4a02bbda-b038-4e74-8aac-dc5bbc1f5a07 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] [instance: d1a4fd6e-9323-416e-b844-5e526565774e] Fetching instance by UUID {{(pid=120799) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:19:23.349337 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-4a02bbda-b038-4e74-8aac-dc5bbc1f5a07 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:19:23.350035 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-4a02bbda-b038-4e74-8aac-dc5bbc1f5a07 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:19:23.353333 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-4a02bbda-b038-4e74-8aac-dc5bbc1f5a07 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:19:23.354585 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-4a02bbda-b038-4e74-8aac-dc5bbc1f5a07 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:19:23.355390 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-4a02bbda-b038-4e74-8aac-dc5bbc1f5a07 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:19:23.356146 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-4a02bbda-b038-4e74-8aac-dc5bbc1f5a07 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:19:23.517889 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.policy [None req-4a02bbda-b038-4e74-8aac-dc5bbc1f5a07 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb28547f4b54c4097d2ffc3c533ca67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42af08ef367945939b1f59ffa8af351a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120799) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:19:23.534124 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.policy [None req-4a02bbda-b038-4e74-8aac-dc5bbc1f5a07 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4fb28547f4b54c4097d2ffc3c533ca67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42af08ef367945939b1f59ffa8af351a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120799) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:19:23.535704 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.policy [None req-4a02bbda-b038-4e74-8aac-dc5bbc1f5a07 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4fb28547f4b54c4097d2ffc3c533ca67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42af08ef367945939b1f59ffa8af351a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120799) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:19:23.537425 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-4a02bbda-b038-4e74-8aac-dc5bbc1f5a07 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] 10.222.0.17 "GET /compute/v2.1/servers/d1a4fd6e-9323-416e-b844-5e526565774e" status: 200 len: 1805 microversion: 2.20 time: 0.212965 Aug 23 07:19:23.538266 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 384/743] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Aug 23 07:19:23 2022] GET /compute/v2.1/servers/d1a4fd6e-9323-416e-b844-5e526565774e => generated 1805 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 07:19:24.564644 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-1c47b087-6e00-41f0-9ecb-ff94c533cb22 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Calling method '>' {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:19:24.565560 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.compute.api [None req-1c47b087-6e00-41f0-9ecb-ff94c533cb22 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] [instance: d1a4fd6e-9323-416e-b844-5e526565774e] Fetching instance by UUID {{(pid=120798) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:19:24.577794 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-1c47b087-6e00-41f0-9ecb-ff94c533cb22 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:19:24.579084 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-1c47b087-6e00-41f0-9ecb-ff94c533cb22 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:19:24.580199 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-1c47b087-6e00-41f0-9ecb-ff94c533cb22 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:19:24.581924 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-1c47b087-6e00-41f0-9ecb-ff94c533cb22 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:19:24.582994 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-1c47b087-6e00-41f0-9ecb-ff94c533cb22 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:19:24.584066 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-1c47b087-6e00-41f0-9ecb-ff94c533cb22 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:19:24.720905 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.policy [None req-1c47b087-6e00-41f0-9ecb-ff94c533cb22 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb28547f4b54c4097d2ffc3c533ca67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42af08ef367945939b1f59ffa8af351a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120798) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:19:24.729949 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.policy [None req-1c47b087-6e00-41f0-9ecb-ff94c533cb22 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4fb28547f4b54c4097d2ffc3c533ca67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42af08ef367945939b1f59ffa8af351a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120798) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:19:24.731801 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.policy [None req-1c47b087-6e00-41f0-9ecb-ff94c533cb22 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4fb28547f4b54c4097d2ffc3c533ca67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42af08ef367945939b1f59ffa8af351a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120798) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:19:24.733146 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [None req-1c47b087-6e00-41f0-9ecb-ff94c533cb22 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] 10.222.0.17 "GET /compute/v2.1/servers/d1a4fd6e-9323-416e-b844-5e526565774e" status: 200 len: 1805 microversion: 2.20 time: 0.175251 Aug 23 07:19:24.733899 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 360/744] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Aug 23 07:19:24 2022] GET /compute/v2.1/servers/d1a4fd6e-9323-416e-b844-5e526565774e => generated 1805 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 07:19:25.756523 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-96d7d1d3-2b34-43b3-b315-20b6355da71e tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Calling method '>' {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:19:25.757057 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.compute.api [None req-96d7d1d3-2b34-43b3-b315-20b6355da71e tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] [instance: d1a4fd6e-9323-416e-b844-5e526565774e] Fetching instance by UUID {{(pid=120799) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:19:25.764446 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-96d7d1d3-2b34-43b3-b315-20b6355da71e tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:19:25.764922 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-96d7d1d3-2b34-43b3-b315-20b6355da71e tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:19:25.765343 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-96d7d1d3-2b34-43b3-b315-20b6355da71e tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:19:25.766037 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-96d7d1d3-2b34-43b3-b315-20b6355da71e tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:19:25.766473 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-96d7d1d3-2b34-43b3-b315-20b6355da71e tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:19:25.766890 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-96d7d1d3-2b34-43b3-b315-20b6355da71e tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:19:25.905620 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.policy [None req-96d7d1d3-2b34-43b3-b315-20b6355da71e tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb28547f4b54c4097d2ffc3c533ca67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42af08ef367945939b1f59ffa8af351a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120799) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:19:25.917702 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.policy [None req-96d7d1d3-2b34-43b3-b315-20b6355da71e tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4fb28547f4b54c4097d2ffc3c533ca67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42af08ef367945939b1f59ffa8af351a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120799) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:19:25.919295 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.policy [None req-96d7d1d3-2b34-43b3-b315-20b6355da71e tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4fb28547f4b54c4097d2ffc3c533ca67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42af08ef367945939b1f59ffa8af351a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120799) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:19:25.920601 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-96d7d1d3-2b34-43b3-b315-20b6355da71e tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] 10.222.0.17 "GET /compute/v2.1/servers/d1a4fd6e-9323-416e-b844-5e526565774e" status: 200 len: 1805 microversion: 2.20 time: 0.168093 Aug 23 07:19:25.925165 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 385/745] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Aug 23 07:19:25 2022] GET /compute/v2.1/servers/d1a4fd6e-9323-416e-b844-5e526565774e => generated 1805 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 07:19:26.943918 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-90c053ec-0e51-4da5-8a0b-a623a7c1a928 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Calling method '>' {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:19:26.944625 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.compute.api [None req-90c053ec-0e51-4da5-8a0b-a623a7c1a928 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] [instance: d1a4fd6e-9323-416e-b844-5e526565774e] Fetching instance by UUID {{(pid=120798) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:19:26.951819 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-90c053ec-0e51-4da5-8a0b-a623a7c1a928 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:19:26.952310 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-90c053ec-0e51-4da5-8a0b-a623a7c1a928 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:19:26.952745 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-90c053ec-0e51-4da5-8a0b-a623a7c1a928 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:19:26.953475 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-90c053ec-0e51-4da5-8a0b-a623a7c1a928 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:19:26.953920 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-90c053ec-0e51-4da5-8a0b-a623a7c1a928 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:19:26.954328 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-90c053ec-0e51-4da5-8a0b-a623a7c1a928 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:19:27.092431 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.policy [None req-90c053ec-0e51-4da5-8a0b-a623a7c1a928 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb28547f4b54c4097d2ffc3c533ca67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42af08ef367945939b1f59ffa8af351a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120798) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:19:27.102549 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.policy [None req-90c053ec-0e51-4da5-8a0b-a623a7c1a928 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4fb28547f4b54c4097d2ffc3c533ca67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42af08ef367945939b1f59ffa8af351a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120798) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:19:27.104137 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.policy [None req-90c053ec-0e51-4da5-8a0b-a623a7c1a928 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4fb28547f4b54c4097d2ffc3c533ca67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42af08ef367945939b1f59ffa8af351a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120798) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:19:27.105309 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [None req-90c053ec-0e51-4da5-8a0b-a623a7c1a928 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] 10.222.0.17 "GET /compute/v2.1/servers/d1a4fd6e-9323-416e-b844-5e526565774e" status: 200 len: 1805 microversion: 2.20 time: 0.165473 Aug 23 07:19:27.106048 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 361/746] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Aug 23 07:19:26 2022] GET /compute/v2.1/servers/d1a4fd6e-9323-416e-b844-5e526565774e => generated 1805 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 07:19:28.130426 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-6753bdd1-469d-458f-bd5e-cc76232d5550 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Calling method '>' {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:19:28.131356 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.compute.api [None req-6753bdd1-469d-458f-bd5e-cc76232d5550 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] [instance: d1a4fd6e-9323-416e-b844-5e526565774e] Fetching instance by UUID {{(pid=120799) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:19:28.138451 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-6753bdd1-469d-458f-bd5e-cc76232d5550 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:19:28.138938 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-6753bdd1-469d-458f-bd5e-cc76232d5550 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:19:28.139373 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-6753bdd1-469d-458f-bd5e-cc76232d5550 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:19:28.140106 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-6753bdd1-469d-458f-bd5e-cc76232d5550 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:19:28.140562 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-6753bdd1-469d-458f-bd5e-cc76232d5550 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:19:28.140982 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-6753bdd1-469d-458f-bd5e-cc76232d5550 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:19:28.283534 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.policy [None req-6753bdd1-469d-458f-bd5e-cc76232d5550 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb28547f4b54c4097d2ffc3c533ca67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42af08ef367945939b1f59ffa8af351a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120799) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:19:28.297358 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.policy [None req-6753bdd1-469d-458f-bd5e-cc76232d5550 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4fb28547f4b54c4097d2ffc3c533ca67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42af08ef367945939b1f59ffa8af351a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120799) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:19:28.299714 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.policy [None req-6753bdd1-469d-458f-bd5e-cc76232d5550 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4fb28547f4b54c4097d2ffc3c533ca67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42af08ef367945939b1f59ffa8af351a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120799) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:19:28.301525 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-6753bdd1-469d-458f-bd5e-cc76232d5550 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] 10.222.0.17 "GET /compute/v2.1/servers/d1a4fd6e-9323-416e-b844-5e526565774e" status: 200 len: 1805 microversion: 2.20 time: 0.176473 Aug 23 07:19:28.302295 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 386/747] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Aug 23 07:19:28 2022] GET /compute/v2.1/servers/d1a4fd6e-9323-416e-b844-5e526565774e => generated 1805 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 07:19:29.325295 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-62c0763c-4928-4158-85ff-e1b4efdc7eaa tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Calling method '>' {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:19:29.325892 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.compute.api [None req-62c0763c-4928-4158-85ff-e1b4efdc7eaa tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] [instance: d1a4fd6e-9323-416e-b844-5e526565774e] Fetching instance by UUID {{(pid=120798) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:19:29.332727 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-62c0763c-4928-4158-85ff-e1b4efdc7eaa tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:19:29.333210 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-62c0763c-4928-4158-85ff-e1b4efdc7eaa tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:19:29.333638 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-62c0763c-4928-4158-85ff-e1b4efdc7eaa tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:19:29.334336 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-62c0763c-4928-4158-85ff-e1b4efdc7eaa tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:19:29.334778 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-62c0763c-4928-4158-85ff-e1b4efdc7eaa tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:19:29.335204 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-62c0763c-4928-4158-85ff-e1b4efdc7eaa tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:19:29.553105 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.policy [None req-62c0763c-4928-4158-85ff-e1b4efdc7eaa tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb28547f4b54c4097d2ffc3c533ca67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42af08ef367945939b1f59ffa8af351a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120798) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:19:29.562317 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.policy [None req-62c0763c-4928-4158-85ff-e1b4efdc7eaa tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4fb28547f4b54c4097d2ffc3c533ca67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42af08ef367945939b1f59ffa8af351a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120798) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:19:29.563825 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.policy [None req-62c0763c-4928-4158-85ff-e1b4efdc7eaa tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4fb28547f4b54c4097d2ffc3c533ca67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42af08ef367945939b1f59ffa8af351a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120798) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:19:29.564959 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [None req-62c0763c-4928-4158-85ff-e1b4efdc7eaa tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] 10.222.0.17 "GET /compute/v2.1/servers/d1a4fd6e-9323-416e-b844-5e526565774e" status: 200 len: 1805 microversion: 2.20 time: 0.243662 Aug 23 07:19:29.565522 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 362/748] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Aug 23 07:19:29 2022] GET /compute/v2.1/servers/d1a4fd6e-9323-416e-b844-5e526565774e => generated 1805 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 07:19:30.593412 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-76dd952b-c543-464b-812b-0630feb56290 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Calling method '>' {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:19:30.594462 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.compute.api [None req-76dd952b-c543-464b-812b-0630feb56290 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] [instance: d1a4fd6e-9323-416e-b844-5e526565774e] Fetching instance by UUID {{(pid=120799) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:19:30.605424 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-76dd952b-c543-464b-812b-0630feb56290 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:19:30.606213 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-76dd952b-c543-464b-812b-0630feb56290 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:19:30.606930 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-76dd952b-c543-464b-812b-0630feb56290 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:19:30.608111 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-76dd952b-c543-464b-812b-0630feb56290 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:19:30.608854 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-76dd952b-c543-464b-812b-0630feb56290 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:19:30.609563 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-76dd952b-c543-464b-812b-0630feb56290 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:19:30.751281 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.policy [None req-76dd952b-c543-464b-812b-0630feb56290 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb28547f4b54c4097d2ffc3c533ca67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42af08ef367945939b1f59ffa8af351a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120799) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:19:30.765652 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.policy [None req-76dd952b-c543-464b-812b-0630feb56290 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4fb28547f4b54c4097d2ffc3c533ca67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42af08ef367945939b1f59ffa8af351a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120799) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:19:30.767593 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.policy [None req-76dd952b-c543-464b-812b-0630feb56290 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4fb28547f4b54c4097d2ffc3c533ca67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42af08ef367945939b1f59ffa8af351a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120799) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:19:30.769363 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-76dd952b-c543-464b-812b-0630feb56290 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] 10.222.0.17 "GET /compute/v2.1/servers/d1a4fd6e-9323-416e-b844-5e526565774e" status: 200 len: 1805 microversion: 2.20 time: 0.182122 Aug 23 07:19:30.770108 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 387/749] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Aug 23 07:19:30 2022] GET /compute/v2.1/servers/d1a4fd6e-9323-416e-b844-5e526565774e => generated 1805 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 07:19:31.796957 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-d207205d-48a2-42d5-ba23-346b74b53245 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Calling method '>' {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:19:31.797774 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.compute.api [None req-d207205d-48a2-42d5-ba23-346b74b53245 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] [instance: d1a4fd6e-9323-416e-b844-5e526565774e] Fetching instance by UUID {{(pid=120798) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:19:31.809431 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-d207205d-48a2-42d5-ba23-346b74b53245 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:19:31.810261 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-d207205d-48a2-42d5-ba23-346b74b53245 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:19:31.811068 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-d207205d-48a2-42d5-ba23-346b74b53245 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:19:31.812300 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-d207205d-48a2-42d5-ba23-346b74b53245 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:19:31.813009 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-d207205d-48a2-42d5-ba23-346b74b53245 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:19:31.813722 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-d207205d-48a2-42d5-ba23-346b74b53245 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:19:31.962819 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.policy [None req-d207205d-48a2-42d5-ba23-346b74b53245 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb28547f4b54c4097d2ffc3c533ca67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42af08ef367945939b1f59ffa8af351a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120798) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:19:31.965544 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG dbcounter [-] [120798] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=120798) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:19:31.973318 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.policy [None req-d207205d-48a2-42d5-ba23-346b74b53245 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4fb28547f4b54c4097d2ffc3c533ca67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42af08ef367945939b1f59ffa8af351a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120798) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:19:31.974924 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.policy [None req-d207205d-48a2-42d5-ba23-346b74b53245 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4fb28547f4b54c4097d2ffc3c533ca67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42af08ef367945939b1f59ffa8af351a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120798) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:19:31.976269 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [None req-d207205d-48a2-42d5-ba23-346b74b53245 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] 10.222.0.17 "GET /compute/v2.1/servers/d1a4fd6e-9323-416e-b844-5e526565774e" status: 200 len: 1805 microversion: 2.20 time: 0.186057 Aug 23 07:19:31.976826 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 363/750] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Aug 23 07:19:31 2022] GET /compute/v2.1/servers/d1a4fd6e-9323-416e-b844-5e526565774e => generated 1805 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 07:19:33.004162 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-4cb89d1d-34c7-4a9c-a8aa-bb64a54a3656 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Calling method '>' {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:19:33.005052 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.compute.api [None req-4cb89d1d-34c7-4a9c-a8aa-bb64a54a3656 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] [instance: d1a4fd6e-9323-416e-b844-5e526565774e] Fetching instance by UUID {{(pid=120799) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:19:33.009590 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG dbcounter [-] [120799] Writing DB stats nova_api:SELECT=34,nova_api:UPDATE=1 {{(pid=120799) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:19:33.023523 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-4cb89d1d-34c7-4a9c-a8aa-bb64a54a3656 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:19:33.024170 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-4cb89d1d-34c7-4a9c-a8aa-bb64a54a3656 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:19:33.024602 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-4cb89d1d-34c7-4a9c-a8aa-bb64a54a3656 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:19:33.025282 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-4cb89d1d-34c7-4a9c-a8aa-bb64a54a3656 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:19:33.025720 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-4cb89d1d-34c7-4a9c-a8aa-bb64a54a3656 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:19:33.028587 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-4cb89d1d-34c7-4a9c-a8aa-bb64a54a3656 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:19:33.032149 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG dbcounter [-] [120799] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120799) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:19:33.180676 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.policy [None req-4cb89d1d-34c7-4a9c-a8aa-bb64a54a3656 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb28547f4b54c4097d2ffc3c533ca67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42af08ef367945939b1f59ffa8af351a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120799) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:19:33.189921 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.policy [None req-4cb89d1d-34c7-4a9c-a8aa-bb64a54a3656 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4fb28547f4b54c4097d2ffc3c533ca67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42af08ef367945939b1f59ffa8af351a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120799) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:19:33.191633 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.policy [None req-4cb89d1d-34c7-4a9c-a8aa-bb64a54a3656 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4fb28547f4b54c4097d2ffc3c533ca67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42af08ef367945939b1f59ffa8af351a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120799) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:19:33.192739 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-4cb89d1d-34c7-4a9c-a8aa-bb64a54a3656 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] 10.222.0.17 "GET /compute/v2.1/servers/d1a4fd6e-9323-416e-b844-5e526565774e" status: 200 len: 1805 microversion: 2.20 time: 0.195549 Aug 23 07:19:33.193295 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 388/751] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Aug 23 07:19:32 2022] GET /compute/v2.1/servers/d1a4fd6e-9323-416e-b844-5e526565774e => generated 1805 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 07:19:34.217293 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-8be888f7-a4a9-4dd0-93cd-38d93c143345 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Calling method '>' {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:19:34.217900 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.compute.api [None req-8be888f7-a4a9-4dd0-93cd-38d93c143345 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] [instance: d1a4fd6e-9323-416e-b844-5e526565774e] Fetching instance by UUID {{(pid=120798) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:19:34.226125 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-8be888f7-a4a9-4dd0-93cd-38d93c143345 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:19:34.226754 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-8be888f7-a4a9-4dd0-93cd-38d93c143345 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:19:34.227186 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-8be888f7-a4a9-4dd0-93cd-38d93c143345 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:19:34.227897 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-8be888f7-a4a9-4dd0-93cd-38d93c143345 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:19:34.228346 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-8be888f7-a4a9-4dd0-93cd-38d93c143345 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:19:34.228764 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-8be888f7-a4a9-4dd0-93cd-38d93c143345 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:19:34.362661 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.policy [None req-8be888f7-a4a9-4dd0-93cd-38d93c143345 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb28547f4b54c4097d2ffc3c533ca67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42af08ef367945939b1f59ffa8af351a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120798) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:19:34.372010 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.policy [None req-8be888f7-a4a9-4dd0-93cd-38d93c143345 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4fb28547f4b54c4097d2ffc3c533ca67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42af08ef367945939b1f59ffa8af351a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120798) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:19:34.374532 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.policy [None req-8be888f7-a4a9-4dd0-93cd-38d93c143345 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4fb28547f4b54c4097d2ffc3c533ca67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42af08ef367945939b1f59ffa8af351a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120798) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:19:34.376535 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [None req-8be888f7-a4a9-4dd0-93cd-38d93c143345 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] 10.222.0.17 "GET /compute/v2.1/servers/d1a4fd6e-9323-416e-b844-5e526565774e" status: 200 len: 1805 microversion: 2.20 time: 0.163260 Aug 23 07:19:34.377390 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 364/752] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Aug 23 07:19:34 2022] GET /compute/v2.1/servers/d1a4fd6e-9323-416e-b844-5e526565774e => generated 1805 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 07:19:35.413182 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-e2d4c6c1-6a76-4f3e-bbed-af7bc1656e0c tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Calling method '>' {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:19:35.414762 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.compute.api [None req-e2d4c6c1-6a76-4f3e-bbed-af7bc1656e0c tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] [instance: d1a4fd6e-9323-416e-b844-5e526565774e] Fetching instance by UUID {{(pid=120799) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:19:35.422189 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-e2d4c6c1-6a76-4f3e-bbed-af7bc1656e0c tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:19:35.422676 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-e2d4c6c1-6a76-4f3e-bbed-af7bc1656e0c tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:19:35.423103 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-e2d4c6c1-6a76-4f3e-bbed-af7bc1656e0c tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:19:35.423816 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-e2d4c6c1-6a76-4f3e-bbed-af7bc1656e0c tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:19:35.424264 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-e2d4c6c1-6a76-4f3e-bbed-af7bc1656e0c tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:19:35.424718 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-e2d4c6c1-6a76-4f3e-bbed-af7bc1656e0c tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:19:35.569618 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.policy [None req-e2d4c6c1-6a76-4f3e-bbed-af7bc1656e0c tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb28547f4b54c4097d2ffc3c533ca67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42af08ef367945939b1f59ffa8af351a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120799) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:19:35.578724 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.policy [None req-e2d4c6c1-6a76-4f3e-bbed-af7bc1656e0c tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4fb28547f4b54c4097d2ffc3c533ca67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42af08ef367945939b1f59ffa8af351a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120799) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:19:35.580262 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.policy [None req-e2d4c6c1-6a76-4f3e-bbed-af7bc1656e0c tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4fb28547f4b54c4097d2ffc3c533ca67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42af08ef367945939b1f59ffa8af351a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120799) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:19:35.581409 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-e2d4c6c1-6a76-4f3e-bbed-af7bc1656e0c tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] 10.222.0.17 "GET /compute/v2.1/servers/d1a4fd6e-9323-416e-b844-5e526565774e" status: 200 len: 1805 microversion: 2.20 time: 0.174950 Aug 23 07:19:35.581932 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 389/753] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Aug 23 07:19:35 2022] GET /compute/v2.1/servers/d1a4fd6e-9323-416e-b844-5e526565774e => generated 1805 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 07:19:36.606673 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-f48770bb-99e6-4932-b954-cdc1510ef4ed tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Calling method '>' {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:19:36.607482 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.compute.api [None req-f48770bb-99e6-4932-b954-cdc1510ef4ed tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] [instance: d1a4fd6e-9323-416e-b844-5e526565774e] Fetching instance by UUID {{(pid=120798) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:19:36.610393 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG dbcounter [-] [120798] Writing DB stats nova_api:SELECT=30 {{(pid=120798) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:19:36.617460 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-f48770bb-99e6-4932-b954-cdc1510ef4ed tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:19:36.617936 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-f48770bb-99e6-4932-b954-cdc1510ef4ed tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:19:36.618352 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-f48770bb-99e6-4932-b954-cdc1510ef4ed tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:19:36.619032 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-f48770bb-99e6-4932-b954-cdc1510ef4ed tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:19:36.619471 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-f48770bb-99e6-4932-b954-cdc1510ef4ed tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:19:36.619881 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-f48770bb-99e6-4932-b954-cdc1510ef4ed tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:19:36.766513 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.policy [None req-f48770bb-99e6-4932-b954-cdc1510ef4ed tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb28547f4b54c4097d2ffc3c533ca67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42af08ef367945939b1f59ffa8af351a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120798) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:19:36.778494 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.policy [None req-f48770bb-99e6-4932-b954-cdc1510ef4ed tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4fb28547f4b54c4097d2ffc3c533ca67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42af08ef367945939b1f59ffa8af351a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120798) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:19:36.780302 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.policy [None req-f48770bb-99e6-4932-b954-cdc1510ef4ed tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4fb28547f4b54c4097d2ffc3c533ca67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42af08ef367945939b1f59ffa8af351a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120798) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:19:36.781570 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [None req-f48770bb-99e6-4932-b954-cdc1510ef4ed tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] 10.222.0.17 "GET /compute/v2.1/servers/d1a4fd6e-9323-416e-b844-5e526565774e" status: 200 len: 1805 microversion: 2.20 time: 0.180407 Aug 23 07:19:36.782164 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 365/754] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Aug 23 07:19:36 2022] GET /compute/v2.1/servers/d1a4fd6e-9323-416e-b844-5e526565774e => generated 1805 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 07:19:37.811180 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-6a80951e-7bb7-4108-9a25-3384720cffa8 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Calling method '>' {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:19:37.812091 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.compute.api [None req-6a80951e-7bb7-4108-9a25-3384720cffa8 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] [instance: d1a4fd6e-9323-416e-b844-5e526565774e] Fetching instance by UUID {{(pid=120799) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:19:37.822205 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-6a80951e-7bb7-4108-9a25-3384720cffa8 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:19:37.822681 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-6a80951e-7bb7-4108-9a25-3384720cffa8 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:19:37.823107 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-6a80951e-7bb7-4108-9a25-3384720cffa8 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:19:37.823817 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-6a80951e-7bb7-4108-9a25-3384720cffa8 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:19:37.824260 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-6a80951e-7bb7-4108-9a25-3384720cffa8 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:19:37.824685 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-6a80951e-7bb7-4108-9a25-3384720cffa8 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:19:37.975695 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.policy [None req-6a80951e-7bb7-4108-9a25-3384720cffa8 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb28547f4b54c4097d2ffc3c533ca67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42af08ef367945939b1f59ffa8af351a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120799) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:19:37.989418 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.policy [None req-6a80951e-7bb7-4108-9a25-3384720cffa8 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4fb28547f4b54c4097d2ffc3c533ca67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42af08ef367945939b1f59ffa8af351a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120799) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:19:37.991584 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.policy [None req-6a80951e-7bb7-4108-9a25-3384720cffa8 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4fb28547f4b54c4097d2ffc3c533ca67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42af08ef367945939b1f59ffa8af351a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120799) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:19:37.992828 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-6a80951e-7bb7-4108-9a25-3384720cffa8 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] 10.222.0.17 "GET /compute/v2.1/servers/d1a4fd6e-9323-416e-b844-5e526565774e" status: 200 len: 1805 microversion: 2.20 time: 0.188894 Aug 23 07:19:37.993388 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 390/755] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Aug 23 07:19:37 2022] GET /compute/v2.1/servers/d1a4fd6e-9323-416e-b844-5e526565774e => generated 1805 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 07:19:39.024905 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-52de6b0b-7228-416d-a6c1-a3b104992487 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Calling method '>' {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:19:39.025505 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.compute.api [None req-52de6b0b-7228-416d-a6c1-a3b104992487 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] [instance: d1a4fd6e-9323-416e-b844-5e526565774e] Fetching instance by UUID {{(pid=120798) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:19:39.032309 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-52de6b0b-7228-416d-a6c1-a3b104992487 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:19:39.032768 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-52de6b0b-7228-416d-a6c1-a3b104992487 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:19:39.033200 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-52de6b0b-7228-416d-a6c1-a3b104992487 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:19:39.033879 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-52de6b0b-7228-416d-a6c1-a3b104992487 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:19:39.034325 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-52de6b0b-7228-416d-a6c1-a3b104992487 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:19:39.034740 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-52de6b0b-7228-416d-a6c1-a3b104992487 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:19:39.107612 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [req-293181e4-b70d-4511-acb7-36c43d62f885 req-fa3637e2-9423-4962-a476-546057249b9a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d1a4fd6e-9323-416e-b844-5e526565774e", "name": "network-vif-plugged", "status": "completed", "tag": "4e45252a-a4b1-488a-9f32-2c668277cefd"}]} {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 07:19:39.120205 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [req-293181e4-b70d-4511-acb7-36c43d62f885 req-fa3637e2-9423-4962-a476-546057249b9a service nova] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:19:39.120852 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [req-293181e4-b70d-4511-acb7-36c43d62f885 req-fa3637e2-9423-4962-a476-546057249b9a service nova] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:19:39.121488 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [req-293181e4-b70d-4511-acb7-36c43d62f885 req-fa3637e2-9423-4962-a476-546057249b9a service nova] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:19:39.135010 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.compute.server_external_events [req-293181e4-b70d-4511-acb7-36c43d62f885 req-fa3637e2-9423-4962-a476-546057249b9a service nova] Creating event network-vif-plugged:4e45252a-a4b1-488a-9f32-2c668277cefd for instance d1a4fd6e-9323-416e-b844-5e526565774e on hv-cinder-85409 Aug 23 07:19:39.140887 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [req-293181e4-b70d-4511-acb7-36c43d62f885 req-fa3637e2-9423-4962-a476-546057249b9a service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038854 Aug 23 07:19:39.142071 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 391/756] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Aug 23 07:19:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 07:19:39.175306 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.policy [None req-52de6b0b-7228-416d-a6c1-a3b104992487 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb28547f4b54c4097d2ffc3c533ca67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42af08ef367945939b1f59ffa8af351a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120798) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:19:39.184708 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.policy [None req-52de6b0b-7228-416d-a6c1-a3b104992487 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4fb28547f4b54c4097d2ffc3c533ca67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42af08ef367945939b1f59ffa8af351a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120798) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:19:39.186278 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.policy [None req-52de6b0b-7228-416d-a6c1-a3b104992487 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4fb28547f4b54c4097d2ffc3c533ca67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42af08ef367945939b1f59ffa8af351a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120798) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:19:39.187366 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [None req-52de6b0b-7228-416d-a6c1-a3b104992487 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] 10.222.0.17 "GET /compute/v2.1/servers/d1a4fd6e-9323-416e-b844-5e526565774e" status: 200 len: 1805 microversion: 2.20 time: 0.166553 Aug 23 07:19:39.188074 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 366/757] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Aug 23 07:19:39 2022] GET /compute/v2.1/servers/d1a4fd6e-9323-416e-b844-5e526565774e => generated 1805 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 07:19:40.211657 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-1a2385de-a621-4c79-acca-ccb9fca89039 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Calling method '>' {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:19:40.213040 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.compute.api [None req-1a2385de-a621-4c79-acca-ccb9fca89039 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] [instance: d1a4fd6e-9323-416e-b844-5e526565774e] Fetching instance by UUID {{(pid=120799) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:19:40.219976 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-1a2385de-a621-4c79-acca-ccb9fca89039 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:19:40.220648 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-1a2385de-a621-4c79-acca-ccb9fca89039 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:19:40.221247 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-1a2385de-a621-4c79-acca-ccb9fca89039 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:19:40.222110 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-1a2385de-a621-4c79-acca-ccb9fca89039 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:19:40.222564 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-1a2385de-a621-4c79-acca-ccb9fca89039 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:19:40.222986 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-1a2385de-a621-4c79-acca-ccb9fca89039 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:19:40.363130 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.policy [None req-1a2385de-a621-4c79-acca-ccb9fca89039 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb28547f4b54c4097d2ffc3c533ca67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42af08ef367945939b1f59ffa8af351a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120799) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:19:40.373649 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.policy [None req-1a2385de-a621-4c79-acca-ccb9fca89039 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4fb28547f4b54c4097d2ffc3c533ca67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42af08ef367945939b1f59ffa8af351a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120799) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:19:40.375127 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.policy [None req-1a2385de-a621-4c79-acca-ccb9fca89039 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4fb28547f4b54c4097d2ffc3c533ca67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42af08ef367945939b1f59ffa8af351a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120799) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:19:40.376284 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-1a2385de-a621-4c79-acca-ccb9fca89039 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] 10.222.0.17 "GET /compute/v2.1/servers/d1a4fd6e-9323-416e-b844-5e526565774e" status: 200 len: 1805 microversion: 2.20 time: 0.169642 Aug 23 07:19:40.376832 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 392/758] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Aug 23 07:19:40 2022] GET /compute/v2.1/servers/d1a4fd6e-9323-416e-b844-5e526565774e => generated 1805 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 07:19:41.408069 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-31d17ea0-9bef-4334-9fd8-cf77e2fa6aad tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Calling method '>' {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:19:41.408712 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.compute.api [None req-31d17ea0-9bef-4334-9fd8-cf77e2fa6aad tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] [instance: d1a4fd6e-9323-416e-b844-5e526565774e] Fetching instance by UUID {{(pid=120798) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:19:41.416178 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-31d17ea0-9bef-4334-9fd8-cf77e2fa6aad tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:19:41.416693 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-31d17ea0-9bef-4334-9fd8-cf77e2fa6aad tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:19:41.417094 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-31d17ea0-9bef-4334-9fd8-cf77e2fa6aad tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:19:41.417804 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-31d17ea0-9bef-4334-9fd8-cf77e2fa6aad tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:19:41.418257 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-31d17ea0-9bef-4334-9fd8-cf77e2fa6aad tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:19:41.418668 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-31d17ea0-9bef-4334-9fd8-cf77e2fa6aad tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:19:41.559204 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.policy [None req-31d17ea0-9bef-4334-9fd8-cf77e2fa6aad tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb28547f4b54c4097d2ffc3c533ca67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42af08ef367945939b1f59ffa8af351a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120798) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:19:41.568398 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.policy [None req-31d17ea0-9bef-4334-9fd8-cf77e2fa6aad tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4fb28547f4b54c4097d2ffc3c533ca67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42af08ef367945939b1f59ffa8af351a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120798) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:19:41.570091 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.policy [None req-31d17ea0-9bef-4334-9fd8-cf77e2fa6aad tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4fb28547f4b54c4097d2ffc3c533ca67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42af08ef367945939b1f59ffa8af351a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120798) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:19:41.571551 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [None req-31d17ea0-9bef-4334-9fd8-cf77e2fa6aad tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] 10.222.0.17 "GET /compute/v2.1/servers/d1a4fd6e-9323-416e-b844-5e526565774e" status: 200 len: 1792 microversion: 2.20 time: 0.167553 Aug 23 07:19:41.572217 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 367/759] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Aug 23 07:19:41 2022] GET /compute/v2.1/servers/d1a4fd6e-9323-416e-b844-5e526565774e => generated 1792 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 07:20:11.304792 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-106e502b-0220-4ac9-b81c-b21f0d9082a3 tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] Calling method '>' {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:20:11.305381 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.compute.api [None req-106e502b-0220-4ac9-b81c-b21f0d9082a3 tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] [instance: 0c761eab-49ac-4396-9907-70845ad75c64] Fetching instance by UUID {{(pid=120799) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:20:11.306079 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [req-db09e60c-993a-4db0-8ee3-0283550a46ca req-1476b907-a2b6-45d3-8a12-46d719ff6d9b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0c761eab-49ac-4396-9907-70845ad75c64", "tag": "bb18fb15-817d-4f8a-9e7c-652d111e0cd7"}]} {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 07:20:11.308113 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG dbcounter [-] [120799] Writing DB stats nova_api:SELECT=9 {{(pid=120799) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:20:11.308765 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG dbcounter [-] [120799] Writing DB stats nova_cell1:SELECT=25 {{(pid=120799) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:20:11.313059 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG dbcounter [-] [120798] Writing DB stats nova_api:SELECT=5 {{(pid=120798) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:20:11.314032 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG dbcounter [-] [120798] Writing DB stats nova_cell1:SELECT=25 {{(pid=120798) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:20:11.316944 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-106e502b-0220-4ac9-b81c-b21f0d9082a3 tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:20:11.317541 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-106e502b-0220-4ac9-b81c-b21f0d9082a3 tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:20:11.318188 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-106e502b-0220-4ac9-b81c-b21f0d9082a3 tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:20:11.319157 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-106e502b-0220-4ac9-b81c-b21f0d9082a3 tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:20:11.320370 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-106e502b-0220-4ac9-b81c-b21f0d9082a3 tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:20:11.320701 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [req-db09e60c-993a-4db0-8ee3-0283550a46ca req-1476b907-a2b6-45d3-8a12-46d719ff6d9b service nova] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:20:11.320892 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-106e502b-0220-4ac9-b81c-b21f0d9082a3 tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:20:11.321233 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [req-db09e60c-993a-4db0-8ee3-0283550a46ca req-1476b907-a2b6-45d3-8a12-46d719ff6d9b service nova] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:20:11.321662 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [req-db09e60c-993a-4db0-8ee3-0283550a46ca req-1476b907-a2b6-45d3-8a12-46d719ff6d9b service nova] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:20:11.337696 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.compute.server_external_events [req-db09e60c-993a-4db0-8ee3-0283550a46ca req-1476b907-a2b6-45d3-8a12-46d719ff6d9b service nova] Creating event network-changed:bb18fb15-817d-4f8a-9e7c-652d111e0cd7 for instance 0c761eab-49ac-4396-9907-70845ad75c64 on hv-cinder-85409 Aug 23 07:20:11.343658 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [req-db09e60c-993a-4db0-8ee3-0283550a46ca req-1476b907-a2b6-45d3-8a12-46d719ff6d9b service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041734 Aug 23 07:20:11.344255 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 368/760] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Aug 23 07:20:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 07:20:11.357637 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.compute.api [None req-106e502b-0220-4ac9-b81c-b21f0d9082a3 tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] [instance: 0c761eab-49ac-4396-9907-70845ad75c64] Going to try to terminate instance {{(pid=120799) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 07:20:11.458420 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-106e502b-0220-4ac9-b81c-b21f0d9082a3 tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] 10.222.0.17 "DELETE /compute/v2.1/servers/0c761eab-49ac-4396-9907-70845ad75c64" status: 204 len: 0 microversion: 2.1 time: 0.157829 Aug 23 07:20:11.459294 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 393/761] 10.222.0.17 () {58 vars in 1239 bytes} [Tue Aug 23 07:20:11 2022] DELETE /compute/v2.1/servers/0c761eab-49ac-4396-9907-70845ad75c64 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 23 07:20:11.472304 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-ac48c7bd-dc17-49e3-b417-18c1d4eaf9e8 tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] Calling method '>' {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:20:11.473120 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.compute.api [None req-ac48c7bd-dc17-49e3-b417-18c1d4eaf9e8 tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] [instance: 0c761eab-49ac-4396-9907-70845ad75c64] Fetching instance by UUID {{(pid=120798) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:20:11.481751 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-ac48c7bd-dc17-49e3-b417-18c1d4eaf9e8 tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:20:11.482331 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-ac48c7bd-dc17-49e3-b417-18c1d4eaf9e8 tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:20:11.482830 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-ac48c7bd-dc17-49e3-b417-18c1d4eaf9e8 tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:20:11.484362 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-ac48c7bd-dc17-49e3-b417-18c1d4eaf9e8 tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:20:11.485059 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-ac48c7bd-dc17-49e3-b417-18c1d4eaf9e8 tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:20:11.485573 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-ac48c7bd-dc17-49e3-b417-18c1d4eaf9e8 tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:20:11.664193 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.policy [None req-ac48c7bd-dc17-49e3-b417-18c1d4eaf9e8 tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c26232f042844a898c19d1f63152b428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd004facbaed41a7a54a3ed6a6a44305', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120798) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:20:11.673700 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [None req-ac48c7bd-dc17-49e3-b417-18c1d4eaf9e8 tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] 10.222.0.17 "GET /compute/v2.1/servers/0c761eab-49ac-4396-9907-70845ad75c64" status: 200 len: 1565 microversion: 2.1 time: 0.207608 Aug 23 07:20:11.674373 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 369/762] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:20:11 2022] GET /compute/v2.1/servers/0c761eab-49ac-4396-9907-70845ad75c64 => generated 1565 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:20:12.697981 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-ca4a6c2e-cc71-45e4-a71d-ea8dd05c8e29 tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] Calling method '>' {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:20:12.698696 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.compute.api [None req-ca4a6c2e-cc71-45e4-a71d-ea8dd05c8e29 tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] [instance: 0c761eab-49ac-4396-9907-70845ad75c64] Fetching instance by UUID {{(pid=120799) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:20:12.705620 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-ca4a6c2e-cc71-45e4-a71d-ea8dd05c8e29 tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:20:12.706095 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-ca4a6c2e-cc71-45e4-a71d-ea8dd05c8e29 tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:20:12.706517 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-ca4a6c2e-cc71-45e4-a71d-ea8dd05c8e29 tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:20:12.707203 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-ca4a6c2e-cc71-45e4-a71d-ea8dd05c8e29 tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:20:12.707687 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-ca4a6c2e-cc71-45e4-a71d-ea8dd05c8e29 tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:20:12.708109 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-ca4a6c2e-cc71-45e4-a71d-ea8dd05c8e29 tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:20:12.905552 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.policy [None req-ca4a6c2e-cc71-45e4-a71d-ea8dd05c8e29 tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c26232f042844a898c19d1f63152b428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd004facbaed41a7a54a3ed6a6a44305', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120799) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:20:12.914262 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-ca4a6c2e-cc71-45e4-a71d-ea8dd05c8e29 tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] 10.222.0.17 "GET /compute/v2.1/servers/0c761eab-49ac-4396-9907-70845ad75c64" status: 200 len: 1565 microversion: 2.1 time: 0.220612 Aug 23 07:20:12.914762 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 394/763] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:20:12 2022] GET /compute/v2.1/servers/0c761eab-49ac-4396-9907-70845ad75c64 => generated 1565 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:20:13.740811 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [req-b8102474-e4ac-4ca4-803a-f313ae50f58a req-428a37cc-da1b-4c30-8e02-e44678db43c8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0c761eab-49ac-4396-9907-70845ad75c64", "name": "network-vif-deleted", "tag": "bb18fb15-817d-4f8a-9e7c-652d111e0cd7"}]} {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 07:20:13.753750 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [req-b8102474-e4ac-4ca4-803a-f313ae50f58a req-428a37cc-da1b-4c30-8e02-e44678db43c8 service nova] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:20:13.754224 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [req-b8102474-e4ac-4ca4-803a-f313ae50f58a req-428a37cc-da1b-4c30-8e02-e44678db43c8 service nova] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:20:13.755298 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [req-b8102474-e4ac-4ca4-803a-f313ae50f58a req-428a37cc-da1b-4c30-8e02-e44678db43c8 service nova] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:20:13.768201 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.compute.server_external_events [req-b8102474-e4ac-4ca4-803a-f313ae50f58a req-428a37cc-da1b-4c30-8e02-e44678db43c8 service nova] Creating event network-vif-deleted:bb18fb15-817d-4f8a-9e7c-652d111e0cd7 for instance 0c761eab-49ac-4396-9907-70845ad75c64 on hv-cinder-85409 Aug 23 07:20:13.774413 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [req-b8102474-e4ac-4ca4-803a-f313ae50f58a req-428a37cc-da1b-4c30-8e02-e44678db43c8 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038282 Aug 23 07:20:13.775034 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 370/764] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Aug 23 07:20:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 07:20:13.939580 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-6763b63b-4658-481e-b9fe-b7e56c0f090c tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] Calling method '>' {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:20:13.940492 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.compute.api [None req-6763b63b-4658-481e-b9fe-b7e56c0f090c tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] [instance: 0c761eab-49ac-4396-9907-70845ad75c64] Fetching instance by UUID {{(pid=120799) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:20:13.948667 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-6763b63b-4658-481e-b9fe-b7e56c0f090c tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:20:13.949153 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-6763b63b-4658-481e-b9fe-b7e56c0f090c tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:20:13.949580 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-6763b63b-4658-481e-b9fe-b7e56c0f090c tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:20:13.950259 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-6763b63b-4658-481e-b9fe-b7e56c0f090c tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:20:13.950708 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-6763b63b-4658-481e-b9fe-b7e56c0f090c tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:20:13.951124 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-6763b63b-4658-481e-b9fe-b7e56c0f090c tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:20:14.021760 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.policy [None req-6763b63b-4658-481e-b9fe-b7e56c0f090c tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c26232f042844a898c19d1f63152b428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd004facbaed41a7a54a3ed6a6a44305', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120799) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:20:14.031294 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-6763b63b-4658-481e-b9fe-b7e56c0f090c tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] 10.222.0.17 "GET /compute/v2.1/servers/0c761eab-49ac-4396-9907-70845ad75c64" status: 200 len: 1218 microversion: 2.1 time: 0.098443 Aug 23 07:20:14.032264 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 395/765] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:20:13 2022] GET /compute/v2.1/servers/0c761eab-49ac-4396-9907-70845ad75c64 => generated 1218 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:20:14.509197 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-4b75bcad-03ad-4527-bc6c-564ef17e2903 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Calling method '>' {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:20:14.509893 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.compute.api [None req-4b75bcad-03ad-4527-bc6c-564ef17e2903 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] [instance: d1a4fd6e-9323-416e-b844-5e526565774e] Fetching instance by UUID {{(pid=120798) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:20:14.516693 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-4b75bcad-03ad-4527-bc6c-564ef17e2903 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:20:14.517287 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-4b75bcad-03ad-4527-bc6c-564ef17e2903 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:20:14.517783 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-4b75bcad-03ad-4527-bc6c-564ef17e2903 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:20:14.518554 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-4b75bcad-03ad-4527-bc6c-564ef17e2903 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:20:14.519061 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-4b75bcad-03ad-4527-bc6c-564ef17e2903 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:20:14.519680 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-4b75bcad-03ad-4527-bc6c-564ef17e2903 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:20:14.549286 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [None req-4b75bcad-03ad-4527-bc6c-564ef17e2903 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] 10.222.0.17 "GET /compute/v2.1/servers/d1a4fd6e-9323-416e-b844-5e526565774e/os-volume_attachments/5181d549-b979-400c-aa21-c60f0f0b4c39" status: 200 len: 194 microversion: 2.20 time: 0.044788 Aug 23 07:20:14.549892 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 371/766] 10.222.0.17 () {60 vars in 1454 bytes} [Tue Aug 23 07:20:14 2022] GET /compute/v2.1/servers/d1a4fd6e-9323-416e-b844-5e526565774e/os-volume_attachments/5181d549-b979-400c-aa21-c60f0f0b4c39 => generated 194 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 23 07:20:14.616897 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-894aecd8-2563-4573-8a39-fee667b3895d tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Calling method '>' {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:20:14.617423 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.compute.api [None req-894aecd8-2563-4573-8a39-fee667b3895d tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] [instance: d1a4fd6e-9323-416e-b844-5e526565774e] Fetching instance by UUID {{(pid=120799) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:20:14.623711 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-894aecd8-2563-4573-8a39-fee667b3895d tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:20:14.624191 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-894aecd8-2563-4573-8a39-fee667b3895d tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:20:14.624621 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-894aecd8-2563-4573-8a39-fee667b3895d tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:20:14.625298 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-894aecd8-2563-4573-8a39-fee667b3895d tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:20:14.625743 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-894aecd8-2563-4573-8a39-fee667b3895d tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:20:14.626154 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-894aecd8-2563-4573-8a39-fee667b3895d tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:20:14.707186 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.objects.instance [None req-894aecd8-2563-4573-8a39-fee667b3895d tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lazy-loading 'services' on Instance uuid d1a4fd6e-9323-416e-b844-5e526565774e {{(pid=120799) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 07:20:14.784771 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-894aecd8-2563-4573-8a39-fee667b3895d tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] 10.222.0.17 "DELETE /compute/v2.1/servers/d1a4fd6e-9323-416e-b844-5e526565774e/os-volume_attachments/5181d549-b979-400c-aa21-c60f0f0b4c39" status: 202 len: 0 microversion: 2.20 time: 0.171753 Aug 23 07:20:14.785374 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 396/767] 10.222.0.17 () {60 vars in 1457 bytes} [Tue Aug 23 07:20:14 2022] DELETE /compute/v2.1/servers/d1a4fd6e-9323-416e-b844-5e526565774e/os-volume_attachments/5181d549-b979-400c-aa21-c60f0f0b4c39 => generated 0 bytes in 173 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 23 07:20:14.794348 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-33bd44e4-46c0-413f-bc22-98505bd9d587 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Calling method '>' {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:20:14.796564 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.compute.api [None req-33bd44e4-46c0-413f-bc22-98505bd9d587 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] [instance: d1a4fd6e-9323-416e-b844-5e526565774e] Fetching instance by UUID {{(pid=120798) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:20:14.803182 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-33bd44e4-46c0-413f-bc22-98505bd9d587 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:20:14.803689 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-33bd44e4-46c0-413f-bc22-98505bd9d587 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:20:14.804156 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-33bd44e4-46c0-413f-bc22-98505bd9d587 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:20:14.804849 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-33bd44e4-46c0-413f-bc22-98505bd9d587 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:20:14.805290 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-33bd44e4-46c0-413f-bc22-98505bd9d587 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:20:14.805901 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-33bd44e4-46c0-413f-bc22-98505bd9d587 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:20:14.838306 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [None req-33bd44e4-46c0-413f-bc22-98505bd9d587 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] 10.222.0.17 "GET /compute/v2.1/servers/d1a4fd6e-9323-416e-b844-5e526565774e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048092 Aug 23 07:20:14.838870 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 372/768] 10.222.0.17 () {60 vars in 1343 bytes} [Tue Aug 23 07:20:14 2022] GET /compute/v2.1/servers/d1a4fd6e-9323-416e-b844-5e526565774e/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 23 07:20:15.240100 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-755b6eba-9ce3-4539-b563-70f243ca9876 tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] Calling method '>' {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:20:15.240902 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.compute.api [None req-755b6eba-9ce3-4539-b563-70f243ca9876 tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] [instance: 0c761eab-49ac-4396-9907-70845ad75c64] Fetching instance by UUID {{(pid=120799) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:20:15.248296 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-755b6eba-9ce3-4539-b563-70f243ca9876 tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:20:15.248772 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-755b6eba-9ce3-4539-b563-70f243ca9876 tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:20:15.249196 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-755b6eba-9ce3-4539-b563-70f243ca9876 tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:20:15.249862 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-755b6eba-9ce3-4539-b563-70f243ca9876 tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:20:15.250310 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-755b6eba-9ce3-4539-b563-70f243ca9876 tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:20:15.250717 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-755b6eba-9ce3-4539-b563-70f243ca9876 tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:20:15.266410 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.wsgi [None req-755b6eba-9ce3-4539-b563-70f243ca9876 tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] HTTP exception thrown: Instance 0c761eab-49ac-4396-9907-70845ad75c64 could not be found. Aug 23 07:20:15.268109 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-755b6eba-9ce3-4539-b563-70f243ca9876 tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] Request method failure captured: Aug 23 07:20:15.268109 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: request: GET /compute/v2.1/servers/0c761eab-49ac-4396-9907-70845ad75c64 HTTP/1.1 Aug 23 07:20:15.268109 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: Accept: application/json Aug 23 07:20:15.268109 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: Accept-Encoding: identity Aug 23 07:20:15.268109 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: Connection: close Aug 23 07:20:15.268109 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: Content-Length: 0 Aug 23 07:20:15.268109 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: Content-Type: application/json Aug 23 07:20:15.268109 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: Host: 10.222.0.17 Aug 23 07:20:15.268109 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: Openstack-System-Scope: None Aug 23 07:20:15.268109 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: User-Agent: python-urllib3/1.26.11 Aug 23 07:20:15.268109 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-Auth-Token: gAAAAABjBH53gjgp7pPhZIfE-SiW3AX9JBQz3K1gc6-LUeBIIITuXAmL21DJOJcaGngQw6WOrtQLRqSxCjE2dRB1hmuyvlEfh_axlYkwDNgG6P6HTSIlZPIs5QfF7uluzKiqY310g-oIB1T_5tbW7HLkL30Xtb0NoQifiGaAUBYhxR7vDlYthNg Aug 23 07:20:15.268109 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-Domain-Id: None Aug 23 07:20:15.268109 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-Domain-Name: None Aug 23 07:20:15.268109 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-Identity-Status: Confirmed Aug 23 07:20:15.268109 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-Is-Admin-Project: True Aug 23 07:20:15.268109 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-Project-Domain-Id: default Aug 23 07:20:15.268109 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-Project-Domain-Name: Default Aug 23 07:20:15.268109 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-Project-Id: fd004facbaed41a7a54a3ed6a6a44305 Aug 23 07:20:15.268109 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-Project-Name: tempest-TestShelveInstance-371580047 Aug 23 07:20:15.268109 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-Role: reader,member Aug 23 07:20:15.268109 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-Roles: reader,member Aug 23 07:20:15.269822 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/fd004facbaed41a7a54a3ed6a6a44305"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/fd004facbaed41a7a54a3ed6a6a44305"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_fd004facbaed41a7a54a3ed6a6a44305"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/fd004facbaed41a7a54a3ed6a6a44305"}]}] Aug 23 07:20:15.269822 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-Tenant: tempest-TestShelveInstance-371580047 Aug 23 07:20:15.269822 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-Tenant-Id: fd004facbaed41a7a54a3ed6a6a44305 Aug 23 07:20:15.269822 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-Tenant-Name: tempest-TestShelveInstance-371580047 Aug 23 07:20:15.269822 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-User: tempest-TestShelveInstance-371580047-project Aug 23 07:20:15.269822 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-User-Domain-Id: default Aug 23 07:20:15.269822 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-User-Domain-Name: Default Aug 23 07:20:15.269822 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-User-Id: c26232f042844a898c19d1f63152b428 Aug 23 07:20:15.269822 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-User-Name: tempest-TestShelveInstance-371580047-project Aug 23 07:20:15.269822 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: method: > Aug 23 07:20:15.269822 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: exception: Instance 0c761eab-49ac-4396-9907-70845ad75c64 could not be found. Aug 23 07:20:15.269822 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: action_args: {'id': '0c761eab-49ac-4396-9907-70845ad75c64'} Aug 23 07:20:15.270681 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 07:20:15.270681 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 07:20:15.270681 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 07:20:15.270681 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 07:20:15.270681 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 07:20:15.270681 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 07:20:15.270681 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 07:20:15.270681 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 07:20:15.270681 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 07:20:15.270681 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 07:20:15.270681 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0c761eab-49ac-4396-9907-70845ad75c64 could not be found. Aug 23 07:20:15.270681 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi Aug 23 07:20:15.270681 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 07:20:15.270681 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi Aug 23 07:20:15.270681 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 07:20:15.270681 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 07:20:15.270681 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 07:20:15.270681 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 07:20:15.270681 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 07:20:15.270681 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 07:20:15.272024 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 07:20:15.272024 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 07:20:15.272024 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 07:20:15.272024 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 07:20:15.272024 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 07:20:15.272024 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 07:20:15.272024 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 07:20:15.272024 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0c761eab-49ac-4396-9907-70845ad75c64 could not be found. Aug 23 07:20:15.272024 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi Aug 23 07:20:15.272024 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 07:20:15.272024 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi Aug 23 07:20:15.272024 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 07:20:15.272024 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 07:20:15.272024 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 07:20:15.272024 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 07:20:15.272024 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 07:20:15.272024 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0c761eab-49ac-4396-9907-70845ad75c64 could not be found. Aug 23 07:20:15.272024 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi Aug 23 07:20:15.273612 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-755b6eba-9ce3-4539-b563-70f243ca9876 tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] Returning 404 to user: Instance 0c761eab-49ac-4396-9907-70845ad75c64 could not be found. {{(pid=120799) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 07:20:15.273612 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-755b6eba-9ce3-4539-b563-70f243ca9876 tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] 10.222.0.17 "GET /compute/v2.1/servers/0c761eab-49ac-4396-9907-70845ad75c64" status: 404 len: 111 microversion: 2.1 time: 0.219494 Aug 23 07:20:15.273612 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 397/769] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:20:15 2022] GET /compute/v2.1/servers/0c761eab-49ac-4396-9907-70845ad75c64 => generated 111 bytes in 221 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 07:20:15.447662 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-60d46a21-12ca-45d7-84c6-d6c5c48211e0 tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] Calling method '.version_select at 0x7fe3c580ddc0>' {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:20:15.472687 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [None req-60d46a21-12ca-45d7-84c6-d6c5c48211e0 tempest-TestShelveInstance-371580047 tempest-TestShelveInstance-371580047-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-118391273" status: 202 len: 0 microversion: 2.1 time: 0.030913 Aug 23 07:20:15.473317 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 373/770] 10.222.0.17 () {58 vars in 1251 bytes} [Tue Aug 23 07:20:15 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-118391273 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 07:20:15.851162 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-b46dbc39-a985-429b-80e0-5686266602e1 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Calling method '>' {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:20:15.853803 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.compute.api [None req-b46dbc39-a985-429b-80e0-5686266602e1 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] [instance: d1a4fd6e-9323-416e-b844-5e526565774e] Fetching instance by UUID {{(pid=120799) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:20:15.859853 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-b46dbc39-a985-429b-80e0-5686266602e1 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:20:15.860333 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-b46dbc39-a985-429b-80e0-5686266602e1 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:20:15.860761 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-b46dbc39-a985-429b-80e0-5686266602e1 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:20:15.861444 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-b46dbc39-a985-429b-80e0-5686266602e1 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:20:15.861869 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-b46dbc39-a985-429b-80e0-5686266602e1 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:20:15.862307 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-b46dbc39-a985-429b-80e0-5686266602e1 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:20:15.892203 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-b46dbc39-a985-429b-80e0-5686266602e1 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] 10.222.0.17 "GET /compute/v2.1/servers/d1a4fd6e-9323-416e-b844-5e526565774e/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.045619 Aug 23 07:20:15.892735 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 398/771] 10.222.0.17 () {60 vars in 1343 bytes} [Tue Aug 23 07:20:15 2022] GET /compute/v2.1/servers/d1a4fd6e-9323-416e-b844-5e526565774e/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:20:15.956992 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-8cae38b1-4d12-4a13-983b-21bfa94d4c72 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Calling method '>' {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:20:15.957584 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.compute.api [None req-8cae38b1-4d12-4a13-983b-21bfa94d4c72 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] [instance: d1a4fd6e-9323-416e-b844-5e526565774e] Fetching instance by UUID {{(pid=120798) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:20:15.965096 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-8cae38b1-4d12-4a13-983b-21bfa94d4c72 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:20:15.965574 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-8cae38b1-4d12-4a13-983b-21bfa94d4c72 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:20:15.965994 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-8cae38b1-4d12-4a13-983b-21bfa94d4c72 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:20:15.966677 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-8cae38b1-4d12-4a13-983b-21bfa94d4c72 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:20:15.967121 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-8cae38b1-4d12-4a13-983b-21bfa94d4c72 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:20:15.967542 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-8cae38b1-4d12-4a13-983b-21bfa94d4c72 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:20:15.992708 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.compute.api [None req-8cae38b1-4d12-4a13-983b-21bfa94d4c72 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] [instance: d1a4fd6e-9323-416e-b844-5e526565774e] Going to try to terminate instance {{(pid=120798) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 07:20:16.072050 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [None req-8cae38b1-4d12-4a13-983b-21bfa94d4c72 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] 10.222.0.17 "DELETE /compute/v2.1/servers/d1a4fd6e-9323-416e-b844-5e526565774e" status: 204 len: 0 microversion: 2.20 time: 0.119227 Aug 23 07:20:16.072951 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 374/772] 10.222.0.17 () {60 vars in 1280 bytes} [Tue Aug 23 07:20:15 2022] DELETE /compute/v2.1/servers/d1a4fd6e-9323-416e-b844-5e526565774e => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 23 07:20:16.081950 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-ab4cf8b2-b15a-4186-90ca-82cfd6b189bc tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Calling method '>' {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:20:16.082616 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.compute.api [None req-ab4cf8b2-b15a-4186-90ca-82cfd6b189bc tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] [instance: d1a4fd6e-9323-416e-b844-5e526565774e] Fetching instance by UUID {{(pid=120799) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:20:16.090427 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-ab4cf8b2-b15a-4186-90ca-82cfd6b189bc tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:20:16.090923 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-ab4cf8b2-b15a-4186-90ca-82cfd6b189bc tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:20:16.091610 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-ab4cf8b2-b15a-4186-90ca-82cfd6b189bc tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:20:16.092311 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-ab4cf8b2-b15a-4186-90ca-82cfd6b189bc tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:20:16.092762 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-ab4cf8b2-b15a-4186-90ca-82cfd6b189bc tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:20:16.093180 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-ab4cf8b2-b15a-4186-90ca-82cfd6b189bc tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:20:16.234811 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.policy [None req-ab4cf8b2-b15a-4186-90ca-82cfd6b189bc tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb28547f4b54c4097d2ffc3c533ca67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42af08ef367945939b1f59ffa8af351a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120799) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:20:16.243478 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.policy [None req-ab4cf8b2-b15a-4186-90ca-82cfd6b189bc tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4fb28547f4b54c4097d2ffc3c533ca67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42af08ef367945939b1f59ffa8af351a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120799) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:20:16.245026 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.policy [None req-ab4cf8b2-b15a-4186-90ca-82cfd6b189bc tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4fb28547f4b54c4097d2ffc3c533ca67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42af08ef367945939b1f59ffa8af351a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120799) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:20:16.246186 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-ab4cf8b2-b15a-4186-90ca-82cfd6b189bc tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] 10.222.0.17 "GET /compute/v2.1/servers/d1a4fd6e-9323-416e-b844-5e526565774e" status: 200 len: 1720 microversion: 2.20 time: 0.168841 Aug 23 07:20:16.246769 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 399/773] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Aug 23 07:20:16 2022] GET /compute/v2.1/servers/d1a4fd6e-9323-416e-b844-5e526565774e => generated 1720 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 07:20:17.270958 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-ce6e1092-49b3-47ea-9616-24049e4e94d7 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Calling method '>' {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:20:17.271847 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.compute.api [None req-ce6e1092-49b3-47ea-9616-24049e4e94d7 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] [instance: d1a4fd6e-9323-416e-b844-5e526565774e] Fetching instance by UUID {{(pid=120798) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:20:17.279060 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-ce6e1092-49b3-47ea-9616-24049e4e94d7 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:20:17.279578 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-ce6e1092-49b3-47ea-9616-24049e4e94d7 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:20:17.280011 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-ce6e1092-49b3-47ea-9616-24049e4e94d7 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:20:17.280712 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-ce6e1092-49b3-47ea-9616-24049e4e94d7 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:20:17.281158 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-ce6e1092-49b3-47ea-9616-24049e4e94d7 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:20:17.281576 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-ce6e1092-49b3-47ea-9616-24049e4e94d7 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:20:17.504435 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.policy [None req-ce6e1092-49b3-47ea-9616-24049e4e94d7 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb28547f4b54c4097d2ffc3c533ca67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42af08ef367945939b1f59ffa8af351a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120798) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:20:17.513161 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.policy [None req-ce6e1092-49b3-47ea-9616-24049e4e94d7 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4fb28547f4b54c4097d2ffc3c533ca67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42af08ef367945939b1f59ffa8af351a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120798) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:20:17.514657 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.policy [None req-ce6e1092-49b3-47ea-9616-24049e4e94d7 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4fb28547f4b54c4097d2ffc3c533ca67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42af08ef367945939b1f59ffa8af351a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120798) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:20:17.515843 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [None req-ce6e1092-49b3-47ea-9616-24049e4e94d7 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] 10.222.0.17 "GET /compute/v2.1/servers/d1a4fd6e-9323-416e-b844-5e526565774e" status: 200 len: 1720 microversion: 2.20 time: 0.250110 Aug 23 07:20:17.516376 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 375/774] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Aug 23 07:20:17 2022] GET /compute/v2.1/servers/d1a4fd6e-9323-416e-b844-5e526565774e => generated 1720 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 07:20:18.461032 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [req-8348f3c6-72c9-498e-b490-66372f96a911 req-c7b39594-95d6-4145-aaa6-6d00d865926d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d1a4fd6e-9323-416e-b844-5e526565774e", "name": "network-vif-deleted", "tag": "4e45252a-a4b1-488a-9f32-2c668277cefd"}]} {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 07:20:18.473989 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [req-8348f3c6-72c9-498e-b490-66372f96a911 req-c7b39594-95d6-4145-aaa6-6d00d865926d service nova] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:20:18.474457 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [req-8348f3c6-72c9-498e-b490-66372f96a911 req-c7b39594-95d6-4145-aaa6-6d00d865926d service nova] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:20:18.475052 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [req-8348f3c6-72c9-498e-b490-66372f96a911 req-c7b39594-95d6-4145-aaa6-6d00d865926d service nova] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:20:18.496472 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.compute.server_external_events [req-8348f3c6-72c9-498e-b490-66372f96a911 req-c7b39594-95d6-4145-aaa6-6d00d865926d service nova] Creating event network-vif-deleted:4e45252a-a4b1-488a-9f32-2c668277cefd for instance d1a4fd6e-9323-416e-b844-5e526565774e on hv-cinder-85409 Aug 23 07:20:18.528163 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [req-8348f3c6-72c9-498e-b490-66372f96a911 req-c7b39594-95d6-4145-aaa6-6d00d865926d service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070676 Aug 23 07:20:18.529092 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 400/775] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Aug 23 07:20:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 07:20:18.540317 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-ba0a5823-9e88-4553-bc0b-45307fb7818b tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Calling method '>' {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:20:18.540989 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.compute.api [None req-ba0a5823-9e88-4553-bc0b-45307fb7818b tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] [instance: d1a4fd6e-9323-416e-b844-5e526565774e] Fetching instance by UUID {{(pid=120798) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:20:18.552552 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-ba0a5823-9e88-4553-bc0b-45307fb7818b tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:20:18.553332 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-ba0a5823-9e88-4553-bc0b-45307fb7818b tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:20:18.553770 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-ba0a5823-9e88-4553-bc0b-45307fb7818b tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:20:18.554484 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-ba0a5823-9e88-4553-bc0b-45307fb7818b tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:20:18.554934 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-ba0a5823-9e88-4553-bc0b-45307fb7818b tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:20:18.564338 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-ba0a5823-9e88-4553-bc0b-45307fb7818b tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:20:18.611272 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-ba0a5823-9e88-4553-bc0b-45307fb7818b tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:20:18.611797 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-ba0a5823-9e88-4553-bc0b-45307fb7818b tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:20:18.612226 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-ba0a5823-9e88-4553-bc0b-45307fb7818b tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:20:18.613810 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.objects.instance [None req-ba0a5823-9e88-4553-bc0b-45307fb7818b tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lazy-loading 'fault' on Instance uuid d1a4fd6e-9323-416e-b844-5e526565774e {{(pid=120798) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 07:20:18.672981 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.policy [None req-ba0a5823-9e88-4553-bc0b-45307fb7818b tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb28547f4b54c4097d2ffc3c533ca67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42af08ef367945939b1f59ffa8af351a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120798) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:20:18.685688 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.policy [None req-ba0a5823-9e88-4553-bc0b-45307fb7818b tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4fb28547f4b54c4097d2ffc3c533ca67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42af08ef367945939b1f59ffa8af351a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120798) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:20:18.696125 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.policy [None req-ba0a5823-9e88-4553-bc0b-45307fb7818b tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4fb28547f4b54c4097d2ffc3c533ca67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42af08ef367945939b1f59ffa8af351a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120798) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:20:18.700940 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [None req-ba0a5823-9e88-4553-bc0b-45307fb7818b tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] 10.222.0.17 "GET /compute/v2.1/servers/d1a4fd6e-9323-416e-b844-5e526565774e" status: 200 len: 1370 microversion: 2.20 time: 0.163671 Aug 23 07:20:18.703052 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 376/776] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Aug 23 07:20:18 2022] GET /compute/v2.1/servers/d1a4fd6e-9323-416e-b844-5e526565774e => generated 1370 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 07:20:19.731491 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-ef2c7e31-acf5-40e5-a89b-4274ecb844ab tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Calling method '>' {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:20:19.732174 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.compute.api [None req-ef2c7e31-acf5-40e5-a89b-4274ecb844ab tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] [instance: d1a4fd6e-9323-416e-b844-5e526565774e] Fetching instance by UUID {{(pid=120799) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:20:19.738962 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-ef2c7e31-acf5-40e5-a89b-4274ecb844ab tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:20:19.739462 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-ef2c7e31-acf5-40e5-a89b-4274ecb844ab tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:20:19.739889 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-ef2c7e31-acf5-40e5-a89b-4274ecb844ab tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:20:19.740568 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-ef2c7e31-acf5-40e5-a89b-4274ecb844ab tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:20:19.741186 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-ef2c7e31-acf5-40e5-a89b-4274ecb844ab tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:20:19.741601 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-ef2c7e31-acf5-40e5-a89b-4274ecb844ab tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:20:19.757952 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.wsgi [None req-ef2c7e31-acf5-40e5-a89b-4274ecb844ab tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] HTTP exception thrown: Instance d1a4fd6e-9323-416e-b844-5e526565774e could not be found. Aug 23 07:20:19.760101 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-ef2c7e31-acf5-40e5-a89b-4274ecb844ab tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Request method failure captured: Aug 23 07:20:19.760101 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: request: GET /compute/v2.1/servers/d1a4fd6e-9323-416e-b844-5e526565774e HTTP/1.1 Aug 23 07:20:19.760101 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: Accept: application/json Aug 23 07:20:19.760101 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: Accept-Encoding: identity Aug 23 07:20:19.760101 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: Connection: close Aug 23 07:20:19.760101 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: Content-Length: 0 Aug 23 07:20:19.760101 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: Content-Type: application/json Aug 23 07:20:19.760101 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: Host: 10.222.0.17 Aug 23 07:20:19.760101 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: Openstack-System-Scope: None Aug 23 07:20:19.760101 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: User-Agent: python-urllib3/1.26.11 Aug 23 07:20:19.760101 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-Auth-Token: gAAAAABjBH8gf3UChNGPZW_cNDeh-tJLHXLBVzvbBrPSKl-a3HClyt6XlUlyHLtHAEXAIOzYSWxN98rtyIGbmdYmXwgDPpTb73aRo6P-4660YglmDugOz6hR7meQeL1MIMDJnrgZDrTKBX-0PDg6-4h8UUfzoD8XAUx2khQb9L88BQ5JdAEEvSU Aug 23 07:20:19.760101 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-Domain-Id: None Aug 23 07:20:19.760101 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-Domain-Name: None Aug 23 07:20:19.760101 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-Identity-Status: Confirmed Aug 23 07:20:19.760101 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-Is-Admin-Project: True Aug 23 07:20:19.760101 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-Openstack-Nova-Api-Version: 2.20 Aug 23 07:20:19.760101 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-Project-Domain-Id: default Aug 23 07:20:19.760101 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-Project-Domain-Name: Default Aug 23 07:20:19.760101 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-Project-Id: 42af08ef367945939b1f59ffa8af351a Aug 23 07:20:19.760101 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-564110610 Aug 23 07:20:19.760101 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-Role: reader,member Aug 23 07:20:19.760101 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-Roles: reader,member Aug 23 07:20:19.761538 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/42af08ef367945939b1f59ffa8af351a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/42af08ef367945939b1f59ffa8af351a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_42af08ef367945939b1f59ffa8af351a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/42af08ef367945939b1f59ffa8af351a"}]}] Aug 23 07:20:19.761538 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-Tenant: tempest-AttachVolumeShelveTestJSON-564110610 Aug 23 07:20:19.761538 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-Tenant-Id: 42af08ef367945939b1f59ffa8af351a Aug 23 07:20:19.761538 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-564110610 Aug 23 07:20:19.761538 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-User: tempest-AttachVolumeShelveTestJSON-564110610-project Aug 23 07:20:19.761538 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-User-Domain-Id: default Aug 23 07:20:19.761538 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-User-Domain-Name: Default Aug 23 07:20:19.761538 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-User-Id: 4fb28547f4b54c4097d2ffc3c533ca67 Aug 23 07:20:19.761538 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-User-Name: tempest-AttachVolumeShelveTestJSON-564110610-project Aug 23 07:20:19.761538 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: method: > Aug 23 07:20:19.761538 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: exception: Instance d1a4fd6e-9323-416e-b844-5e526565774e could not be found. Aug 23 07:20:19.761538 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: action_args: {'id': 'd1a4fd6e-9323-416e-b844-5e526565774e'} Aug 23 07:20:19.762297 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 07:20:19.762297 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 07:20:19.762297 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 07:20:19.762297 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 07:20:19.762297 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 07:20:19.762297 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 07:20:19.762297 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 07:20:19.762297 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 07:20:19.762297 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 07:20:19.762297 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 07:20:19.762297 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d1a4fd6e-9323-416e-b844-5e526565774e could not be found. Aug 23 07:20:19.762297 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi Aug 23 07:20:19.762297 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 07:20:19.762297 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi Aug 23 07:20:19.762297 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 07:20:19.762297 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 07:20:19.762297 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 07:20:19.762297 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 07:20:19.762297 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 07:20:19.762297 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 07:20:19.763489 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 07:20:19.763489 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 07:20:19.763489 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 07:20:19.763489 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 07:20:19.763489 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 07:20:19.763489 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 07:20:19.763489 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 07:20:19.763489 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d1a4fd6e-9323-416e-b844-5e526565774e could not be found. Aug 23 07:20:19.763489 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi Aug 23 07:20:19.763489 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 07:20:19.763489 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi Aug 23 07:20:19.763489 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 07:20:19.763489 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 07:20:19.763489 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 07:20:19.763489 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 07:20:19.763489 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 07:20:19.763489 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d1a4fd6e-9323-416e-b844-5e526565774e could not be found. Aug 23 07:20:19.763489 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi Aug 23 07:20:19.764604 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-ef2c7e31-acf5-40e5-a89b-4274ecb844ab tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Returning 404 to user: Instance d1a4fd6e-9323-416e-b844-5e526565774e could not be found. {{(pid=120799) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 07:20:19.764604 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-ef2c7e31-acf5-40e5-a89b-4274ecb844ab tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] 10.222.0.17 "GET /compute/v2.1/servers/d1a4fd6e-9323-416e-b844-5e526565774e" status: 404 len: 111 microversion: 2.20 time: 0.035016 Aug 23 07:20:19.764604 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 401/777] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Aug 23 07:20:19 2022] GET /compute/v2.1/servers/d1a4fd6e-9323-416e-b844-5e526565774e => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 23 07:20:19.770308 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-b5f2a98a-87bb-4c91-b227-4ef1648bbed2 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Calling method '.version_select at 0x7fe3c577d8b0>' {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:20:19.792913 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [None req-b5f2a98a-87bb-4c91-b227-4ef1648bbed2 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-172953591" status: 204 len: 0 microversion: 2.20 time: 0.026342 Aug 23 07:20:19.793768 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 377/778] 10.222.0.17 () {60 vars in 1259 bytes} [Tue Aug 23 07:20:19 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-172953591 => generated 0 bytes in 28 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 23 07:20:21.066233 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-044a845d-a3ef-498c-96e6-e680574af835 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Action: 'create', calling method: .version_select at 0x7fe3c581dee0>, body: {"keypair": {"name": "tempest-keypair-85048611", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHdfYUrrHIMqdXaR0BRozWsQviJVE35Finh+8xA91W31CGdPWyevzzarwAIHBUheecrQ+8K+z9J1VOS21lQ1lXvYm5yqWLzZU6W5d57yFZKSkf/bpiHQho63GAZpuW3olQ=="}} {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 07:20:21.085590 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.quota [None req-044a845d-a3ef-498c-96e6-e680574af835 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Getting quotas for project 42af08ef367945939b1f59ffa8af351a. Resources: {'key_pairs'} {{(pid=120799) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 07:20:21.090085 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.quota [None req-044a845d-a3ef-498c-96e6-e680574af835 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Getting quotas for user 4fb28547f4b54c4097d2ffc3c533ca67 and project 42af08ef367945939b1f59ffa8af351a. Resources: {'key_pairs'} {{(pid=120799) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 07:20:21.113710 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-044a845d-a3ef-498c-96e6-e680574af835 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 201 len: 399 microversion: 2.20 time: 0.051349 Aug 23 07:20:21.114307 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 402/779] 10.222.0.17 () {62 vars in 1200 bytes} [Tue Aug 23 07:20:21 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 53 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 23 07:20:22.527888 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-5c0dfa99-0b2f-407a-bad7-583ca54656ec tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-645133165", "imageRef": "b899fd65-02ae-4b43-bac7-86f38fc3f224", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "e2ad1a62-8403-4dc6-a38f-0eaf29c3b166"}], "security_groups": [{"name": "tempest-securitygroup--177021263"}], "key_name": "tempest-keypair-85048611", "user_data": "}} {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 07:20:22.642501 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.network.neutron [None req-5c0dfa99-0b2f-407a-bad7-583ca54656ec tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] validate_networks() for [('e2ad1a62-8403-4dc6-a38f-0eaf29c3b166', None, None, None, None, None)] {{(pid=120798) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 23 07:20:23.167628 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.virt.hardware [None req-5c0dfa99-0b2f-407a-bad7-583ca54656ec tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Flavor limits 0:0:0 {{(pid=120798) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 07:20:23.168044 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.virt.hardware [None req-5c0dfa99-0b2f-407a-bad7-583ca54656ec tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Image limits 0:0:0 {{(pid=120798) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 07:20:23.168564 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.virt.hardware [None req-5c0dfa99-0b2f-407a-bad7-583ca54656ec tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Flavor pref 0:0:0 {{(pid=120798) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 07:20:23.168971 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.virt.hardware [None req-5c0dfa99-0b2f-407a-bad7-583ca54656ec tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Image pref 0:0:0 {{(pid=120798) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 07:20:23.169565 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.virt.hardware [None req-5c0dfa99-0b2f-407a-bad7-583ca54656ec tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120798) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 07:20:23.178721 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-5c0dfa99-0b2f-407a-bad7-583ca54656ec tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:20:23.179196 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-5c0dfa99-0b2f-407a-bad7-583ca54656ec tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:20:23.179652 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-5c0dfa99-0b2f-407a-bad7-583ca54656ec tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:20:23.180365 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-5c0dfa99-0b2f-407a-bad7-583ca54656ec tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:20:23.180947 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-5c0dfa99-0b2f-407a-bad7-583ca54656ec tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:20:23.181367 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-5c0dfa99-0b2f-407a-bad7-583ca54656ec tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:20:23.200419 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.quota [None req-5c0dfa99-0b2f-407a-bad7-583ca54656ec tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Getting quotas for project 42af08ef367945939b1f59ffa8af351a. Resources: {'ram', 'instances', 'cores'} {{(pid=120798) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 07:20:23.205328 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.quota [None req-5c0dfa99-0b2f-407a-bad7-583ca54656ec tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Getting quotas for user 4fb28547f4b54c4097d2ffc3c533ca67 and project 42af08ef367945939b1f59ffa8af351a. Resources: {'ram', 'instances', 'cores'} {{(pid=120798) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 07:20:23.217179 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.compute.api [None req-5c0dfa99-0b2f-407a-bad7-583ca54656ec tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Going to run 1 instances... {{(pid=120798) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 23 07:20:23.220722 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.compute.api [None req-5c0dfa99-0b2f-407a-bad7-583ca54656ec tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] [instance: 971419a3-e367-44fc-b6b4-10543aa4ab52] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b899fd65-02ae-4b43-bac7-86f38fc3f224',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120798) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 07:20:23.273638 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [None req-5c0dfa99-0b2f-407a-bad7-583ca54656ec tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.750320 Aug 23 07:20:23.280953 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 378/780] 10.222.0.17 () {62 vars in 1188 bytes} [Tue Aug 23 07:20:22 2022] POST /compute/v2.1/servers => generated 401 bytes in 752 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 23 07:20:23.286722 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-ab4c4fe3-d0bf-4433-875d-b14b09994e54 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Calling method '>' {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:20:23.287338 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.compute.api [None req-ab4c4fe3-d0bf-4433-875d-b14b09994e54 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] [instance: 971419a3-e367-44fc-b6b4-10543aa4ab52] Fetching instance by UUID {{(pid=120799) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:20:23.356845 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.policy [None req-ab4c4fe3-d0bf-4433-875d-b14b09994e54 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb28547f4b54c4097d2ffc3c533ca67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42af08ef367945939b1f59ffa8af351a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120799) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:20:23.377262 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.policy [None req-ab4c4fe3-d0bf-4433-875d-b14b09994e54 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4fb28547f4b54c4097d2ffc3c533ca67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42af08ef367945939b1f59ffa8af351a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120799) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:20:23.378991 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.policy [None req-ab4c4fe3-d0bf-4433-875d-b14b09994e54 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4fb28547f4b54c4097d2ffc3c533ca67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42af08ef367945939b1f59ffa8af351a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120799) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:20:23.380159 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-ab4c4fe3-d0bf-4433-875d-b14b09994e54 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] 10.222.0.17 "GET /compute/v2.1/servers/971419a3-e367-44fc-b6b4-10543aa4ab52" status: 200 len: 1279 microversion: 2.20 time: 0.097501 Aug 23 07:20:23.381073 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 403/781] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Aug 23 07:20:23 2022] GET /compute/v2.1/servers/971419a3-e367-44fc-b6b4-10543aa4ab52 => generated 1279 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 07:20:24.406269 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-54ec4e96-b88e-4a7a-a7db-93c9f55ecc92 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Calling method '>' {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:20:24.406872 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.compute.api [None req-54ec4e96-b88e-4a7a-a7db-93c9f55ecc92 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] [instance: 971419a3-e367-44fc-b6b4-10543aa4ab52] Fetching instance by UUID {{(pid=120798) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:20:24.413427 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-54ec4e96-b88e-4a7a-a7db-93c9f55ecc92 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:20:24.414556 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-54ec4e96-b88e-4a7a-a7db-93c9f55ecc92 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:20:24.415085 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-54ec4e96-b88e-4a7a-a7db-93c9f55ecc92 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:20:24.416053 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-54ec4e96-b88e-4a7a-a7db-93c9f55ecc92 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:20:24.416547 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-54ec4e96-b88e-4a7a-a7db-93c9f55ecc92 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:20:24.416963 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-54ec4e96-b88e-4a7a-a7db-93c9f55ecc92 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:20:24.486444 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.policy [None req-54ec4e96-b88e-4a7a-a7db-93c9f55ecc92 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb28547f4b54c4097d2ffc3c533ca67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42af08ef367945939b1f59ffa8af351a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120798) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:20:24.496494 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.policy [None req-54ec4e96-b88e-4a7a-a7db-93c9f55ecc92 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4fb28547f4b54c4097d2ffc3c533ca67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42af08ef367945939b1f59ffa8af351a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120798) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:20:24.498024 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.policy [None req-54ec4e96-b88e-4a7a-a7db-93c9f55ecc92 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4fb28547f4b54c4097d2ffc3c533ca67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42af08ef367945939b1f59ffa8af351a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120798) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:20:24.499126 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [None req-54ec4e96-b88e-4a7a-a7db-93c9f55ecc92 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] 10.222.0.17 "GET /compute/v2.1/servers/971419a3-e367-44fc-b6b4-10543aa4ab52" status: 200 len: 1337 microversion: 2.20 time: 0.097911 Aug 23 07:20:24.499710 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 379/782] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Aug 23 07:20:24 2022] GET /compute/v2.1/servers/971419a3-e367-44fc-b6b4-10543aa4ab52 => generated 1337 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 07:20:25.522243 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-245cc88b-f776-47b4-93fc-e8f32eef23d0 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Calling method '>' {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:20:25.522816 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.compute.api [None req-245cc88b-f776-47b4-93fc-e8f32eef23d0 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] [instance: 971419a3-e367-44fc-b6b4-10543aa4ab52] Fetching instance by UUID {{(pid=120799) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:20:25.530152 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-245cc88b-f776-47b4-93fc-e8f32eef23d0 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:20:25.530637 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-245cc88b-f776-47b4-93fc-e8f32eef23d0 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:20:25.531057 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-245cc88b-f776-47b4-93fc-e8f32eef23d0 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:20:25.531800 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-245cc88b-f776-47b4-93fc-e8f32eef23d0 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:20:25.532188 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-245cc88b-f776-47b4-93fc-e8f32eef23d0 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:20:25.532601 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-245cc88b-f776-47b4-93fc-e8f32eef23d0 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:20:25.669858 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.policy [None req-245cc88b-f776-47b4-93fc-e8f32eef23d0 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb28547f4b54c4097d2ffc3c533ca67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42af08ef367945939b1f59ffa8af351a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120799) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:20:25.679365 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.policy [None req-245cc88b-f776-47b4-93fc-e8f32eef23d0 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4fb28547f4b54c4097d2ffc3c533ca67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42af08ef367945939b1f59ffa8af351a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120799) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:20:25.681424 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.policy [None req-245cc88b-f776-47b4-93fc-e8f32eef23d0 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4fb28547f4b54c4097d2ffc3c533ca67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42af08ef367945939b1f59ffa8af351a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120799) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:20:25.682620 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-245cc88b-f776-47b4-93fc-e8f32eef23d0 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] 10.222.0.17 "GET /compute/v2.1/servers/971419a3-e367-44fc-b6b4-10543aa4ab52" status: 200 len: 1404 microversion: 2.20 time: 0.164493 Aug 23 07:20:25.691569 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 404/783] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Aug 23 07:20:25 2022] GET /compute/v2.1/servers/971419a3-e367-44fc-b6b4-10543aa4ab52 => generated 1404 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 07:20:25.888583 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [req-66dc617d-f5b5-421f-aa9f-20f7482c40c8 req-81cb93d6-53ea-4c8b-b7df-a5ccc76e301b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "971419a3-e367-44fc-b6b4-10543aa4ab52", "tag": "7a341a97-ef9f-44a7-99ba-2be318b77ee7"}]} {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 07:20:25.902026 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [req-66dc617d-f5b5-421f-aa9f-20f7482c40c8 req-81cb93d6-53ea-4c8b-b7df-a5ccc76e301b service nova] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:20:25.902491 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [req-66dc617d-f5b5-421f-aa9f-20f7482c40c8 req-81cb93d6-53ea-4c8b-b7df-a5ccc76e301b service nova] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:20:25.902916 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [req-66dc617d-f5b5-421f-aa9f-20f7482c40c8 req-81cb93d6-53ea-4c8b-b7df-a5ccc76e301b service nova] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:20:25.918348 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.compute.server_external_events [req-66dc617d-f5b5-421f-aa9f-20f7482c40c8 req-81cb93d6-53ea-4c8b-b7df-a5ccc76e301b service nova] Creating event network-changed:7a341a97-ef9f-44a7-99ba-2be318b77ee7 for instance 971419a3-e367-44fc-b6b4-10543aa4ab52 on hv-cinder-85409 Aug 23 07:20:25.923355 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [req-66dc617d-f5b5-421f-aa9f-20f7482c40c8 req-81cb93d6-53ea-4c8b-b7df-a5ccc76e301b service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038398 Aug 23 07:20:25.923972 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 380/784] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Aug 23 07:20:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 07:20:26.708525 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-7543e2b9-1803-4ffb-83aa-e36926c75a46 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Calling method '>' {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:20:26.709379 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.compute.api [None req-7543e2b9-1803-4ffb-83aa-e36926c75a46 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] [instance: 971419a3-e367-44fc-b6b4-10543aa4ab52] Fetching instance by UUID {{(pid=120799) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:20:26.717889 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-7543e2b9-1803-4ffb-83aa-e36926c75a46 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:20:26.718364 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-7543e2b9-1803-4ffb-83aa-e36926c75a46 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:20:26.718784 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-7543e2b9-1803-4ffb-83aa-e36926c75a46 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:20:26.719461 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-7543e2b9-1803-4ffb-83aa-e36926c75a46 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:20:26.719956 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-7543e2b9-1803-4ffb-83aa-e36926c75a46 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:20:26.720369 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-7543e2b9-1803-4ffb-83aa-e36926c75a46 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:20:26.853728 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.policy [None req-7543e2b9-1803-4ffb-83aa-e36926c75a46 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb28547f4b54c4097d2ffc3c533ca67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42af08ef367945939b1f59ffa8af351a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120799) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:20:26.866400 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.policy [None req-7543e2b9-1803-4ffb-83aa-e36926c75a46 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4fb28547f4b54c4097d2ffc3c533ca67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42af08ef367945939b1f59ffa8af351a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120799) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:20:26.868786 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.policy [None req-7543e2b9-1803-4ffb-83aa-e36926c75a46 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4fb28547f4b54c4097d2ffc3c533ca67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42af08ef367945939b1f59ffa8af351a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120799) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:20:26.869888 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-7543e2b9-1803-4ffb-83aa-e36926c75a46 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] 10.222.0.17 "GET /compute/v2.1/servers/971419a3-e367-44fc-b6b4-10543aa4ab52" status: 200 len: 1404 microversion: 2.20 time: 0.166959 Aug 23 07:20:26.870415 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 405/785] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Aug 23 07:20:26 2022] GET /compute/v2.1/servers/971419a3-e367-44fc-b6b4-10543aa4ab52 => generated 1404 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 07:20:27.892884 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-9584a346-e7c0-4f62-a2aa-5495fec3d9d2 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Calling method '>' {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:20:27.893605 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.compute.api [None req-9584a346-e7c0-4f62-a2aa-5495fec3d9d2 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] [instance: 971419a3-e367-44fc-b6b4-10543aa4ab52] Fetching instance by UUID {{(pid=120798) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:20:27.901084 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-9584a346-e7c0-4f62-a2aa-5495fec3d9d2 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:20:27.901717 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-9584a346-e7c0-4f62-a2aa-5495fec3d9d2 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:20:27.902149 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-9584a346-e7c0-4f62-a2aa-5495fec3d9d2 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:20:27.902831 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-9584a346-e7c0-4f62-a2aa-5495fec3d9d2 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:20:27.903281 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-9584a346-e7c0-4f62-a2aa-5495fec3d9d2 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:20:27.903724 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-9584a346-e7c0-4f62-a2aa-5495fec3d9d2 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:20:28.043746 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.policy [None req-9584a346-e7c0-4f62-a2aa-5495fec3d9d2 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb28547f4b54c4097d2ffc3c533ca67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42af08ef367945939b1f59ffa8af351a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120798) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:20:28.052260 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.policy [None req-9584a346-e7c0-4f62-a2aa-5495fec3d9d2 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4fb28547f4b54c4097d2ffc3c533ca67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42af08ef367945939b1f59ffa8af351a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120798) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:20:28.053741 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.policy [None req-9584a346-e7c0-4f62-a2aa-5495fec3d9d2 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4fb28547f4b54c4097d2ffc3c533ca67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42af08ef367945939b1f59ffa8af351a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120798) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:20:28.054843 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [None req-9584a346-e7c0-4f62-a2aa-5495fec3d9d2 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] 10.222.0.17 "GET /compute/v2.1/servers/971419a3-e367-44fc-b6b4-10543aa4ab52" status: 200 len: 1404 microversion: 2.20 time: 0.166300 Aug 23 07:20:28.055401 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 381/786] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Aug 23 07:20:27 2022] GET /compute/v2.1/servers/971419a3-e367-44fc-b6b4-10543aa4ab52 => generated 1404 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 07:20:29.077556 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-3de32b24-66e5-4167-9569-f31181fea632 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Calling method '>' {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:20:29.078146 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.compute.api [None req-3de32b24-66e5-4167-9569-f31181fea632 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] [instance: 971419a3-e367-44fc-b6b4-10543aa4ab52] Fetching instance by UUID {{(pid=120799) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:20:29.085623 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-3de32b24-66e5-4167-9569-f31181fea632 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:20:29.086526 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-3de32b24-66e5-4167-9569-f31181fea632 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:20:29.087674 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-3de32b24-66e5-4167-9569-f31181fea632 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:20:29.087674 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-3de32b24-66e5-4167-9569-f31181fea632 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:20:29.088943 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-3de32b24-66e5-4167-9569-f31181fea632 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:20:29.090644 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-3de32b24-66e5-4167-9569-f31181fea632 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:20:29.239782 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.policy [None req-3de32b24-66e5-4167-9569-f31181fea632 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb28547f4b54c4097d2ffc3c533ca67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42af08ef367945939b1f59ffa8af351a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120799) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:20:29.250419 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.policy [None req-3de32b24-66e5-4167-9569-f31181fea632 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4fb28547f4b54c4097d2ffc3c533ca67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42af08ef367945939b1f59ffa8af351a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120799) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:20:29.252013 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.policy [None req-3de32b24-66e5-4167-9569-f31181fea632 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4fb28547f4b54c4097d2ffc3c533ca67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42af08ef367945939b1f59ffa8af351a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120799) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:20:29.253051 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-3de32b24-66e5-4167-9569-f31181fea632 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] 10.222.0.17 "GET /compute/v2.1/servers/971419a3-e367-44fc-b6b4-10543aa4ab52" status: 200 len: 1404 microversion: 2.20 time: 0.179590 Aug 23 07:20:29.253800 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 406/787] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Aug 23 07:20:29 2022] GET /compute/v2.1/servers/971419a3-e367-44fc-b6b4-10543aa4ab52 => generated 1404 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 07:20:30.281891 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-391be1b0-be14-4dfd-af14-fe0f6e74cd95 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Calling method '>' {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:20:30.282966 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.compute.api [None req-391be1b0-be14-4dfd-af14-fe0f6e74cd95 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] [instance: 971419a3-e367-44fc-b6b4-10543aa4ab52] Fetching instance by UUID {{(pid=120798) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:20:30.293066 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-391be1b0-be14-4dfd-af14-fe0f6e74cd95 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:20:30.293549 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-391be1b0-be14-4dfd-af14-fe0f6e74cd95 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:20:30.293979 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-391be1b0-be14-4dfd-af14-fe0f6e74cd95 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:20:30.294664 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-391be1b0-be14-4dfd-af14-fe0f6e74cd95 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:20:30.295111 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-391be1b0-be14-4dfd-af14-fe0f6e74cd95 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:20:30.295565 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-391be1b0-be14-4dfd-af14-fe0f6e74cd95 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:20:30.437963 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.policy [None req-391be1b0-be14-4dfd-af14-fe0f6e74cd95 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb28547f4b54c4097d2ffc3c533ca67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42af08ef367945939b1f59ffa8af351a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120798) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:20:30.449420 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.policy [None req-391be1b0-be14-4dfd-af14-fe0f6e74cd95 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4fb28547f4b54c4097d2ffc3c533ca67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42af08ef367945939b1f59ffa8af351a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120798) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:20:30.451698 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.policy [None req-391be1b0-be14-4dfd-af14-fe0f6e74cd95 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4fb28547f4b54c4097d2ffc3c533ca67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42af08ef367945939b1f59ffa8af351a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120798) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:20:30.453231 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [None req-391be1b0-be14-4dfd-af14-fe0f6e74cd95 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] 10.222.0.17 "GET /compute/v2.1/servers/971419a3-e367-44fc-b6b4-10543aa4ab52" status: 200 len: 1404 microversion: 2.20 time: 0.178344 Aug 23 07:20:30.453918 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 382/788] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Aug 23 07:20:30 2022] GET /compute/v2.1/servers/971419a3-e367-44fc-b6b4-10543aa4ab52 => generated 1404 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 07:20:31.343331 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [req-2a74b27e-7922-4102-9792-24f375382d75 req-2608254a-abc0-4cdb-ada1-80ec0ae97085 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "971419a3-e367-44fc-b6b4-10543aa4ab52", "name": "network-vif-plugged", "status": "completed", "tag": "7a341a97-ef9f-44a7-99ba-2be318b77ee7"}]} {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 07:20:31.357870 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [req-2a74b27e-7922-4102-9792-24f375382d75 req-2608254a-abc0-4cdb-ada1-80ec0ae97085 service nova] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:20:31.358141 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [req-2a74b27e-7922-4102-9792-24f375382d75 req-2608254a-abc0-4cdb-ada1-80ec0ae97085 service nova] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:20:31.358812 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [req-2a74b27e-7922-4102-9792-24f375382d75 req-2608254a-abc0-4cdb-ada1-80ec0ae97085 service nova] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:20:31.373631 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.compute.server_external_events [req-2a74b27e-7922-4102-9792-24f375382d75 req-2608254a-abc0-4cdb-ada1-80ec0ae97085 service nova] Creating event network-vif-plugged:7a341a97-ef9f-44a7-99ba-2be318b77ee7 for instance 971419a3-e367-44fc-b6b4-10543aa4ab52 on hv-cinder-85409 Aug 23 07:20:31.378675 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [req-2a74b27e-7922-4102-9792-24f375382d75 req-2608254a-abc0-4cdb-ada1-80ec0ae97085 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039358 Aug 23 07:20:31.379264 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 407/789] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Aug 23 07:20:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 07:20:31.480727 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-fe4a5161-690d-49f6-8e04-bee8c9125558 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Calling method '>' {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:20:31.481398 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.compute.api [None req-fe4a5161-690d-49f6-8e04-bee8c9125558 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] [instance: 971419a3-e367-44fc-b6b4-10543aa4ab52] Fetching instance by UUID {{(pid=120798) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:20:31.487948 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-fe4a5161-690d-49f6-8e04-bee8c9125558 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:20:31.488422 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-fe4a5161-690d-49f6-8e04-bee8c9125558 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:20:31.488841 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-fe4a5161-690d-49f6-8e04-bee8c9125558 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:20:31.489513 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-fe4a5161-690d-49f6-8e04-bee8c9125558 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:20:31.490516 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-fe4a5161-690d-49f6-8e04-bee8c9125558 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:20:31.490946 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-fe4a5161-690d-49f6-8e04-bee8c9125558 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:20:31.628723 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.policy [None req-fe4a5161-690d-49f6-8e04-bee8c9125558 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb28547f4b54c4097d2ffc3c533ca67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42af08ef367945939b1f59ffa8af351a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120798) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:20:31.639055 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.policy [None req-fe4a5161-690d-49f6-8e04-bee8c9125558 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4fb28547f4b54c4097d2ffc3c533ca67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42af08ef367945939b1f59ffa8af351a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120798) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:20:31.640598 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.policy [None req-fe4a5161-690d-49f6-8e04-bee8c9125558 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4fb28547f4b54c4097d2ffc3c533ca67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42af08ef367945939b1f59ffa8af351a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120798) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:20:31.641710 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [None req-fe4a5161-690d-49f6-8e04-bee8c9125558 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] 10.222.0.17 "GET /compute/v2.1/servers/971419a3-e367-44fc-b6b4-10543aa4ab52" status: 200 len: 1404 microversion: 2.20 time: 0.165823 Aug 23 07:20:31.642282 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 383/790] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Aug 23 07:20:31 2022] GET /compute/v2.1/servers/971419a3-e367-44fc-b6b4-10543aa4ab52 => generated 1404 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 07:20:32.671785 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-e7eaf4a0-8938-40a3-b5fb-8d6c38026fd7 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Calling method '>' {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:20:32.672464 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.compute.api [None req-e7eaf4a0-8938-40a3-b5fb-8d6c38026fd7 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] [instance: 971419a3-e367-44fc-b6b4-10543aa4ab52] Fetching instance by UUID {{(pid=120799) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:20:32.679359 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-e7eaf4a0-8938-40a3-b5fb-8d6c38026fd7 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:20:32.679854 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-e7eaf4a0-8938-40a3-b5fb-8d6c38026fd7 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:20:32.680278 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-e7eaf4a0-8938-40a3-b5fb-8d6c38026fd7 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:20:32.680955 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-e7eaf4a0-8938-40a3-b5fb-8d6c38026fd7 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:20:32.681410 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-e7eaf4a0-8938-40a3-b5fb-8d6c38026fd7 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:20:32.681805 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-e7eaf4a0-8938-40a3-b5fb-8d6c38026fd7 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:20:32.831303 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.policy [None req-e7eaf4a0-8938-40a3-b5fb-8d6c38026fd7 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb28547f4b54c4097d2ffc3c533ca67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42af08ef367945939b1f59ffa8af351a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120799) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:20:32.843613 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.policy [None req-e7eaf4a0-8938-40a3-b5fb-8d6c38026fd7 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4fb28547f4b54c4097d2ffc3c533ca67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42af08ef367945939b1f59ffa8af351a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120799) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:20:32.845161 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.policy [None req-e7eaf4a0-8938-40a3-b5fb-8d6c38026fd7 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4fb28547f4b54c4097d2ffc3c533ca67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42af08ef367945939b1f59ffa8af351a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120799) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:20:32.846395 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-e7eaf4a0-8938-40a3-b5fb-8d6c38026fd7 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] 10.222.0.17 "GET /compute/v2.1/servers/971419a3-e367-44fc-b6b4-10543aa4ab52" status: 200 len: 1596 microversion: 2.20 time: 0.179681 Aug 23 07:20:32.846986 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 408/791] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Aug 23 07:20:32 2022] GET /compute/v2.1/servers/971419a3-e367-44fc-b6b4-10543aa4ab52 => generated 1596 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 07:20:32.869179 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-ea91beef-e095-4458-bfca-8e1e554867b3 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Calling method '>' {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:20:32.869717 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.compute.api [None req-ea91beef-e095-4458-bfca-8e1e554867b3 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] [instance: 971419a3-e367-44fc-b6b4-10543aa4ab52] Fetching instance by UUID {{(pid=120798) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:20:32.876781 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-ea91beef-e095-4458-bfca-8e1e554867b3 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:20:32.877267 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-ea91beef-e095-4458-bfca-8e1e554867b3 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:20:32.877683 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-ea91beef-e095-4458-bfca-8e1e554867b3 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:20:32.878386 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-ea91beef-e095-4458-bfca-8e1e554867b3 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:20:32.878828 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-ea91beef-e095-4458-bfca-8e1e554867b3 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:20:32.879238 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-ea91beef-e095-4458-bfca-8e1e554867b3 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:20:32.965746 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [None req-ea91beef-e095-4458-bfca-8e1e554867b3 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] 10.222.0.17 "GET /compute/v2.1/servers/971419a3-e367-44fc-b6b4-10543aa4ab52/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.100438 Aug 23 07:20:32.966368 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 384/792] 10.222.0.17 () {60 vars in 1316 bytes} [Tue Aug 23 07:20:32 2022] GET /compute/v2.1/servers/971419a3-e367-44fc-b6b4-10543aa4ab52/os-interface => generated 285 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 23 07:20:33.980027 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [req-20bd73ac-a22f-4daa-aa07-913c9df3f49a req-552d9223-587d-4f49-a3b6-ad4932c5f343 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "971419a3-e367-44fc-b6b4-10543aa4ab52", "tag": "7a341a97-ef9f-44a7-99ba-2be318b77ee7"}]} {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 07:20:33.986076 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG dbcounter [-] [120799] Writing DB stats nova_cell0:SELECT=6 {{(pid=120799) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:20:33.991245 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [req-20bd73ac-a22f-4daa-aa07-913c9df3f49a req-552d9223-587d-4f49-a3b6-ad4932c5f343 service nova] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:20:33.991739 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [req-20bd73ac-a22f-4daa-aa07-913c9df3f49a req-552d9223-587d-4f49-a3b6-ad4932c5f343 service nova] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:20:33.992153 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [req-20bd73ac-a22f-4daa-aa07-913c9df3f49a req-552d9223-587d-4f49-a3b6-ad4932c5f343 service nova] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:20:34.003961 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.compute.server_external_events [req-20bd73ac-a22f-4daa-aa07-913c9df3f49a req-552d9223-587d-4f49-a3b6-ad4932c5f343 service nova] Creating event network-changed:7a341a97-ef9f-44a7-99ba-2be318b77ee7 for instance 971419a3-e367-44fc-b6b4-10543aa4ab52 on hv-cinder-85409 Aug 23 07:20:34.008918 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [req-20bd73ac-a22f-4daa-aa07-913c9df3f49a req-552d9223-587d-4f49-a3b6-ad4932c5f343 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032689 Aug 23 07:20:34.009487 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 409/793] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Aug 23 07:20:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 07:20:51.230486 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG dbcounter [-] [120798] Writing DB stats nova_cell0:SELECT=2 {{(pid=120798) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:20:51.231301 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG dbcounter [-] [120798] Writing DB stats nova_cell0:SELECT=6 {{(pid=120798) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:20:51.233266 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG dbcounter [-] [120798] Writing DB stats nova_api:SELECT=56,nova_api:DELETE=2,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=120798) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:20:51.233971 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG dbcounter [-] [120798] Writing DB stats nova_cell1:SELECT=82,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120798) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:20:51.238590 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-4357f25e-95d9-436f-aabf-d1633e66803b tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1806866341", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1565151740", "security_groups": [{"name": "tempest-secgroup-smoke-1052235560"}], "block_device_mapping_v2": [{"uuid": "a8074e7c-c785-4e0a-9434-93543adb2bca", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "6a0a58c3-07f3-4091-814d-8e4792f5ba82"}]}} {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 07:20:51.356127 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.network.neutron [None req-4357f25e-95d9-436f-aabf-d1633e66803b tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] validate_networks() for [('6a0a58c3-07f3-4091-814d-8e4792f5ba82', None, None, None, None, None)] {{(pid=120798) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 23 07:20:51.749073 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.virt.hardware [None req-4357f25e-95d9-436f-aabf-d1633e66803b tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Flavor limits 0:0:0 {{(pid=120798) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 07:20:51.749737 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.virt.hardware [None req-4357f25e-95d9-436f-aabf-d1633e66803b tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Image limits 0:0:0 {{(pid=120798) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 07:20:51.750488 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.virt.hardware [None req-4357f25e-95d9-436f-aabf-d1633e66803b tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Flavor pref 0:0:0 {{(pid=120798) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 07:20:51.751166 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.virt.hardware [None req-4357f25e-95d9-436f-aabf-d1633e66803b tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Image pref 0:0:0 {{(pid=120798) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 07:20:51.751920 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.virt.hardware [None req-4357f25e-95d9-436f-aabf-d1633e66803b tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120798) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 07:20:51.765528 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-4357f25e-95d9-436f-aabf-d1633e66803b tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:20:51.766008 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-4357f25e-95d9-436f-aabf-d1633e66803b tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:20:51.766440 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-4357f25e-95d9-436f-aabf-d1633e66803b tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:20:51.767160 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-4357f25e-95d9-436f-aabf-d1633e66803b tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:20:51.767644 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-4357f25e-95d9-436f-aabf-d1633e66803b tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:20:51.768043 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-4357f25e-95d9-436f-aabf-d1633e66803b tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:20:51.786101 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.quota [None req-4357f25e-95d9-436f-aabf-d1633e66803b tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Getting quotas for project f43b271d00f74eb7aa3d0719315c5a99. Resources: {'ram', 'instances', 'cores'} {{(pid=120798) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 07:20:51.790585 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.quota [None req-4357f25e-95d9-436f-aabf-d1633e66803b tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Getting quotas for user ffd12f09606b4e6ba12f63b976df1884 and project f43b271d00f74eb7aa3d0719315c5a99. Resources: {'ram', 'instances', 'cores'} {{(pid=120798) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 07:20:51.850150 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.compute.api [None req-4357f25e-95d9-436f-aabf-d1633e66803b tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Going to run 1 instances... {{(pid=120798) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 23 07:20:51.852343 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.compute.api [None req-4357f25e-95d9-436f-aabf-d1633e66803b tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] [instance: d364cacb-afc7-4499-ab81-7e15d47f0b40] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='a8074e7c-c785-4e0a-9434-93543adb2bca',volume_size=None,volume_type=None)] {{(pid=120798) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 07:20:51.991678 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [None req-4357f25e-95d9-436f-aabf-d1633e66803b tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.761919 Aug 23 07:20:51.992317 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 385/794] 10.222.0.17 () {60 vars in 1147 bytes} [Tue Aug 23 07:20:51 2022] POST /compute/v2.1/servers => generated 406 bytes in 763 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 23 07:20:52.001426 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG dbcounter [-] [120799] Writing DB stats nova_api:SELECT=50,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=120799) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:20:52.002222 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG dbcounter [-] [120799] Writing DB stats nova_cell1:SELECT=81,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=120799) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:20:52.006456 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-28ff90c6-6f81-415a-92c6-155890eecf92 tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Calling method '>' {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:20:52.007147 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.compute.api [None req-28ff90c6-6f81-415a-92c6-155890eecf92 tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] [instance: d364cacb-afc7-4499-ab81-7e15d47f0b40] Fetching instance by UUID {{(pid=120799) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:20:52.072673 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.policy [None req-28ff90c6-6f81-415a-92c6-155890eecf92 tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffd12f09606b4e6ba12f63b976df1884', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43b271d00f74eb7aa3d0719315c5a99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120799) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:20:52.079862 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-28ff90c6-6f81-415a-92c6-155890eecf92 tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] 10.222.0.17 "GET /compute/v2.1/servers/d364cacb-afc7-4499-ab81-7e15d47f0b40" status: 200 len: 1095 microversion: 2.1 time: 0.080035 Aug 23 07:20:52.080409 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 410/795] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:20:51 2022] GET /compute/v2.1/servers/d364cacb-afc7-4499-ab81-7e15d47f0b40 => generated 1095 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:20:53.106729 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-e5a7bb09-9d68-4054-b8bf-e83a0d74ecf3 tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Calling method '>' {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:20:53.107853 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.compute.api [None req-e5a7bb09-9d68-4054-b8bf-e83a0d74ecf3 tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] [instance: d364cacb-afc7-4499-ab81-7e15d47f0b40] Fetching instance by UUID {{(pid=120798) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:20:53.118112 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-e5a7bb09-9d68-4054-b8bf-e83a0d74ecf3 tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:20:53.118892 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-e5a7bb09-9d68-4054-b8bf-e83a0d74ecf3 tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:20:53.119662 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-e5a7bb09-9d68-4054-b8bf-e83a0d74ecf3 tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:20:53.120829 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-e5a7bb09-9d68-4054-b8bf-e83a0d74ecf3 tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:20:53.121566 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-e5a7bb09-9d68-4054-b8bf-e83a0d74ecf3 tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:20:53.122261 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-e5a7bb09-9d68-4054-b8bf-e83a0d74ecf3 tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:20:53.186902 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.policy [None req-e5a7bb09-9d68-4054-b8bf-e83a0d74ecf3 tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffd12f09606b4e6ba12f63b976df1884', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43b271d00f74eb7aa3d0719315c5a99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120798) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:20:53.195064 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [None req-e5a7bb09-9d68-4054-b8bf-e83a0d74ecf3 tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] 10.222.0.17 "GET /compute/v2.1/servers/d364cacb-afc7-4499-ab81-7e15d47f0b40" status: 200 len: 1193 microversion: 2.1 time: 0.095911 Aug 23 07:20:53.195675 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 386/796] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:20:53 2022] GET /compute/v2.1/servers/d364cacb-afc7-4499-ab81-7e15d47f0b40 => generated 1193 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:20:54.217570 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-edd4235a-020c-4d96-8793-96f0faf6e6ec tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Calling method '>' {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:20:54.218169 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.compute.api [None req-edd4235a-020c-4d96-8793-96f0faf6e6ec tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] [instance: d364cacb-afc7-4499-ab81-7e15d47f0b40] Fetching instance by UUID {{(pid=120799) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:20:54.226015 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-edd4235a-020c-4d96-8793-96f0faf6e6ec tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:20:54.226729 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-edd4235a-020c-4d96-8793-96f0faf6e6ec tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:20:54.227339 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-edd4235a-020c-4d96-8793-96f0faf6e6ec tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:20:54.228222 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-edd4235a-020c-4d96-8793-96f0faf6e6ec tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:20:54.228674 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-edd4235a-020c-4d96-8793-96f0faf6e6ec tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:20:54.229095 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-edd4235a-020c-4d96-8793-96f0faf6e6ec tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:20:54.369332 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.policy [None req-edd4235a-020c-4d96-8793-96f0faf6e6ec tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffd12f09606b4e6ba12f63b976df1884', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43b271d00f74eb7aa3d0719315c5a99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120799) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:20:54.378282 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-edd4235a-020c-4d96-8793-96f0faf6e6ec tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] 10.222.0.17 "GET /compute/v2.1/servers/d364cacb-afc7-4499-ab81-7e15d47f0b40" status: 200 len: 1267 microversion: 2.1 time: 0.164860 Aug 23 07:20:54.379013 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 411/797] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:20:54 2022] GET /compute/v2.1/servers/d364cacb-afc7-4499-ab81-7e15d47f0b40 => generated 1267 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:20:54.588039 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [req-57cf0ca7-99ee-49cf-8cd6-7aa837a03b9b req-038647f6-8f65-4b28-92f7-e56241a03bd9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d364cacb-afc7-4499-ab81-7e15d47f0b40", "tag": "58b621ad-94f4-4882-b5ed-7393dd3d6b95"}]} {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 07:20:54.600356 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [req-57cf0ca7-99ee-49cf-8cd6-7aa837a03b9b req-038647f6-8f65-4b28-92f7-e56241a03bd9 service nova] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:20:54.600845 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [req-57cf0ca7-99ee-49cf-8cd6-7aa837a03b9b req-038647f6-8f65-4b28-92f7-e56241a03bd9 service nova] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:20:54.601279 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [req-57cf0ca7-99ee-49cf-8cd6-7aa837a03b9b req-038647f6-8f65-4b28-92f7-e56241a03bd9 service nova] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:20:54.615623 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.compute.server_external_events [req-57cf0ca7-99ee-49cf-8cd6-7aa837a03b9b req-038647f6-8f65-4b28-92f7-e56241a03bd9 service nova] Creating event network-changed:58b621ad-94f4-4882-b5ed-7393dd3d6b95 for instance d364cacb-afc7-4499-ab81-7e15d47f0b40 on hv-cinder-85409 Aug 23 07:20:54.621740 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [req-57cf0ca7-99ee-49cf-8cd6-7aa837a03b9b req-038647f6-8f65-4b28-92f7-e56241a03bd9 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036726 Aug 23 07:20:54.622370 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 387/798] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Aug 23 07:20:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 07:20:55.403104 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-06222426-1e83-49b1-90de-8b8487b73fa9 tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Calling method '>' {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:20:55.404266 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.compute.api [None req-06222426-1e83-49b1-90de-8b8487b73fa9 tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] [instance: d364cacb-afc7-4499-ab81-7e15d47f0b40] Fetching instance by UUID {{(pid=120799) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:20:55.411233 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-06222426-1e83-49b1-90de-8b8487b73fa9 tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:20:55.411700 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-06222426-1e83-49b1-90de-8b8487b73fa9 tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:20:55.412135 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-06222426-1e83-49b1-90de-8b8487b73fa9 tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:20:55.412815 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-06222426-1e83-49b1-90de-8b8487b73fa9 tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:20:55.413264 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-06222426-1e83-49b1-90de-8b8487b73fa9 tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:20:55.413684 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-06222426-1e83-49b1-90de-8b8487b73fa9 tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:20:55.557871 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.policy [None req-06222426-1e83-49b1-90de-8b8487b73fa9 tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffd12f09606b4e6ba12f63b976df1884', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43b271d00f74eb7aa3d0719315c5a99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120799) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:20:55.566290 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-06222426-1e83-49b1-90de-8b8487b73fa9 tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] 10.222.0.17 "GET /compute/v2.1/servers/d364cacb-afc7-4499-ab81-7e15d47f0b40" status: 200 len: 1267 microversion: 2.1 time: 0.169513 Aug 23 07:20:55.566960 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 412/799] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:20:55 2022] GET /compute/v2.1/servers/d364cacb-afc7-4499-ab81-7e15d47f0b40 => generated 1267 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:20:56.593044 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-5c4fc877-36bc-4f3e-b5b8-a511628b5da3 tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Calling method '>' {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:20:56.593776 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.compute.api [None req-5c4fc877-36bc-4f3e-b5b8-a511628b5da3 tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] [instance: d364cacb-afc7-4499-ab81-7e15d47f0b40] Fetching instance by UUID {{(pid=120798) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:20:56.600566 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-5c4fc877-36bc-4f3e-b5b8-a511628b5da3 tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:20:56.601039 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-5c4fc877-36bc-4f3e-b5b8-a511628b5da3 tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:20:56.601474 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-5c4fc877-36bc-4f3e-b5b8-a511628b5da3 tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:20:56.602162 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-5c4fc877-36bc-4f3e-b5b8-a511628b5da3 tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:20:56.602609 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-5c4fc877-36bc-4f3e-b5b8-a511628b5da3 tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:20:56.603022 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-5c4fc877-36bc-4f3e-b5b8-a511628b5da3 tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:20:56.747389 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.policy [None req-5c4fc877-36bc-4f3e-b5b8-a511628b5da3 tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffd12f09606b4e6ba12f63b976df1884', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43b271d00f74eb7aa3d0719315c5a99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120798) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:20:56.755693 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [None req-5c4fc877-36bc-4f3e-b5b8-a511628b5da3 tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] 10.222.0.17 "GET /compute/v2.1/servers/d364cacb-afc7-4499-ab81-7e15d47f0b40" status: 200 len: 1267 microversion: 2.1 time: 0.171201 Aug 23 07:20:56.756225 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 388/800] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:20:56 2022] GET /compute/v2.1/servers/d364cacb-afc7-4499-ab81-7e15d47f0b40 => generated 1267 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:20:57.779374 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-b6d41354-f9e1-4b5c-af7c-9aa485109849 tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Calling method '>' {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:20:57.780266 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.compute.api [None req-b6d41354-f9e1-4b5c-af7c-9aa485109849 tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] [instance: d364cacb-afc7-4499-ab81-7e15d47f0b40] Fetching instance by UUID {{(pid=120799) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:20:57.788912 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-b6d41354-f9e1-4b5c-af7c-9aa485109849 tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:20:57.789537 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-b6d41354-f9e1-4b5c-af7c-9aa485109849 tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:20:57.790103 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-b6d41354-f9e1-4b5c-af7c-9aa485109849 tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:20:57.790993 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-b6d41354-f9e1-4b5c-af7c-9aa485109849 tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:20:57.791708 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-b6d41354-f9e1-4b5c-af7c-9aa485109849 tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:20:57.792262 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-b6d41354-f9e1-4b5c-af7c-9aa485109849 tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:20:57.932536 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.policy [None req-b6d41354-f9e1-4b5c-af7c-9aa485109849 tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffd12f09606b4e6ba12f63b976df1884', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43b271d00f74eb7aa3d0719315c5a99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120799) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:20:57.941091 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-b6d41354-f9e1-4b5c-af7c-9aa485109849 tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] 10.222.0.17 "GET /compute/v2.1/servers/d364cacb-afc7-4499-ab81-7e15d47f0b40" status: 200 len: 1267 microversion: 2.1 time: 0.166794 Aug 23 07:20:57.942119 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 413/801] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:20:57 2022] GET /compute/v2.1/servers/d364cacb-afc7-4499-ab81-7e15d47f0b40 => generated 1267 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:20:58.966381 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-9a860b32-e912-4beb-b18d-bfd68a359910 tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Calling method '>' {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:20:58.967697 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.compute.api [None req-9a860b32-e912-4beb-b18d-bfd68a359910 tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] [instance: d364cacb-afc7-4499-ab81-7e15d47f0b40] Fetching instance by UUID {{(pid=120798) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:20:58.974554 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-9a860b32-e912-4beb-b18d-bfd68a359910 tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:20:58.975085 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-9a860b32-e912-4beb-b18d-bfd68a359910 tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:20:58.975549 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-9a860b32-e912-4beb-b18d-bfd68a359910 tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:20:58.976246 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-9a860b32-e912-4beb-b18d-bfd68a359910 tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:20:58.976698 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-9a860b32-e912-4beb-b18d-bfd68a359910 tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:20:58.977120 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-9a860b32-e912-4beb-b18d-bfd68a359910 tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:20:59.124949 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.policy [None req-9a860b32-e912-4beb-b18d-bfd68a359910 tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffd12f09606b4e6ba12f63b976df1884', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43b271d00f74eb7aa3d0719315c5a99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120798) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:20:59.132989 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [None req-9a860b32-e912-4beb-b18d-bfd68a359910 tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] 10.222.0.17 "GET /compute/v2.1/servers/d364cacb-afc7-4499-ab81-7e15d47f0b40" status: 200 len: 1267 microversion: 2.1 time: 0.173612 Aug 23 07:20:59.133553 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 389/802] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:20:58 2022] GET /compute/v2.1/servers/d364cacb-afc7-4499-ab81-7e15d47f0b40 => generated 1267 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:21:00.155905 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-6955bf83-dcd9-4f40-9957-6b8c2bf7c84f tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Calling method '>' {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:21:00.157439 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.compute.api [None req-6955bf83-dcd9-4f40-9957-6b8c2bf7c84f tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] [instance: d364cacb-afc7-4499-ab81-7e15d47f0b40] Fetching instance by UUID {{(pid=120799) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:21:00.164749 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-6955bf83-dcd9-4f40-9957-6b8c2bf7c84f tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:21:00.165220 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-6955bf83-dcd9-4f40-9957-6b8c2bf7c84f tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:21:00.165653 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-6955bf83-dcd9-4f40-9957-6b8c2bf7c84f tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:21:00.166345 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-6955bf83-dcd9-4f40-9957-6b8c2bf7c84f tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:21:00.166800 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-6955bf83-dcd9-4f40-9957-6b8c2bf7c84f tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:21:00.167212 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-6955bf83-dcd9-4f40-9957-6b8c2bf7c84f tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:21:00.307696 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.policy [None req-6955bf83-dcd9-4f40-9957-6b8c2bf7c84f tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffd12f09606b4e6ba12f63b976df1884', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43b271d00f74eb7aa3d0719315c5a99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120799) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:21:00.318849 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-6955bf83-dcd9-4f40-9957-6b8c2bf7c84f tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] 10.222.0.17 "GET /compute/v2.1/servers/d364cacb-afc7-4499-ab81-7e15d47f0b40" status: 200 len: 1267 microversion: 2.1 time: 0.168690 Aug 23 07:21:00.319457 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 414/803] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:21:00 2022] GET /compute/v2.1/servers/d364cacb-afc7-4499-ab81-7e15d47f0b40 => generated 1267 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:21:01.347139 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-c622bf68-9a5e-4521-9a5c-7f665923c09b tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Calling method '>' {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:21:01.348182 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.compute.api [None req-c622bf68-9a5e-4521-9a5c-7f665923c09b tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] [instance: d364cacb-afc7-4499-ab81-7e15d47f0b40] Fetching instance by UUID {{(pid=120798) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:21:01.359277 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-c622bf68-9a5e-4521-9a5c-7f665923c09b tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:21:01.360127 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-c622bf68-9a5e-4521-9a5c-7f665923c09b tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:21:01.360842 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-c622bf68-9a5e-4521-9a5c-7f665923c09b tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:21:01.361968 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-c622bf68-9a5e-4521-9a5c-7f665923c09b tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:21:01.362720 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-c622bf68-9a5e-4521-9a5c-7f665923c09b tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:21:01.363459 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-c622bf68-9a5e-4521-9a5c-7f665923c09b tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:21:01.506457 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.policy [None req-c622bf68-9a5e-4521-9a5c-7f665923c09b tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffd12f09606b4e6ba12f63b976df1884', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43b271d00f74eb7aa3d0719315c5a99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120798) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:21:01.514622 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [None req-c622bf68-9a5e-4521-9a5c-7f665923c09b tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] 10.222.0.17 "GET /compute/v2.1/servers/d364cacb-afc7-4499-ab81-7e15d47f0b40" status: 200 len: 1267 microversion: 2.1 time: 0.174588 Aug 23 07:21:01.515220 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 390/804] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:21:01 2022] GET /compute/v2.1/servers/d364cacb-afc7-4499-ab81-7e15d47f0b40 => generated 1267 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:21:02.540106 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-e2d8a5e2-d729-43ce-af5b-04361eb35819 tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Calling method '>' {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:21:02.541059 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.compute.api [None req-e2d8a5e2-d729-43ce-af5b-04361eb35819 tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] [instance: d364cacb-afc7-4499-ab81-7e15d47f0b40] Fetching instance by UUID {{(pid=120799) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:21:02.544929 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG dbcounter [-] [120799] Writing DB stats nova_cell0:SELECT=2 {{(pid=120799) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:21:02.550505 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-e2d8a5e2-d729-43ce-af5b-04361eb35819 tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:21:02.550991 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-e2d8a5e2-d729-43ce-af5b-04361eb35819 tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:21:02.551451 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-e2d8a5e2-d729-43ce-af5b-04361eb35819 tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:21:02.552136 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-e2d8a5e2-d729-43ce-af5b-04361eb35819 tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:21:02.552578 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-e2d8a5e2-d729-43ce-af5b-04361eb35819 tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:21:02.552994 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-e2d8a5e2-d729-43ce-af5b-04361eb35819 tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:21:02.690786 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.policy [None req-e2d8a5e2-d729-43ce-af5b-04361eb35819 tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffd12f09606b4e6ba12f63b976df1884', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43b271d00f74eb7aa3d0719315c5a99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120799) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:21:02.698932 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-e2d8a5e2-d729-43ce-af5b-04361eb35819 tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] 10.222.0.17 "GET /compute/v2.1/servers/d364cacb-afc7-4499-ab81-7e15d47f0b40" status: 200 len: 1267 microversion: 2.1 time: 0.165312 Aug 23 07:21:02.699522 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 415/805] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:21:02 2022] GET /compute/v2.1/servers/d364cacb-afc7-4499-ab81-7e15d47f0b40 => generated 1267 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:21:03.720893 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-6dc4c48e-f05b-4246-9d38-a6c4bea26468 tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Calling method '>' {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:21:03.721659 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.compute.api [None req-6dc4c48e-f05b-4246-9d38-a6c4bea26468 tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] [instance: d364cacb-afc7-4499-ab81-7e15d47f0b40] Fetching instance by UUID {{(pid=120798) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:21:03.724190 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG dbcounter [-] [120798] Writing DB stats nova_cell0:SELECT=2 {{(pid=120798) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:21:03.724994 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG dbcounter [-] [120798] Writing DB stats nova_cell0:SELECT=6 {{(pid=120798) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:21:03.734918 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-6dc4c48e-f05b-4246-9d38-a6c4bea26468 tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:21:03.735401 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-6dc4c48e-f05b-4246-9d38-a6c4bea26468 tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:21:03.735888 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-6dc4c48e-f05b-4246-9d38-a6c4bea26468 tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:21:03.736690 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-6dc4c48e-f05b-4246-9d38-a6c4bea26468 tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:21:03.737288 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-6dc4c48e-f05b-4246-9d38-a6c4bea26468 tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:21:03.737712 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-6dc4c48e-f05b-4246-9d38-a6c4bea26468 tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:21:03.883176 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.policy [None req-6dc4c48e-f05b-4246-9d38-a6c4bea26468 tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffd12f09606b4e6ba12f63b976df1884', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43b271d00f74eb7aa3d0719315c5a99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120798) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:21:03.891709 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [None req-6dc4c48e-f05b-4246-9d38-a6c4bea26468 tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] 10.222.0.17 "GET /compute/v2.1/servers/d364cacb-afc7-4499-ab81-7e15d47f0b40" status: 200 len: 1267 microversion: 2.1 time: 0.175375 Aug 23 07:21:03.892319 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 391/806] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:21:03 2022] GET /compute/v2.1/servers/d364cacb-afc7-4499-ab81-7e15d47f0b40 => generated 1267 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:21:04.916625 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-2b97b9b2-3994-47df-a3d6-846c1fd6a84e tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Calling method '>' {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:21:04.917578 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.compute.api [None req-2b97b9b2-3994-47df-a3d6-846c1fd6a84e tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] [instance: d364cacb-afc7-4499-ab81-7e15d47f0b40] Fetching instance by UUID {{(pid=120799) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:21:04.928435 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-2b97b9b2-3994-47df-a3d6-846c1fd6a84e tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:21:04.929224 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-2b97b9b2-3994-47df-a3d6-846c1fd6a84e tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:21:04.929938 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-2b97b9b2-3994-47df-a3d6-846c1fd6a84e tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:21:04.931059 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-2b97b9b2-3994-47df-a3d6-846c1fd6a84e tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:21:04.931844 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-2b97b9b2-3994-47df-a3d6-846c1fd6a84e tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:21:04.932493 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-2b97b9b2-3994-47df-a3d6-846c1fd6a84e tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:21:05.080508 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.policy [None req-2b97b9b2-3994-47df-a3d6-846c1fd6a84e tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffd12f09606b4e6ba12f63b976df1884', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43b271d00f74eb7aa3d0719315c5a99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120799) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:21:05.088881 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-2b97b9b2-3994-47df-a3d6-846c1fd6a84e tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] 10.222.0.17 "GET /compute/v2.1/servers/d364cacb-afc7-4499-ab81-7e15d47f0b40" status: 200 len: 1267 microversion: 2.1 time: 0.178909 Aug 23 07:21:05.089445 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 416/807] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:21:04 2022] GET /compute/v2.1/servers/d364cacb-afc7-4499-ab81-7e15d47f0b40 => generated 1267 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:21:05.542067 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [req-6975599d-cd36-4660-8edf-9bb12d73dcb9 req-a8cfcfc6-9a10-4ae5-a6d0-fb0af1a5073a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d364cacb-afc7-4499-ab81-7e15d47f0b40", "name": "network-vif-plugged", "status": "completed", "tag": "58b621ad-94f4-4882-b5ed-7393dd3d6b95"}]} {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 07:21:05.552619 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [req-6975599d-cd36-4660-8edf-9bb12d73dcb9 req-a8cfcfc6-9a10-4ae5-a6d0-fb0af1a5073a service nova] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:21:05.553087 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [req-6975599d-cd36-4660-8edf-9bb12d73dcb9 req-a8cfcfc6-9a10-4ae5-a6d0-fb0af1a5073a service nova] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:21:05.553544 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [req-6975599d-cd36-4660-8edf-9bb12d73dcb9 req-a8cfcfc6-9a10-4ae5-a6d0-fb0af1a5073a service nova] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:21:05.565872 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.compute.server_external_events [req-6975599d-cd36-4660-8edf-9bb12d73dcb9 req-a8cfcfc6-9a10-4ae5-a6d0-fb0af1a5073a service nova] Creating event network-vif-plugged:58b621ad-94f4-4882-b5ed-7393dd3d6b95 for instance d364cacb-afc7-4499-ab81-7e15d47f0b40 on hv-cinder-85409 Aug 23 07:21:05.571117 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [req-6975599d-cd36-4660-8edf-9bb12d73dcb9 req-a8cfcfc6-9a10-4ae5-a6d0-fb0af1a5073a service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032799 Aug 23 07:21:05.572369 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 392/808] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Aug 23 07:21:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 07:21:06.114216 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-fca1b3a4-eca0-442c-b18d-f85239532860 tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Calling method '>' {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:21:06.115101 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.compute.api [None req-fca1b3a4-eca0-442c-b18d-f85239532860 tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] [instance: d364cacb-afc7-4499-ab81-7e15d47f0b40] Fetching instance by UUID {{(pid=120799) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:21:06.126208 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-fca1b3a4-eca0-442c-b18d-f85239532860 tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:21:06.127019 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-fca1b3a4-eca0-442c-b18d-f85239532860 tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:21:06.127788 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-fca1b3a4-eca0-442c-b18d-f85239532860 tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:21:06.128899 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-fca1b3a4-eca0-442c-b18d-f85239532860 tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:21:06.129630 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-fca1b3a4-eca0-442c-b18d-f85239532860 tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:21:06.130457 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-fca1b3a4-eca0-442c-b18d-f85239532860 tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:21:06.272204 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.policy [None req-fca1b3a4-eca0-442c-b18d-f85239532860 tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffd12f09606b4e6ba12f63b976df1884', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43b271d00f74eb7aa3d0719315c5a99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120799) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:21:06.282493 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-fca1b3a4-eca0-442c-b18d-f85239532860 tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] 10.222.0.17 "GET /compute/v2.1/servers/d364cacb-afc7-4499-ab81-7e15d47f0b40" status: 200 len: 1267 microversion: 2.1 time: 0.175011 Aug 23 07:21:06.283060 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 417/809] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:21:06 2022] GET /compute/v2.1/servers/d364cacb-afc7-4499-ab81-7e15d47f0b40 => generated 1267 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:21:07.304073 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-ba594292-5416-4d3d-bb78-19ac3947a766 tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Calling method '>' {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:21:07.304805 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.compute.api [None req-ba594292-5416-4d3d-bb78-19ac3947a766 tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] [instance: d364cacb-afc7-4499-ab81-7e15d47f0b40] Fetching instance by UUID {{(pid=120798) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:21:07.311866 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-ba594292-5416-4d3d-bb78-19ac3947a766 tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:21:07.312408 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-ba594292-5416-4d3d-bb78-19ac3947a766 tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:21:07.312874 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-ba594292-5416-4d3d-bb78-19ac3947a766 tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:21:07.313664 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-ba594292-5416-4d3d-bb78-19ac3947a766 tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:21:07.314366 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-ba594292-5416-4d3d-bb78-19ac3947a766 tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:21:07.314985 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-ba594292-5416-4d3d-bb78-19ac3947a766 tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:21:07.461748 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.policy [None req-ba594292-5416-4d3d-bb78-19ac3947a766 tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffd12f09606b4e6ba12f63b976df1884', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43b271d00f74eb7aa3d0719315c5a99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120798) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:21:07.470172 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [None req-ba594292-5416-4d3d-bb78-19ac3947a766 tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] 10.222.0.17 "GET /compute/v2.1/servers/d364cacb-afc7-4499-ab81-7e15d47f0b40" status: 200 len: 1454 microversion: 2.1 time: 0.170986 Aug 23 07:21:07.470834 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 393/810] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:21:07 2022] GET /compute/v2.1/servers/d364cacb-afc7-4499-ab81-7e15d47f0b40 => generated 1454 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:21:07.492185 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-a27fa77d-c8f1-4b3a-a062-706e151e8276 tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Calling method '>' {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:21:07.492868 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.compute.api [None req-a27fa77d-c8f1-4b3a-a062-706e151e8276 tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] [instance: d364cacb-afc7-4499-ab81-7e15d47f0b40] Fetching instance by UUID {{(pid=120799) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:21:07.503144 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-a27fa77d-c8f1-4b3a-a062-706e151e8276 tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:21:07.503889 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-a27fa77d-c8f1-4b3a-a062-706e151e8276 tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:21:07.504413 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-a27fa77d-c8f1-4b3a-a062-706e151e8276 tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:21:07.505323 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-a27fa77d-c8f1-4b3a-a062-706e151e8276 tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:21:07.505973 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-a27fa77d-c8f1-4b3a-a062-706e151e8276 tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:21:07.506607 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-a27fa77d-c8f1-4b3a-a062-706e151e8276 tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:21:07.648107 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.policy [None req-a27fa77d-c8f1-4b3a-a062-706e151e8276 tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffd12f09606b4e6ba12f63b976df1884', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43b271d00f74eb7aa3d0719315c5a99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120799) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:21:07.656084 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-a27fa77d-c8f1-4b3a-a062-706e151e8276 tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] 10.222.0.17 "GET /compute/v2.1/servers/d364cacb-afc7-4499-ab81-7e15d47f0b40" status: 200 len: 1454 microversion: 2.1 time: 0.169794 Aug 23 07:21:07.656662 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 418/811] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:21:07 2022] GET /compute/v2.1/servers/d364cacb-afc7-4499-ab81-7e15d47f0b40 => generated 1454 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:21:09.524365 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [req-90d4c337-26c8-4ba7-8d8d-0bcf11bcf29f req-d69f0587-b5d3-42bc-a1dd-d109fbfe5a88 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d364cacb-afc7-4499-ab81-7e15d47f0b40", "tag": "58b621ad-94f4-4882-b5ed-7393dd3d6b95"}]} {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 07:21:09.534668 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [req-90d4c337-26c8-4ba7-8d8d-0bcf11bcf29f req-d69f0587-b5d3-42bc-a1dd-d109fbfe5a88 service nova] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:21:09.535106 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [req-90d4c337-26c8-4ba7-8d8d-0bcf11bcf29f req-d69f0587-b5d3-42bc-a1dd-d109fbfe5a88 service nova] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:21:09.535562 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [req-90d4c337-26c8-4ba7-8d8d-0bcf11bcf29f req-d69f0587-b5d3-42bc-a1dd-d109fbfe5a88 service nova] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:21:09.546601 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.compute.server_external_events [req-90d4c337-26c8-4ba7-8d8d-0bcf11bcf29f req-d69f0587-b5d3-42bc-a1dd-d109fbfe5a88 service nova] Creating event network-changed:58b621ad-94f4-4882-b5ed-7393dd3d6b95 for instance d364cacb-afc7-4499-ab81-7e15d47f0b40 on hv-cinder-85409 Aug 23 07:21:09.551818 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [req-90d4c337-26c8-4ba7-8d8d-0bcf11bcf29f req-d69f0587-b5d3-42bc-a1dd-d109fbfe5a88 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031102 Aug 23 07:21:09.552820 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 394/812] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Aug 23 07:21:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 07:21:09.944139 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-20daa15f-6ea7-451b-8ca1-6a61d847f78e tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Calling method '>' {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:21:09.945254 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.compute.api [None req-20daa15f-6ea7-451b-8ca1-6a61d847f78e tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] [instance: 971419a3-e367-44fc-b6b4-10543aa4ab52] Fetching instance by UUID {{(pid=120799) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:21:09.951965 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-20daa15f-6ea7-451b-8ca1-6a61d847f78e tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:21:09.952733 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-20daa15f-6ea7-451b-8ca1-6a61d847f78e tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:21:09.953350 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-20daa15f-6ea7-451b-8ca1-6a61d847f78e tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:21:09.954266 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-20daa15f-6ea7-451b-8ca1-6a61d847f78e tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:21:09.954876 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-20daa15f-6ea7-451b-8ca1-6a61d847f78e tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:21:09.955553 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-20daa15f-6ea7-451b-8ca1-6a61d847f78e tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:21:09.979772 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-20daa15f-6ea7-451b-8ca1-6a61d847f78e tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] 10.222.0.17 "GET /compute/v2.1/servers/971419a3-e367-44fc-b6b4-10543aa4ab52/ips" status: 200 len: 151 microversion: 2.20 time: 0.039377 Aug 23 07:21:09.986645 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 419/813] 10.222.0.17 () {60 vars in 1289 bytes} [Tue Aug 23 07:21:09 2022] GET /compute/v2.1/servers/971419a3-e367-44fc-b6b4-10543aa4ab52/ips => generated 151 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 23 07:21:11.859151 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-76de968f-5c1e-4ea8-8751-28ffc90c5dea tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 07:21:11.860010 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.compute.api [None req-76de968f-5c1e-4ea8-8751-28ffc90c5dea tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] [instance: 971419a3-e367-44fc-b6b4-10543aa4ab52] Fetching instance by UUID {{(pid=120798) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:21:11.867191 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-76de968f-5c1e-4ea8-8751-28ffc90c5dea tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:21:11.867710 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-76de968f-5c1e-4ea8-8751-28ffc90c5dea tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:21:11.868144 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-76de968f-5c1e-4ea8-8751-28ffc90c5dea tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:21:11.868843 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-76de968f-5c1e-4ea8-8751-28ffc90c5dea tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:21:11.869290 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-76de968f-5c1e-4ea8-8751-28ffc90c5dea tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:21:11.869709 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-76de968f-5c1e-4ea8-8751-28ffc90c5dea tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:21:11.895948 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.objects.instance [None req-76de968f-5c1e-4ea8-8751-28ffc90c5dea tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lazy-loading 'flavor' on Instance uuid 971419a3-e367-44fc-b6b4-10543aa4ab52 {{(pid=120798) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 07:21:12.085874 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [None req-76de968f-5c1e-4ea8-8751-28ffc90c5dea tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] 10.222.0.17 "POST /compute/v2.1/servers/971419a3-e367-44fc-b6b4-10543aa4ab52/action" status: 202 len: 0 microversion: 2.20 time: 0.231710 Aug 23 07:21:12.086466 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 395/814] 10.222.0.17 () {62 vars in 1319 bytes} [Tue Aug 23 07:21:11 2022] POST /compute/v2.1/servers/971419a3-e367-44fc-b6b4-10543aa4ab52/action => generated 0 bytes in 233 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 23 07:21:12.095270 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-cf0bf73e-086d-4735-bbd5-34f897c955be tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Calling method '>' {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:21:12.095999 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.compute.api [None req-cf0bf73e-086d-4735-bbd5-34f897c955be tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] [instance: 971419a3-e367-44fc-b6b4-10543aa4ab52] Fetching instance by UUID {{(pid=120799) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:21:12.102124 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-cf0bf73e-086d-4735-bbd5-34f897c955be tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:21:12.102598 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-cf0bf73e-086d-4735-bbd5-34f897c955be tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:21:12.103020 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-cf0bf73e-086d-4735-bbd5-34f897c955be tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:21:12.103744 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-cf0bf73e-086d-4735-bbd5-34f897c955be tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:21:12.104188 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-cf0bf73e-086d-4735-bbd5-34f897c955be tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:21:12.104687 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-cf0bf73e-086d-4735-bbd5-34f897c955be tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:21:12.242114 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.policy [None req-cf0bf73e-086d-4735-bbd5-34f897c955be tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb28547f4b54c4097d2ffc3c533ca67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42af08ef367945939b1f59ffa8af351a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120799) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:21:12.250457 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.policy [None req-cf0bf73e-086d-4735-bbd5-34f897c955be tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4fb28547f4b54c4097d2ffc3c533ca67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42af08ef367945939b1f59ffa8af351a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120799) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:21:12.252045 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.policy [None req-cf0bf73e-086d-4735-bbd5-34f897c955be tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4fb28547f4b54c4097d2ffc3c533ca67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42af08ef367945939b1f59ffa8af351a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120799) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:21:12.253200 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-cf0bf73e-086d-4735-bbd5-34f897c955be tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] 10.222.0.17 "GET /compute/v2.1/servers/971419a3-e367-44fc-b6b4-10543aa4ab52" status: 200 len: 1720 microversion: 2.20 time: 0.162259 Aug 23 07:21:12.253753 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 420/815] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Aug 23 07:21:12 2022] GET /compute/v2.1/servers/971419a3-e367-44fc-b6b4-10543aa4ab52 => generated 1720 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 07:21:13.280858 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-55cae26e-f273-4b18-8a44-3139d587d7b8 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Calling method '>' {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:21:13.281606 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.compute.api [None req-55cae26e-f273-4b18-8a44-3139d587d7b8 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] [instance: 971419a3-e367-44fc-b6b4-10543aa4ab52] Fetching instance by UUID {{(pid=120798) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:21:13.290866 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-55cae26e-f273-4b18-8a44-3139d587d7b8 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:21:13.291550 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-55cae26e-f273-4b18-8a44-3139d587d7b8 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:21:13.292145 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-55cae26e-f273-4b18-8a44-3139d587d7b8 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:21:13.292969 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-55cae26e-f273-4b18-8a44-3139d587d7b8 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:21:13.293524 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-55cae26e-f273-4b18-8a44-3139d587d7b8 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:21:13.294102 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-55cae26e-f273-4b18-8a44-3139d587d7b8 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:21:13.431855 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.policy [None req-55cae26e-f273-4b18-8a44-3139d587d7b8 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb28547f4b54c4097d2ffc3c533ca67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42af08ef367945939b1f59ffa8af351a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120798) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:21:13.440442 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.policy [None req-55cae26e-f273-4b18-8a44-3139d587d7b8 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4fb28547f4b54c4097d2ffc3c533ca67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42af08ef367945939b1f59ffa8af351a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120798) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:21:13.441943 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.policy [None req-55cae26e-f273-4b18-8a44-3139d587d7b8 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4fb28547f4b54c4097d2ffc3c533ca67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42af08ef367945939b1f59ffa8af351a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120798) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:21:13.443101 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [None req-55cae26e-f273-4b18-8a44-3139d587d7b8 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] 10.222.0.17 "GET /compute/v2.1/servers/971419a3-e367-44fc-b6b4-10543aa4ab52" status: 200 len: 1720 microversion: 2.20 time: 0.169629 Aug 23 07:21:13.443683 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 396/816] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Aug 23 07:21:13 2022] GET /compute/v2.1/servers/971419a3-e367-44fc-b6b4-10543aa4ab52 => generated 1720 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 07:21:14.469824 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-144870a1-1cee-47e3-8e21-fb6f26c7dc39 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Calling method '>' {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:21:14.470757 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.compute.api [None req-144870a1-1cee-47e3-8e21-fb6f26c7dc39 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] [instance: 971419a3-e367-44fc-b6b4-10543aa4ab52] Fetching instance by UUID {{(pid=120799) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:21:14.478134 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-144870a1-1cee-47e3-8e21-fb6f26c7dc39 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:21:14.478617 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-144870a1-1cee-47e3-8e21-fb6f26c7dc39 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:21:14.479042 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-144870a1-1cee-47e3-8e21-fb6f26c7dc39 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:21:14.479797 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-144870a1-1cee-47e3-8e21-fb6f26c7dc39 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:21:14.480243 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-144870a1-1cee-47e3-8e21-fb6f26c7dc39 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:21:14.480660 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-144870a1-1cee-47e3-8e21-fb6f26c7dc39 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:21:14.620488 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.policy [None req-144870a1-1cee-47e3-8e21-fb6f26c7dc39 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb28547f4b54c4097d2ffc3c533ca67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42af08ef367945939b1f59ffa8af351a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120799) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:21:14.632807 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.policy [None req-144870a1-1cee-47e3-8e21-fb6f26c7dc39 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4fb28547f4b54c4097d2ffc3c533ca67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42af08ef367945939b1f59ffa8af351a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120799) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:21:14.635086 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.policy [None req-144870a1-1cee-47e3-8e21-fb6f26c7dc39 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4fb28547f4b54c4097d2ffc3c533ca67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42af08ef367945939b1f59ffa8af351a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120799) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:21:14.636887 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-144870a1-1cee-47e3-8e21-fb6f26c7dc39 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] 10.222.0.17 "GET /compute/v2.1/servers/971419a3-e367-44fc-b6b4-10543aa4ab52" status: 200 len: 1720 microversion: 2.20 time: 0.173784 Aug 23 07:21:14.637670 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 421/817] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Aug 23 07:21:14 2022] GET /compute/v2.1/servers/971419a3-e367-44fc-b6b4-10543aa4ab52 => generated 1720 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 07:21:15.661990 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-c8340c53-598d-40b8-ae56-3eaf73030343 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Calling method '>' {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:21:15.662586 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.compute.api [None req-c8340c53-598d-40b8-ae56-3eaf73030343 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] [instance: 971419a3-e367-44fc-b6b4-10543aa4ab52] Fetching instance by UUID {{(pid=120798) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:21:15.669646 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-c8340c53-598d-40b8-ae56-3eaf73030343 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:21:15.670117 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-c8340c53-598d-40b8-ae56-3eaf73030343 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:21:15.670542 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-c8340c53-598d-40b8-ae56-3eaf73030343 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:21:15.671220 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-c8340c53-598d-40b8-ae56-3eaf73030343 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:21:15.671699 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-c8340c53-598d-40b8-ae56-3eaf73030343 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:21:15.672120 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-c8340c53-598d-40b8-ae56-3eaf73030343 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:21:15.817059 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.policy [None req-c8340c53-598d-40b8-ae56-3eaf73030343 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb28547f4b54c4097d2ffc3c533ca67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42af08ef367945939b1f59ffa8af351a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120798) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:21:15.825695 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.policy [None req-c8340c53-598d-40b8-ae56-3eaf73030343 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4fb28547f4b54c4097d2ffc3c533ca67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42af08ef367945939b1f59ffa8af351a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120798) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:21:15.827189 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.policy [None req-c8340c53-598d-40b8-ae56-3eaf73030343 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4fb28547f4b54c4097d2ffc3c533ca67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42af08ef367945939b1f59ffa8af351a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120798) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:21:15.828364 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [None req-c8340c53-598d-40b8-ae56-3eaf73030343 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] 10.222.0.17 "GET /compute/v2.1/servers/971419a3-e367-44fc-b6b4-10543aa4ab52" status: 200 len: 1720 microversion: 2.20 time: 0.171373 Aug 23 07:21:15.828918 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 397/818] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Aug 23 07:21:15 2022] GET /compute/v2.1/servers/971419a3-e367-44fc-b6b4-10543aa4ab52 => generated 1720 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 07:21:16.856170 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-70fc1536-9e7f-45ac-9512-73bb38b461e0 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Calling method '>' {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:21:16.857043 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.compute.api [None req-70fc1536-9e7f-45ac-9512-73bb38b461e0 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] [instance: 971419a3-e367-44fc-b6b4-10543aa4ab52] Fetching instance by UUID {{(pid=120799) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:21:16.866841 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-70fc1536-9e7f-45ac-9512-73bb38b461e0 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:21:16.867312 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-70fc1536-9e7f-45ac-9512-73bb38b461e0 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:21:16.867778 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-70fc1536-9e7f-45ac-9512-73bb38b461e0 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:21:16.868460 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-70fc1536-9e7f-45ac-9512-73bb38b461e0 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:21:16.868934 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-70fc1536-9e7f-45ac-9512-73bb38b461e0 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:21:16.869353 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-70fc1536-9e7f-45ac-9512-73bb38b461e0 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:21:17.003336 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.policy [None req-70fc1536-9e7f-45ac-9512-73bb38b461e0 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb28547f4b54c4097d2ffc3c533ca67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42af08ef367945939b1f59ffa8af351a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120799) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:21:17.016496 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.policy [None req-70fc1536-9e7f-45ac-9512-73bb38b461e0 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4fb28547f4b54c4097d2ffc3c533ca67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42af08ef367945939b1f59ffa8af351a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120799) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:21:17.018730 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.policy [None req-70fc1536-9e7f-45ac-9512-73bb38b461e0 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4fb28547f4b54c4097d2ffc3c533ca67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42af08ef367945939b1f59ffa8af351a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120799) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:21:17.020703 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-70fc1536-9e7f-45ac-9512-73bb38b461e0 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] 10.222.0.17 "GET /compute/v2.1/servers/971419a3-e367-44fc-b6b4-10543aa4ab52" status: 200 len: 1720 microversion: 2.20 time: 0.171304 Aug 23 07:21:17.021270 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 422/819] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Aug 23 07:21:16 2022] GET /compute/v2.1/servers/971419a3-e367-44fc-b6b4-10543aa4ab52 => generated 1720 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 07:21:18.047237 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-6c781406-f8e1-4bee-92a5-c1a7b92f42b0 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Calling method '>' {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:21:18.048269 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.compute.api [None req-6c781406-f8e1-4bee-92a5-c1a7b92f42b0 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] [instance: 971419a3-e367-44fc-b6b4-10543aa4ab52] Fetching instance by UUID {{(pid=120798) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:21:18.059729 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-6c781406-f8e1-4bee-92a5-c1a7b92f42b0 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:21:18.060530 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-6c781406-f8e1-4bee-92a5-c1a7b92f42b0 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:21:18.061251 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-6c781406-f8e1-4bee-92a5-c1a7b92f42b0 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:21:18.062380 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-6c781406-f8e1-4bee-92a5-c1a7b92f42b0 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:21:18.063142 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-6c781406-f8e1-4bee-92a5-c1a7b92f42b0 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:21:18.063929 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-6c781406-f8e1-4bee-92a5-c1a7b92f42b0 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:21:18.200168 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.policy [None req-6c781406-f8e1-4bee-92a5-c1a7b92f42b0 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb28547f4b54c4097d2ffc3c533ca67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42af08ef367945939b1f59ffa8af351a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120798) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:21:18.208940 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.policy [None req-6c781406-f8e1-4bee-92a5-c1a7b92f42b0 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4fb28547f4b54c4097d2ffc3c533ca67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42af08ef367945939b1f59ffa8af351a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120798) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:21:18.210444 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.policy [None req-6c781406-f8e1-4bee-92a5-c1a7b92f42b0 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4fb28547f4b54c4097d2ffc3c533ca67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42af08ef367945939b1f59ffa8af351a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120798) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:21:18.211646 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [None req-6c781406-f8e1-4bee-92a5-c1a7b92f42b0 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] 10.222.0.17 "GET /compute/v2.1/servers/971419a3-e367-44fc-b6b4-10543aa4ab52" status: 200 len: 1720 microversion: 2.20 time: 0.171058 Aug 23 07:21:18.212204 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 398/820] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Aug 23 07:21:18 2022] GET /compute/v2.1/servers/971419a3-e367-44fc-b6b4-10543aa4ab52 => generated 1720 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 07:21:19.234770 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-ea88fda3-e456-497e-bfa1-749c1aecddca tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Calling method '>' {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:21:19.235345 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.compute.api [None req-ea88fda3-e456-497e-bfa1-749c1aecddca tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] [instance: 971419a3-e367-44fc-b6b4-10543aa4ab52] Fetching instance by UUID {{(pid=120799) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:21:19.242347 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-ea88fda3-e456-497e-bfa1-749c1aecddca tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:21:19.242817 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-ea88fda3-e456-497e-bfa1-749c1aecddca tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:21:19.243217 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-ea88fda3-e456-497e-bfa1-749c1aecddca tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:21:19.243939 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-ea88fda3-e456-497e-bfa1-749c1aecddca tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:21:19.244378 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-ea88fda3-e456-497e-bfa1-749c1aecddca tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:21:19.244786 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-ea88fda3-e456-497e-bfa1-749c1aecddca tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:21:19.386992 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.policy [None req-ea88fda3-e456-497e-bfa1-749c1aecddca tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb28547f4b54c4097d2ffc3c533ca67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42af08ef367945939b1f59ffa8af351a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120799) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:21:19.400190 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.policy [None req-ea88fda3-e456-497e-bfa1-749c1aecddca tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4fb28547f4b54c4097d2ffc3c533ca67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42af08ef367945939b1f59ffa8af351a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120799) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:21:19.402671 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.policy [None req-ea88fda3-e456-497e-bfa1-749c1aecddca tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4fb28547f4b54c4097d2ffc3c533ca67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42af08ef367945939b1f59ffa8af351a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120799) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:21:19.404545 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-ea88fda3-e456-497e-bfa1-749c1aecddca tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] 10.222.0.17 "GET /compute/v2.1/servers/971419a3-e367-44fc-b6b4-10543aa4ab52" status: 200 len: 1720 microversion: 2.20 time: 0.173679 Aug 23 07:21:19.405335 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 423/821] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Aug 23 07:21:19 2022] GET /compute/v2.1/servers/971419a3-e367-44fc-b6b4-10543aa4ab52 => generated 1720 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 07:21:20.432170 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-e5de6efb-056d-42d6-b335-92051a255382 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Calling method '>' {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:21:20.433174 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.compute.api [None req-e5de6efb-056d-42d6-b335-92051a255382 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] [instance: 971419a3-e367-44fc-b6b4-10543aa4ab52] Fetching instance by UUID {{(pid=120798) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:21:20.443275 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-e5de6efb-056d-42d6-b335-92051a255382 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:21:20.443803 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-e5de6efb-056d-42d6-b335-92051a255382 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:21:20.444239 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-e5de6efb-056d-42d6-b335-92051a255382 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:21:20.444942 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-e5de6efb-056d-42d6-b335-92051a255382 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:21:20.445394 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-e5de6efb-056d-42d6-b335-92051a255382 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:21:20.445822 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-e5de6efb-056d-42d6-b335-92051a255382 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:21:20.580913 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.policy [None req-e5de6efb-056d-42d6-b335-92051a255382 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb28547f4b54c4097d2ffc3c533ca67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42af08ef367945939b1f59ffa8af351a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120798) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:21:20.589774 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.policy [None req-e5de6efb-056d-42d6-b335-92051a255382 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4fb28547f4b54c4097d2ffc3c533ca67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42af08ef367945939b1f59ffa8af351a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120798) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:21:20.591588 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.policy [None req-e5de6efb-056d-42d6-b335-92051a255382 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4fb28547f4b54c4097d2ffc3c533ca67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42af08ef367945939b1f59ffa8af351a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120798) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:21:20.592742 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [None req-e5de6efb-056d-42d6-b335-92051a255382 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] 10.222.0.17 "GET /compute/v2.1/servers/971419a3-e367-44fc-b6b4-10543aa4ab52" status: 200 len: 1720 microversion: 2.20 time: 0.167361 Aug 23 07:21:20.593301 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 399/822] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Aug 23 07:21:20 2022] GET /compute/v2.1/servers/971419a3-e367-44fc-b6b4-10543aa4ab52 => generated 1720 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 07:21:21.616261 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-e3a8fe1c-dd38-4dc3-a4c2-4bd331f03e1f tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Calling method '>' {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:21:21.616855 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.compute.api [None req-e3a8fe1c-dd38-4dc3-a4c2-4bd331f03e1f tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] [instance: 971419a3-e367-44fc-b6b4-10543aa4ab52] Fetching instance by UUID {{(pid=120799) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:21:21.623824 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-e3a8fe1c-dd38-4dc3-a4c2-4bd331f03e1f tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:21:21.624298 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-e3a8fe1c-dd38-4dc3-a4c2-4bd331f03e1f tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:21:21.624724 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-e3a8fe1c-dd38-4dc3-a4c2-4bd331f03e1f tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:21:21.625398 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-e3a8fe1c-dd38-4dc3-a4c2-4bd331f03e1f tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:21:21.625842 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-e3a8fe1c-dd38-4dc3-a4c2-4bd331f03e1f tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:21:21.626253 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-e3a8fe1c-dd38-4dc3-a4c2-4bd331f03e1f tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:21:21.763058 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.policy [None req-e3a8fe1c-dd38-4dc3-a4c2-4bd331f03e1f tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb28547f4b54c4097d2ffc3c533ca67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42af08ef367945939b1f59ffa8af351a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120799) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:21:21.775960 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.policy [None req-e3a8fe1c-dd38-4dc3-a4c2-4bd331f03e1f tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4fb28547f4b54c4097d2ffc3c533ca67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42af08ef367945939b1f59ffa8af351a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120799) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:21:21.778015 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.policy [None req-e3a8fe1c-dd38-4dc3-a4c2-4bd331f03e1f tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4fb28547f4b54c4097d2ffc3c533ca67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42af08ef367945939b1f59ffa8af351a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120799) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:21:21.779863 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-e3a8fe1c-dd38-4dc3-a4c2-4bd331f03e1f tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] 10.222.0.17 "GET /compute/v2.1/servers/971419a3-e367-44fc-b6b4-10543aa4ab52" status: 200 len: 1720 microversion: 2.20 time: 0.167536 Aug 23 07:21:21.780721 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 424/823] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Aug 23 07:21:21 2022] GET /compute/v2.1/servers/971419a3-e367-44fc-b6b4-10543aa4ab52 => generated 1720 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 07:21:22.807292 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-2ba09310-6437-4dd3-9445-e7772cab0556 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Calling method '>' {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:21:22.808281 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.compute.api [None req-2ba09310-6437-4dd3-9445-e7772cab0556 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] [instance: 971419a3-e367-44fc-b6b4-10543aa4ab52] Fetching instance by UUID {{(pid=120798) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:21:22.811461 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG dbcounter [-] [120798] Writing DB stats nova_api:SELECT=44,nova_api:INSERT=3 {{(pid=120798) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:21:22.820365 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-2ba09310-6437-4dd3-9445-e7772cab0556 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:21:22.821164 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-2ba09310-6437-4dd3-9445-e7772cab0556 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:21:22.821854 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-2ba09310-6437-4dd3-9445-e7772cab0556 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:21:22.822972 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-2ba09310-6437-4dd3-9445-e7772cab0556 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:21:22.823767 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-2ba09310-6437-4dd3-9445-e7772cab0556 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:21:22.824453 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-2ba09310-6437-4dd3-9445-e7772cab0556 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:21:22.829785 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG dbcounter [-] [120798] Writing DB stats nova_cell1:SELECT=84,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120798) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:21:22.973731 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.policy [None req-2ba09310-6437-4dd3-9445-e7772cab0556 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb28547f4b54c4097d2ffc3c533ca67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42af08ef367945939b1f59ffa8af351a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120798) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:21:22.986311 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.policy [None req-2ba09310-6437-4dd3-9445-e7772cab0556 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4fb28547f4b54c4097d2ffc3c533ca67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42af08ef367945939b1f59ffa8af351a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120798) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:21:22.988612 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.policy [None req-2ba09310-6437-4dd3-9445-e7772cab0556 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4fb28547f4b54c4097d2ffc3c533ca67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42af08ef367945939b1f59ffa8af351a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120798) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:21:22.990662 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [None req-2ba09310-6437-4dd3-9445-e7772cab0556 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] 10.222.0.17 "GET /compute/v2.1/servers/971419a3-e367-44fc-b6b4-10543aa4ab52" status: 200 len: 1720 microversion: 2.20 time: 0.189973 Aug 23 07:21:22.991460 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 400/824] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Aug 23 07:21:22 2022] GET /compute/v2.1/servers/971419a3-e367-44fc-b6b4-10543aa4ab52 => generated 1720 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 07:21:24.015771 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-be4fed83-45ac-48ac-b84b-db6011d95330 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Calling method '>' {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:21:24.016609 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.compute.api [None req-be4fed83-45ac-48ac-b84b-db6011d95330 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] [instance: 971419a3-e367-44fc-b6b4-10543aa4ab52] Fetching instance by UUID {{(pid=120799) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:21:24.019488 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG dbcounter [-] [120799] Writing DB stats nova_api:SELECT=33 {{(pid=120799) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:21:24.026520 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-be4fed83-45ac-48ac-b84b-db6011d95330 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:21:24.027138 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-be4fed83-45ac-48ac-b84b-db6011d95330 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:21:24.027705 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-be4fed83-45ac-48ac-b84b-db6011d95330 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:21:24.028545 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-be4fed83-45ac-48ac-b84b-db6011d95330 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:21:24.029092 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-be4fed83-45ac-48ac-b84b-db6011d95330 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:21:24.029633 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-be4fed83-45ac-48ac-b84b-db6011d95330 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:21:24.033046 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG dbcounter [-] [120799] Writing DB stats nova_cell1:SELECT=83 {{(pid=120799) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:21:24.166814 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.policy [None req-be4fed83-45ac-48ac-b84b-db6011d95330 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb28547f4b54c4097d2ffc3c533ca67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42af08ef367945939b1f59ffa8af351a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120799) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:21:24.178608 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.policy [None req-be4fed83-45ac-48ac-b84b-db6011d95330 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4fb28547f4b54c4097d2ffc3c533ca67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42af08ef367945939b1f59ffa8af351a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120799) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:21:24.180801 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.policy [None req-be4fed83-45ac-48ac-b84b-db6011d95330 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4fb28547f4b54c4097d2ffc3c533ca67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42af08ef367945939b1f59ffa8af351a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120799) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:21:24.182474 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-be4fed83-45ac-48ac-b84b-db6011d95330 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] 10.222.0.17 "GET /compute/v2.1/servers/971419a3-e367-44fc-b6b4-10543aa4ab52" status: 200 len: 1720 microversion: 2.20 time: 0.171777 Aug 23 07:21:24.183292 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 425/825] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Aug 23 07:21:24 2022] GET /compute/v2.1/servers/971419a3-e367-44fc-b6b4-10543aa4ab52 => generated 1720 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 07:21:25.212147 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-8ac03caf-b4a2-481a-9265-7635f2d04727 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Calling method '>' {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:21:25.212771 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.compute.api [None req-8ac03caf-b4a2-481a-9265-7635f2d04727 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] [instance: 971419a3-e367-44fc-b6b4-10543aa4ab52] Fetching instance by UUID {{(pid=120798) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:21:25.219889 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-8ac03caf-b4a2-481a-9265-7635f2d04727 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:21:25.220371 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-8ac03caf-b4a2-481a-9265-7635f2d04727 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:21:25.220811 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-8ac03caf-b4a2-481a-9265-7635f2d04727 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:21:25.221498 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-8ac03caf-b4a2-481a-9265-7635f2d04727 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:21:25.221929 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-8ac03caf-b4a2-481a-9265-7635f2d04727 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:21:25.222346 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-8ac03caf-b4a2-481a-9265-7635f2d04727 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:21:25.367303 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.policy [None req-8ac03caf-b4a2-481a-9265-7635f2d04727 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb28547f4b54c4097d2ffc3c533ca67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42af08ef367945939b1f59ffa8af351a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120798) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:21:25.379727 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.policy [None req-8ac03caf-b4a2-481a-9265-7635f2d04727 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4fb28547f4b54c4097d2ffc3c533ca67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42af08ef367945939b1f59ffa8af351a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120798) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:21:25.381342 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.policy [None req-8ac03caf-b4a2-481a-9265-7635f2d04727 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4fb28547f4b54c4097d2ffc3c533ca67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42af08ef367945939b1f59ffa8af351a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120798) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:21:25.382508 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [None req-8ac03caf-b4a2-481a-9265-7635f2d04727 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] 10.222.0.17 "GET /compute/v2.1/servers/971419a3-e367-44fc-b6b4-10543aa4ab52" status: 200 len: 1720 microversion: 2.20 time: 0.179055 Aug 23 07:21:25.383074 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 401/826] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Aug 23 07:21:25 2022] GET /compute/v2.1/servers/971419a3-e367-44fc-b6b4-10543aa4ab52 => generated 1720 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 07:21:26.410010 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-cd0c486d-e46d-4616-be0b-9391e53ffe95 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Calling method '>' {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:21:26.410931 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.compute.api [None req-cd0c486d-e46d-4616-be0b-9391e53ffe95 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] [instance: 971419a3-e367-44fc-b6b4-10543aa4ab52] Fetching instance by UUID {{(pid=120799) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:21:26.418498 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-cd0c486d-e46d-4616-be0b-9391e53ffe95 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:21:26.418973 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-cd0c486d-e46d-4616-be0b-9391e53ffe95 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:21:26.419399 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-cd0c486d-e46d-4616-be0b-9391e53ffe95 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:21:26.420100 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-cd0c486d-e46d-4616-be0b-9391e53ffe95 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:21:26.420548 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-cd0c486d-e46d-4616-be0b-9391e53ffe95 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:21:26.420954 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-cd0c486d-e46d-4616-be0b-9391e53ffe95 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:21:26.575696 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.policy [None req-cd0c486d-e46d-4616-be0b-9391e53ffe95 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb28547f4b54c4097d2ffc3c533ca67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42af08ef367945939b1f59ffa8af351a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120799) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:21:26.584437 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.policy [None req-cd0c486d-e46d-4616-be0b-9391e53ffe95 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4fb28547f4b54c4097d2ffc3c533ca67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42af08ef367945939b1f59ffa8af351a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120799) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:21:26.585930 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.policy [None req-cd0c486d-e46d-4616-be0b-9391e53ffe95 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4fb28547f4b54c4097d2ffc3c533ca67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42af08ef367945939b1f59ffa8af351a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120799) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:21:26.587092 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-cd0c486d-e46d-4616-be0b-9391e53ffe95 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] 10.222.0.17 "GET /compute/v2.1/servers/971419a3-e367-44fc-b6b4-10543aa4ab52" status: 200 len: 1720 microversion: 2.20 time: 0.183896 Aug 23 07:21:26.587651 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 426/827] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Aug 23 07:21:26 2022] GET /compute/v2.1/servers/971419a3-e367-44fc-b6b4-10543aa4ab52 => generated 1720 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 07:21:27.610902 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-d4ec3786-409d-4da3-b421-96997671e672 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Calling method '>' {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:21:27.611607 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.compute.api [None req-d4ec3786-409d-4da3-b421-96997671e672 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] [instance: 971419a3-e367-44fc-b6b4-10543aa4ab52] Fetching instance by UUID {{(pid=120798) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:21:27.618548 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-d4ec3786-409d-4da3-b421-96997671e672 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:21:27.619034 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-d4ec3786-409d-4da3-b421-96997671e672 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:21:27.619492 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-d4ec3786-409d-4da3-b421-96997671e672 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:21:27.620189 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-d4ec3786-409d-4da3-b421-96997671e672 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:21:27.620641 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-d4ec3786-409d-4da3-b421-96997671e672 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:21:27.621062 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-d4ec3786-409d-4da3-b421-96997671e672 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:21:27.752561 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.policy [None req-d4ec3786-409d-4da3-b421-96997671e672 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb28547f4b54c4097d2ffc3c533ca67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42af08ef367945939b1f59ffa8af351a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120798) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:21:27.761196 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.policy [None req-d4ec3786-409d-4da3-b421-96997671e672 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4fb28547f4b54c4097d2ffc3c533ca67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42af08ef367945939b1f59ffa8af351a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120798) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:21:27.762692 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.policy [None req-d4ec3786-409d-4da3-b421-96997671e672 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4fb28547f4b54c4097d2ffc3c533ca67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42af08ef367945939b1f59ffa8af351a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120798) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:21:27.763881 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [None req-d4ec3786-409d-4da3-b421-96997671e672 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] 10.222.0.17 "GET /compute/v2.1/servers/971419a3-e367-44fc-b6b4-10543aa4ab52" status: 200 len: 1741 microversion: 2.20 time: 0.157438 Aug 23 07:21:27.764409 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 402/828] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Aug 23 07:21:27 2022] GET /compute/v2.1/servers/971419a3-e367-44fc-b6b4-10543aa4ab52 => generated 1741 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 07:21:28.792275 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-a98b588e-a530-478a-85c3-e030a849e2bd tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Calling method '>' {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:21:28.793249 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.compute.api [None req-a98b588e-a530-478a-85c3-e030a849e2bd tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] [instance: 971419a3-e367-44fc-b6b4-10543aa4ab52] Fetching instance by UUID {{(pid=120799) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:21:28.803367 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-a98b588e-a530-478a-85c3-e030a849e2bd tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:21:28.803860 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-a98b588e-a530-478a-85c3-e030a849e2bd tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:21:28.804288 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-a98b588e-a530-478a-85c3-e030a849e2bd tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:21:28.804956 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-a98b588e-a530-478a-85c3-e030a849e2bd tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:21:28.805396 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-a98b588e-a530-478a-85c3-e030a849e2bd tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:21:28.805809 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-a98b588e-a530-478a-85c3-e030a849e2bd tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:21:28.945995 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.policy [None req-a98b588e-a530-478a-85c3-e030a849e2bd tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb28547f4b54c4097d2ffc3c533ca67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42af08ef367945939b1f59ffa8af351a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120799) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:21:28.954500 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.policy [None req-a98b588e-a530-478a-85c3-e030a849e2bd tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4fb28547f4b54c4097d2ffc3c533ca67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42af08ef367945939b1f59ffa8af351a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120799) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:21:28.956036 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.policy [None req-a98b588e-a530-478a-85c3-e030a849e2bd tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4fb28547f4b54c4097d2ffc3c533ca67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42af08ef367945939b1f59ffa8af351a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120799) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:21:28.957207 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-a98b588e-a530-478a-85c3-e030a849e2bd tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] 10.222.0.17 "GET /compute/v2.1/servers/971419a3-e367-44fc-b6b4-10543aa4ab52" status: 200 len: 1741 microversion: 2.20 time: 0.172352 Aug 23 07:21:28.957762 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 427/829] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Aug 23 07:21:28 2022] GET /compute/v2.1/servers/971419a3-e367-44fc-b6b4-10543aa4ab52 => generated 1741 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 07:21:29.981562 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-c91f4488-5632-4cc4-b204-4d4eb4e1dfb0 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Calling method '>' {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:21:29.982849 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.compute.api [None req-c91f4488-5632-4cc4-b204-4d4eb4e1dfb0 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] [instance: 971419a3-e367-44fc-b6b4-10543aa4ab52] Fetching instance by UUID {{(pid=120798) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:21:29.990028 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-c91f4488-5632-4cc4-b204-4d4eb4e1dfb0 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:21:29.990517 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-c91f4488-5632-4cc4-b204-4d4eb4e1dfb0 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:21:29.990949 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-c91f4488-5632-4cc4-b204-4d4eb4e1dfb0 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:21:29.991674 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-c91f4488-5632-4cc4-b204-4d4eb4e1dfb0 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:21:29.992123 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-c91f4488-5632-4cc4-b204-4d4eb4e1dfb0 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:21:29.992557 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-c91f4488-5632-4cc4-b204-4d4eb4e1dfb0 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:21:30.153219 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.policy [None req-c91f4488-5632-4cc4-b204-4d4eb4e1dfb0 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb28547f4b54c4097d2ffc3c533ca67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42af08ef367945939b1f59ffa8af351a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120798) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:21:30.163519 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.policy [None req-c91f4488-5632-4cc4-b204-4d4eb4e1dfb0 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4fb28547f4b54c4097d2ffc3c533ca67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42af08ef367945939b1f59ffa8af351a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120798) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:21:30.165049 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.policy [None req-c91f4488-5632-4cc4-b204-4d4eb4e1dfb0 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4fb28547f4b54c4097d2ffc3c533ca67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42af08ef367945939b1f59ffa8af351a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120798) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:21:30.166220 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [None req-c91f4488-5632-4cc4-b204-4d4eb4e1dfb0 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] 10.222.0.17 "GET /compute/v2.1/servers/971419a3-e367-44fc-b6b4-10543aa4ab52" status: 200 len: 1736 microversion: 2.20 time: 0.188769 Aug 23 07:21:30.166769 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 403/830] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Aug 23 07:21:29 2022] GET /compute/v2.1/servers/971419a3-e367-44fc-b6b4-10543aa4ab52 => generated 1736 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 07:21:31.194427 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-b807ba47-a17f-43e3-8359-d7c31f88bf6e tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Calling method '>' {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:21:31.195880 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.compute.api [None req-b807ba47-a17f-43e3-8359-d7c31f88bf6e tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] [instance: 971419a3-e367-44fc-b6b4-10543aa4ab52] Fetching instance by UUID {{(pid=120799) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:21:31.203357 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-b807ba47-a17f-43e3-8359-d7c31f88bf6e tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:21:31.203929 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-b807ba47-a17f-43e3-8359-d7c31f88bf6e tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:21:31.205347 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-b807ba47-a17f-43e3-8359-d7c31f88bf6e tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:21:31.207051 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-b807ba47-a17f-43e3-8359-d7c31f88bf6e tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:21:31.207479 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-b807ba47-a17f-43e3-8359-d7c31f88bf6e tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:21:31.208531 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-b807ba47-a17f-43e3-8359-d7c31f88bf6e tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:21:31.362182 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.policy [None req-b807ba47-a17f-43e3-8359-d7c31f88bf6e tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb28547f4b54c4097d2ffc3c533ca67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42af08ef367945939b1f59ffa8af351a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120799) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:21:31.370960 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.policy [None req-b807ba47-a17f-43e3-8359-d7c31f88bf6e tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4fb28547f4b54c4097d2ffc3c533ca67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42af08ef367945939b1f59ffa8af351a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120799) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:21:31.372587 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.policy [None req-b807ba47-a17f-43e3-8359-d7c31f88bf6e tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4fb28547f4b54c4097d2ffc3c533ca67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42af08ef367945939b1f59ffa8af351a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120799) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:21:31.374305 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-b807ba47-a17f-43e3-8359-d7c31f88bf6e tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] 10.222.0.17 "GET /compute/v2.1/servers/971419a3-e367-44fc-b6b4-10543aa4ab52" status: 200 len: 1736 microversion: 2.20 time: 0.188195 Aug 23 07:21:31.374951 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 428/831] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Aug 23 07:21:31 2022] GET /compute/v2.1/servers/971419a3-e367-44fc-b6b4-10543aa4ab52 => generated 1736 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 07:21:31.671131 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [req-3a7d03ce-86fb-41c0-b8a8-b99e13f28dae req-0ae13acf-0abc-4618-9798-c92d264a2d0d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "971419a3-e367-44fc-b6b4-10543aa4ab52", "name": "network-vif-plugged", "status": "completed", "tag": "7a341a97-ef9f-44a7-99ba-2be318b77ee7"}]} {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 07:21:31.683284 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [req-3a7d03ce-86fb-41c0-b8a8-b99e13f28dae req-0ae13acf-0abc-4618-9798-c92d264a2d0d service nova] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:21:31.683793 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [req-3a7d03ce-86fb-41c0-b8a8-b99e13f28dae req-0ae13acf-0abc-4618-9798-c92d264a2d0d service nova] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:21:31.684222 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [req-3a7d03ce-86fb-41c0-b8a8-b99e13f28dae req-0ae13acf-0abc-4618-9798-c92d264a2d0d service nova] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:21:31.698465 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.compute.server_external_events [req-3a7d03ce-86fb-41c0-b8a8-b99e13f28dae req-0ae13acf-0abc-4618-9798-c92d264a2d0d service nova] Creating event network-vif-plugged:7a341a97-ef9f-44a7-99ba-2be318b77ee7 for instance 971419a3-e367-44fc-b6b4-10543aa4ab52 on hv-cinder-85409 Aug 23 07:21:31.704328 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [req-3a7d03ce-86fb-41c0-b8a8-b99e13f28dae req-0ae13acf-0abc-4618-9798-c92d264a2d0d service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036846 Aug 23 07:21:31.705716 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 404/832] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Aug 23 07:21:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 07:21:32.398770 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-6b281b44-2482-466b-9d03-53ef7a786583 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Calling method '>' {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:21:32.400205 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.compute.api [None req-6b281b44-2482-466b-9d03-53ef7a786583 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] [instance: 971419a3-e367-44fc-b6b4-10543aa4ab52] Fetching instance by UUID {{(pid=120799) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:21:32.407452 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-6b281b44-2482-466b-9d03-53ef7a786583 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:21:32.408203 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-6b281b44-2482-466b-9d03-53ef7a786583 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:21:32.408879 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-6b281b44-2482-466b-9d03-53ef7a786583 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:21:32.409687 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-6b281b44-2482-466b-9d03-53ef7a786583 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:21:32.410330 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-6b281b44-2482-466b-9d03-53ef7a786583 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:21:32.410957 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-6b281b44-2482-466b-9d03-53ef7a786583 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:21:32.566474 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.policy [None req-6b281b44-2482-466b-9d03-53ef7a786583 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb28547f4b54c4097d2ffc3c533ca67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42af08ef367945939b1f59ffa8af351a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120799) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:21:32.575589 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.policy [None req-6b281b44-2482-466b-9d03-53ef7a786583 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4fb28547f4b54c4097d2ffc3c533ca67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42af08ef367945939b1f59ffa8af351a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120799) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:21:32.577370 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.policy [None req-6b281b44-2482-466b-9d03-53ef7a786583 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4fb28547f4b54c4097d2ffc3c533ca67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42af08ef367945939b1f59ffa8af351a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120799) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:21:32.578583 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-6b281b44-2482-466b-9d03-53ef7a786583 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] 10.222.0.17 "GET /compute/v2.1/servers/971419a3-e367-44fc-b6b4-10543aa4ab52" status: 200 len: 1736 microversion: 2.20 time: 0.184664 Aug 23 07:21:32.579252 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 429/833] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Aug 23 07:21:32 2022] GET /compute/v2.1/servers/971419a3-e367-44fc-b6b4-10543aa4ab52 => generated 1736 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 07:21:33.604004 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-d59b5c5e-1b73-4762-92fb-faf9c5efd9bc tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Calling method '>' {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:21:33.606313 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.compute.api [None req-d59b5c5e-1b73-4762-92fb-faf9c5efd9bc tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] [instance: 971419a3-e367-44fc-b6b4-10543aa4ab52] Fetching instance by UUID {{(pid=120798) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:21:33.613238 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-d59b5c5e-1b73-4762-92fb-faf9c5efd9bc tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:21:33.613769 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-d59b5c5e-1b73-4762-92fb-faf9c5efd9bc tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:21:33.614204 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-d59b5c5e-1b73-4762-92fb-faf9c5efd9bc tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:21:33.615307 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-d59b5c5e-1b73-4762-92fb-faf9c5efd9bc tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:21:33.615956 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-d59b5c5e-1b73-4762-92fb-faf9c5efd9bc tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:21:33.616551 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-d59b5c5e-1b73-4762-92fb-faf9c5efd9bc tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:21:33.766361 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.policy [None req-d59b5c5e-1b73-4762-92fb-faf9c5efd9bc tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb28547f4b54c4097d2ffc3c533ca67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42af08ef367945939b1f59ffa8af351a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120798) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:21:33.775458 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.policy [None req-d59b5c5e-1b73-4762-92fb-faf9c5efd9bc tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4fb28547f4b54c4097d2ffc3c533ca67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42af08ef367945939b1f59ffa8af351a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120798) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:21:33.777252 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.policy [None req-d59b5c5e-1b73-4762-92fb-faf9c5efd9bc tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4fb28547f4b54c4097d2ffc3c533ca67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42af08ef367945939b1f59ffa8af351a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120798) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:21:33.778489 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [None req-d59b5c5e-1b73-4762-92fb-faf9c5efd9bc tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] 10.222.0.17 "GET /compute/v2.1/servers/971419a3-e367-44fc-b6b4-10543aa4ab52" status: 200 len: 1736 microversion: 2.20 time: 0.179813 Aug 23 07:21:33.779574 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 405/834] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Aug 23 07:21:33 2022] GET /compute/v2.1/servers/971419a3-e367-44fc-b6b4-10543aa4ab52 => generated 1736 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 07:21:34.803882 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-5c7cd8cf-7efa-463b-a5d8-8fc94952cebc tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Calling method '>' {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:21:34.804480 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.compute.api [None req-5c7cd8cf-7efa-463b-a5d8-8fc94952cebc tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] [instance: 971419a3-e367-44fc-b6b4-10543aa4ab52] Fetching instance by UUID {{(pid=120799) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:21:34.811249 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-5c7cd8cf-7efa-463b-a5d8-8fc94952cebc tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:21:34.811822 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-5c7cd8cf-7efa-463b-a5d8-8fc94952cebc tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:21:34.812262 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-5c7cd8cf-7efa-463b-a5d8-8fc94952cebc tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:21:34.812953 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-5c7cd8cf-7efa-463b-a5d8-8fc94952cebc tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:21:34.813395 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-5c7cd8cf-7efa-463b-a5d8-8fc94952cebc tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:21:34.813806 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-5c7cd8cf-7efa-463b-a5d8-8fc94952cebc tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:21:34.951570 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.policy [None req-5c7cd8cf-7efa-463b-a5d8-8fc94952cebc tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb28547f4b54c4097d2ffc3c533ca67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42af08ef367945939b1f59ffa8af351a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120799) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:21:34.960525 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.policy [None req-5c7cd8cf-7efa-463b-a5d8-8fc94952cebc tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4fb28547f4b54c4097d2ffc3c533ca67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42af08ef367945939b1f59ffa8af351a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120799) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:21:34.962186 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.policy [None req-5c7cd8cf-7efa-463b-a5d8-8fc94952cebc tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4fb28547f4b54c4097d2ffc3c533ca67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42af08ef367945939b1f59ffa8af351a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120799) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:21:34.963353 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-5c7cd8cf-7efa-463b-a5d8-8fc94952cebc tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] 10.222.0.17 "GET /compute/v2.1/servers/971419a3-e367-44fc-b6b4-10543aa4ab52" status: 200 len: 1736 microversion: 2.20 time: 0.165844 Aug 23 07:21:34.970628 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 430/835] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Aug 23 07:21:34 2022] GET /compute/v2.1/servers/971419a3-e367-44fc-b6b4-10543aa4ab52 => generated 1736 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 07:21:35.986920 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-0d4580b5-836c-4748-a3f5-43963f438d76 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Calling method '>' {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:21:35.987548 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.compute.api [None req-0d4580b5-836c-4748-a3f5-43963f438d76 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] [instance: 971419a3-e367-44fc-b6b4-10543aa4ab52] Fetching instance by UUID {{(pid=120798) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:21:35.994119 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-0d4580b5-836c-4748-a3f5-43963f438d76 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:21:35.994613 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-0d4580b5-836c-4748-a3f5-43963f438d76 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:21:35.995260 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-0d4580b5-836c-4748-a3f5-43963f438d76 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:21:35.996131 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-0d4580b5-836c-4748-a3f5-43963f438d76 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:21:35.996586 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-0d4580b5-836c-4748-a3f5-43963f438d76 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:21:35.997027 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-0d4580b5-836c-4748-a3f5-43963f438d76 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:21:36.144921 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.policy [None req-0d4580b5-836c-4748-a3f5-43963f438d76 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb28547f4b54c4097d2ffc3c533ca67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42af08ef367945939b1f59ffa8af351a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120798) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:21:36.154334 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.policy [None req-0d4580b5-836c-4748-a3f5-43963f438d76 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4fb28547f4b54c4097d2ffc3c533ca67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42af08ef367945939b1f59ffa8af351a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120798) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:21:36.157227 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.policy [None req-0d4580b5-836c-4748-a3f5-43963f438d76 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4fb28547f4b54c4097d2ffc3c533ca67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42af08ef367945939b1f59ffa8af351a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120798) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:21:36.158938 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [None req-0d4580b5-836c-4748-a3f5-43963f438d76 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] 10.222.0.17 "GET /compute/v2.1/servers/971419a3-e367-44fc-b6b4-10543aa4ab52" status: 200 len: 1736 microversion: 2.20 time: 0.176519 Aug 23 07:21:36.159856 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 406/836] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Aug 23 07:21:35 2022] GET /compute/v2.1/servers/971419a3-e367-44fc-b6b4-10543aa4ab52 => generated 1736 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 07:21:37.182485 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-f26957ec-ab9a-49d5-a33d-7b84e12e09d5 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Calling method '>' {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:21:37.183078 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.compute.api [None req-f26957ec-ab9a-49d5-a33d-7b84e12e09d5 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] [instance: 971419a3-e367-44fc-b6b4-10543aa4ab52] Fetching instance by UUID {{(pid=120799) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:21:37.190665 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-f26957ec-ab9a-49d5-a33d-7b84e12e09d5 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:21:37.191125 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-f26957ec-ab9a-49d5-a33d-7b84e12e09d5 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:21:37.191603 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-f26957ec-ab9a-49d5-a33d-7b84e12e09d5 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:21:37.192292 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-f26957ec-ab9a-49d5-a33d-7b84e12e09d5 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:21:37.192799 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-f26957ec-ab9a-49d5-a33d-7b84e12e09d5 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:21:37.193207 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-f26957ec-ab9a-49d5-a33d-7b84e12e09d5 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:21:37.338542 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.policy [None req-f26957ec-ab9a-49d5-a33d-7b84e12e09d5 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb28547f4b54c4097d2ffc3c533ca67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42af08ef367945939b1f59ffa8af351a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120799) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:21:37.347967 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.policy [None req-f26957ec-ab9a-49d5-a33d-7b84e12e09d5 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4fb28547f4b54c4097d2ffc3c533ca67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42af08ef367945939b1f59ffa8af351a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120799) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:21:37.349553 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.policy [None req-f26957ec-ab9a-49d5-a33d-7b84e12e09d5 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4fb28547f4b54c4097d2ffc3c533ca67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42af08ef367945939b1f59ffa8af351a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120799) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:21:37.350733 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-f26957ec-ab9a-49d5-a33d-7b84e12e09d5 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] 10.222.0.17 "GET /compute/v2.1/servers/971419a3-e367-44fc-b6b4-10543aa4ab52" status: 200 len: 1736 microversion: 2.20 time: 0.172481 Aug 23 07:21:37.351495 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 431/837] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Aug 23 07:21:37 2022] GET /compute/v2.1/servers/971419a3-e367-44fc-b6b4-10543aa4ab52 => generated 1736 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 07:21:38.379036 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-918af334-db71-40c4-b852-96fcbdf5b0c2 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Calling method '>' {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:21:38.379740 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.compute.api [None req-918af334-db71-40c4-b852-96fcbdf5b0c2 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] [instance: 971419a3-e367-44fc-b6b4-10543aa4ab52] Fetching instance by UUID {{(pid=120798) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:21:38.388396 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-918af334-db71-40c4-b852-96fcbdf5b0c2 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:21:38.388899 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-918af334-db71-40c4-b852-96fcbdf5b0c2 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:21:38.389323 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-918af334-db71-40c4-b852-96fcbdf5b0c2 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:21:38.390055 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-918af334-db71-40c4-b852-96fcbdf5b0c2 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:21:38.390501 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-918af334-db71-40c4-b852-96fcbdf5b0c2 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:21:38.390919 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-918af334-db71-40c4-b852-96fcbdf5b0c2 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:21:38.572046 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.policy [None req-918af334-db71-40c4-b852-96fcbdf5b0c2 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb28547f4b54c4097d2ffc3c533ca67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42af08ef367945939b1f59ffa8af351a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120798) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:21:38.594743 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.policy [None req-918af334-db71-40c4-b852-96fcbdf5b0c2 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4fb28547f4b54c4097d2ffc3c533ca67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42af08ef367945939b1f59ffa8af351a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120798) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:21:38.596448 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.policy [None req-918af334-db71-40c4-b852-96fcbdf5b0c2 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4fb28547f4b54c4097d2ffc3c533ca67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42af08ef367945939b1f59ffa8af351a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120798) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:21:38.597624 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [None req-918af334-db71-40c4-b852-96fcbdf5b0c2 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] 10.222.0.17 "GET /compute/v2.1/servers/971419a3-e367-44fc-b6b4-10543aa4ab52" status: 200 len: 1736 microversion: 2.20 time: 0.222828 Aug 23 07:21:38.598391 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 407/838] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Aug 23 07:21:38 2022] GET /compute/v2.1/servers/971419a3-e367-44fc-b6b4-10543aa4ab52 => generated 1736 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 07:21:39.621404 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-a4f5c1e4-ab65-4dc3-bd1b-6bddad7e3710 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Calling method '>' {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:21:39.622003 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.compute.api [None req-a4f5c1e4-ab65-4dc3-bd1b-6bddad7e3710 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] [instance: 971419a3-e367-44fc-b6b4-10543aa4ab52] Fetching instance by UUID {{(pid=120799) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:21:39.628729 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-a4f5c1e4-ab65-4dc3-bd1b-6bddad7e3710 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:21:39.629202 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-a4f5c1e4-ab65-4dc3-bd1b-6bddad7e3710 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:21:39.629627 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-a4f5c1e4-ab65-4dc3-bd1b-6bddad7e3710 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:21:39.630394 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-a4f5c1e4-ab65-4dc3-bd1b-6bddad7e3710 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:21:39.630852 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-a4f5c1e4-ab65-4dc3-bd1b-6bddad7e3710 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:21:39.631247 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-a4f5c1e4-ab65-4dc3-bd1b-6bddad7e3710 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:21:39.767903 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.policy [None req-a4f5c1e4-ab65-4dc3-bd1b-6bddad7e3710 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb28547f4b54c4097d2ffc3c533ca67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42af08ef367945939b1f59ffa8af351a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120799) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:21:39.776793 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.policy [None req-a4f5c1e4-ab65-4dc3-bd1b-6bddad7e3710 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4fb28547f4b54c4097d2ffc3c533ca67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42af08ef367945939b1f59ffa8af351a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120799) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:21:39.778285 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.policy [None req-a4f5c1e4-ab65-4dc3-bd1b-6bddad7e3710 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4fb28547f4b54c4097d2ffc3c533ca67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42af08ef367945939b1f59ffa8af351a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120799) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:21:39.779480 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-a4f5c1e4-ab65-4dc3-bd1b-6bddad7e3710 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] 10.222.0.17 "GET /compute/v2.1/servers/971419a3-e367-44fc-b6b4-10543aa4ab52" status: 200 len: 1736 microversion: 2.20 time: 0.162189 Aug 23 07:21:39.780027 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 432/839] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Aug 23 07:21:39 2022] GET /compute/v2.1/servers/971419a3-e367-44fc-b6b4-10543aa4ab52 => generated 1736 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 07:21:40.804491 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-2c7edf7d-5445-4536-86fe-03215faa98f3 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Calling method '>' {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:21:40.805119 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.compute.api [None req-2c7edf7d-5445-4536-86fe-03215faa98f3 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] [instance: 971419a3-e367-44fc-b6b4-10543aa4ab52] Fetching instance by UUID {{(pid=120798) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:21:40.812538 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-2c7edf7d-5445-4536-86fe-03215faa98f3 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:21:40.813046 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-2c7edf7d-5445-4536-86fe-03215faa98f3 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:21:40.813498 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-2c7edf7d-5445-4536-86fe-03215faa98f3 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:21:40.814221 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-2c7edf7d-5445-4536-86fe-03215faa98f3 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:21:40.814694 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-2c7edf7d-5445-4536-86fe-03215faa98f3 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:21:40.815140 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-2c7edf7d-5445-4536-86fe-03215faa98f3 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:21:40.952159 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.policy [None req-2c7edf7d-5445-4536-86fe-03215faa98f3 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb28547f4b54c4097d2ffc3c533ca67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42af08ef367945939b1f59ffa8af351a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120798) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:21:40.961179 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.policy [None req-2c7edf7d-5445-4536-86fe-03215faa98f3 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4fb28547f4b54c4097d2ffc3c533ca67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42af08ef367945939b1f59ffa8af351a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120798) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:21:40.962668 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.policy [None req-2c7edf7d-5445-4536-86fe-03215faa98f3 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4fb28547f4b54c4097d2ffc3c533ca67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42af08ef367945939b1f59ffa8af351a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120798) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:21:40.963854 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [None req-2c7edf7d-5445-4536-86fe-03215faa98f3 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] 10.222.0.17 "GET /compute/v2.1/servers/971419a3-e367-44fc-b6b4-10543aa4ab52" status: 200 len: 1718 microversion: 2.20 time: 0.165056 Aug 23 07:21:40.964406 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 408/840] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Aug 23 07:21:40 2022] GET /compute/v2.1/servers/971419a3-e367-44fc-b6b4-10543aa4ab52 => generated 1718 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 07:21:41.999948 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-efb6d9bd-acc9-4a27-a59b-b1cedf61d7fd tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Calling method '>' {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:21:42.000918 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.compute.api [None req-efb6d9bd-acc9-4a27-a59b-b1cedf61d7fd tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] [instance: 971419a3-e367-44fc-b6b4-10543aa4ab52] Fetching instance by UUID {{(pid=120799) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:21:42.009674 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-efb6d9bd-acc9-4a27-a59b-b1cedf61d7fd tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:21:42.010155 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-efb6d9bd-acc9-4a27-a59b-b1cedf61d7fd tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:21:42.010581 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-efb6d9bd-acc9-4a27-a59b-b1cedf61d7fd tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:21:42.011258 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-efb6d9bd-acc9-4a27-a59b-b1cedf61d7fd tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:21:42.011748 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-efb6d9bd-acc9-4a27-a59b-b1cedf61d7fd tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:21:42.012177 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-efb6d9bd-acc9-4a27-a59b-b1cedf61d7fd tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:21:42.149055 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.policy [None req-efb6d9bd-acc9-4a27-a59b-b1cedf61d7fd tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb28547f4b54c4097d2ffc3c533ca67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42af08ef367945939b1f59ffa8af351a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120799) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:21:42.157891 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.policy [None req-efb6d9bd-acc9-4a27-a59b-b1cedf61d7fd tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4fb28547f4b54c4097d2ffc3c533ca67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42af08ef367945939b1f59ffa8af351a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120799) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:21:42.159471 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.policy [None req-efb6d9bd-acc9-4a27-a59b-b1cedf61d7fd tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4fb28547f4b54c4097d2ffc3c533ca67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42af08ef367945939b1f59ffa8af351a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120799) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:21:42.160779 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-efb6d9bd-acc9-4a27-a59b-b1cedf61d7fd tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] 10.222.0.17 "GET /compute/v2.1/servers/971419a3-e367-44fc-b6b4-10543aa4ab52" status: 200 len: 1721 microversion: 2.20 time: 0.167547 Aug 23 07:21:42.161351 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 433/841] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Aug 23 07:21:41 2022] GET /compute/v2.1/servers/971419a3-e367-44fc-b6b4-10543aa4ab52 => generated 1721 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 07:21:42.183040 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-819ccb00-7f96-4609-9127-6eea4f101273 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f32dff50-78f1-4753-b372-e3996ff376d0"}} {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 07:21:42.185424 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.compute.api [None req-819ccb00-7f96-4609-9127-6eea4f101273 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] [instance: 971419a3-e367-44fc-b6b4-10543aa4ab52] Fetching instance by UUID {{(pid=120798) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:21:42.193156 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-819ccb00-7f96-4609-9127-6eea4f101273 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:21:42.193666 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-819ccb00-7f96-4609-9127-6eea4f101273 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:21:42.194168 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-819ccb00-7f96-4609-9127-6eea4f101273 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:21:42.194853 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-819ccb00-7f96-4609-9127-6eea4f101273 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:21:42.195297 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-819ccb00-7f96-4609-9127-6eea4f101273 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:21:42.195742 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-819ccb00-7f96-4609-9127-6eea4f101273 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:21:42.478490 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [None req-819ccb00-7f96-4609-9127-6eea4f101273 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] 10.222.0.17 "POST /compute/v2.1/servers/971419a3-e367-44fc-b6b4-10543aa4ab52/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.299554 Aug 23 07:21:42.479147 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 409/842] 10.222.0.17 () {62 vars in 1364 bytes} [Tue Aug 23 07:21:42 2022] POST /compute/v2.1/servers/971419a3-e367-44fc-b6b4-10543aa4ab52/os-volume_attachments => generated 188 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 23 07:21:42.606675 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-7cf345b7-adca-402f-bd7d-15271e4e104f tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Calling method '>' {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:21:42.607158 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.compute.api [None req-7cf345b7-adca-402f-bd7d-15271e4e104f tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] [instance: 971419a3-e367-44fc-b6b4-10543aa4ab52] Fetching instance by UUID {{(pid=120799) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:21:42.613691 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-7cf345b7-adca-402f-bd7d-15271e4e104f tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:21:42.614167 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-7cf345b7-adca-402f-bd7d-15271e4e104f tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:21:42.614621 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-7cf345b7-adca-402f-bd7d-15271e4e104f tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:21:42.615633 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-7cf345b7-adca-402f-bd7d-15271e4e104f tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:21:42.616088 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-7cf345b7-adca-402f-bd7d-15271e4e104f tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:21:42.616507 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-7cf345b7-adca-402f-bd7d-15271e4e104f tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:21:42.877778 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-7cf345b7-adca-402f-bd7d-15271e4e104f tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] 10.222.0.17 "DELETE /compute/v2.1/servers/971419a3-e367-44fc-b6b4-10543aa4ab52/os-volume_attachments/f32dff50-78f1-4753-b372-e3996ff376d0" status: 202 len: 0 microversion: 2.20 time: 0.275076 Aug 23 07:21:42.878355 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 434/843] 10.222.0.17 () {60 vars in 1457 bytes} [Tue Aug 23 07:21:42 2022] DELETE /compute/v2.1/servers/971419a3-e367-44fc-b6b4-10543aa4ab52/os-volume_attachments/f32dff50-78f1-4753-b372-e3996ff376d0 => generated 0 bytes in 277 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 23 07:21:42.940650 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-2a5a5404-ea3b-4fa9-be50-0d378d50e99c tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 07:21:42.941494 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.compute.api [None req-2a5a5404-ea3b-4fa9-be50-0d378d50e99c tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] [instance: 971419a3-e367-44fc-b6b4-10543aa4ab52] Fetching instance by UUID {{(pid=120798) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:21:42.951116 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-2a5a5404-ea3b-4fa9-be50-0d378d50e99c tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:21:42.951819 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-2a5a5404-ea3b-4fa9-be50-0d378d50e99c tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:21:42.952378 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-2a5a5404-ea3b-4fa9-be50-0d378d50e99c tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:21:42.953405 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-2a5a5404-ea3b-4fa9-be50-0d378d50e99c tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:21:42.954040 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-2a5a5404-ea3b-4fa9-be50-0d378d50e99c tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:21:42.954575 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-2a5a5404-ea3b-4fa9-be50-0d378d50e99c tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:21:43.000702 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.compute.api [None req-2a5a5404-ea3b-4fa9-be50-0d378d50e99c tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] [instance: 971419a3-e367-44fc-b6b4-10543aa4ab52] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120798) unshelve /opt/stack/nova/nova/compute/api.py:4578}} Aug 23 07:21:43.072612 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [None req-2a5a5404-ea3b-4fa9-be50-0d378d50e99c tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] 10.222.0.17 "POST /compute/v2.1/servers/971419a3-e367-44fc-b6b4-10543aa4ab52/action" status: 202 len: 0 microversion: 2.20 time: 0.138148 Aug 23 07:21:43.073453 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 410/844] 10.222.0.17 () {62 vars in 1319 bytes} [Tue Aug 23 07:21:42 2022] POST /compute/v2.1/servers/971419a3-e367-44fc-b6b4-10543aa4ab52/action => generated 0 bytes in 140 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 23 07:21:43.082494 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-86af46cd-d25b-47b1-b884-ca79c6d5c0b2 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Calling method '>' {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:21:43.083071 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.compute.api [None req-86af46cd-d25b-47b1-b884-ca79c6d5c0b2 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] [instance: 971419a3-e367-44fc-b6b4-10543aa4ab52] Fetching instance by UUID {{(pid=120799) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:21:43.090677 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-86af46cd-d25b-47b1-b884-ca79c6d5c0b2 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:21:43.091162 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-86af46cd-d25b-47b1-b884-ca79c6d5c0b2 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:21:43.091965 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-86af46cd-d25b-47b1-b884-ca79c6d5c0b2 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:21:43.092701 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-86af46cd-d25b-47b1-b884-ca79c6d5c0b2 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:21:43.093202 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-86af46cd-d25b-47b1-b884-ca79c6d5c0b2 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:21:43.093645 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-86af46cd-d25b-47b1-b884-ca79c6d5c0b2 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:21:43.230879 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.policy [None req-86af46cd-d25b-47b1-b884-ca79c6d5c0b2 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb28547f4b54c4097d2ffc3c533ca67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42af08ef367945939b1f59ffa8af351a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120799) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:21:43.239142 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.policy [None req-86af46cd-d25b-47b1-b884-ca79c6d5c0b2 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4fb28547f4b54c4097d2ffc3c533ca67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42af08ef367945939b1f59ffa8af351a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120799) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:21:43.240713 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.policy [None req-86af46cd-d25b-47b1-b884-ca79c6d5c0b2 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4fb28547f4b54c4097d2ffc3c533ca67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42af08ef367945939b1f59ffa8af351a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120799) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:21:43.241860 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-86af46cd-d25b-47b1-b884-ca79c6d5c0b2 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] 10.222.0.17 "GET /compute/v2.1/servers/971419a3-e367-44fc-b6b4-10543aa4ab52" status: 200 len: 1669 microversion: 2.20 time: 0.163806 Aug 23 07:21:43.242414 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 435/845] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Aug 23 07:21:43 2022] GET /compute/v2.1/servers/971419a3-e367-44fc-b6b4-10543aa4ab52 => generated 1669 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 07:21:43.743964 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [req-0d93bc14-2e64-4c62-9b46-5725cc1c8b78 req-67883e46-c38c-4cd5-85ed-a4330e164eaa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "971419a3-e367-44fc-b6b4-10543aa4ab52", "name": "network-vif-unplugged", "status": "completed", "tag": "7a341a97-ef9f-44a7-99ba-2be318b77ee7"}]} {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 07:21:43.753527 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [req-0d93bc14-2e64-4c62-9b46-5725cc1c8b78 req-67883e46-c38c-4cd5-85ed-a4330e164eaa service nova] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:21:43.754019 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [req-0d93bc14-2e64-4c62-9b46-5725cc1c8b78 req-67883e46-c38c-4cd5-85ed-a4330e164eaa service nova] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:21:43.754456 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [req-0d93bc14-2e64-4c62-9b46-5725cc1c8b78 req-67883e46-c38c-4cd5-85ed-a4330e164eaa service nova] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:21:43.771586 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.compute.server_external_events [req-0d93bc14-2e64-4c62-9b46-5725cc1c8b78 req-67883e46-c38c-4cd5-85ed-a4330e164eaa service nova] Unable to find a host for instance 971419a3-e367-44fc-b6b4-10543aa4ab52. Dropping event network-vif-unplugged {{(pid=120798) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 23 07:21:43.772682 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [req-0d93bc14-2e64-4c62-9b46-5725cc1c8b78 req-67883e46-c38c-4cd5-85ed-a4330e164eaa service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.033366 Aug 23 07:21:43.773449 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 411/846] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Aug 23 07:21:43 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 35 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Aug 23 07:21:44.266292 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-e404e2d4-48b2-4d6f-b783-2c4c545ea400 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Calling method '>' {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:21:44.266938 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.compute.api [None req-e404e2d4-48b2-4d6f-b783-2c4c545ea400 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] [instance: 971419a3-e367-44fc-b6b4-10543aa4ab52] Fetching instance by UUID {{(pid=120799) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:21:44.273721 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-e404e2d4-48b2-4d6f-b783-2c4c545ea400 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:21:44.274201 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-e404e2d4-48b2-4d6f-b783-2c4c545ea400 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:21:44.274630 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-e404e2d4-48b2-4d6f-b783-2c4c545ea400 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:21:44.275391 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-e404e2d4-48b2-4d6f-b783-2c4c545ea400 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:21:44.276104 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-e404e2d4-48b2-4d6f-b783-2c4c545ea400 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:21:44.276508 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-e404e2d4-48b2-4d6f-b783-2c4c545ea400 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:21:44.411619 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.policy [None req-e404e2d4-48b2-4d6f-b783-2c4c545ea400 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb28547f4b54c4097d2ffc3c533ca67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42af08ef367945939b1f59ffa8af351a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120799) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:21:44.420022 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.policy [None req-e404e2d4-48b2-4d6f-b783-2c4c545ea400 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4fb28547f4b54c4097d2ffc3c533ca67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42af08ef367945939b1f59ffa8af351a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120799) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:21:44.421525 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.policy [None req-e404e2d4-48b2-4d6f-b783-2c4c545ea400 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4fb28547f4b54c4097d2ffc3c533ca67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42af08ef367945939b1f59ffa8af351a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120799) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:21:44.422694 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-e404e2d4-48b2-4d6f-b783-2c4c545ea400 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] 10.222.0.17 "GET /compute/v2.1/servers/971419a3-e367-44fc-b6b4-10543aa4ab52" status: 200 len: 1671 microversion: 2.20 time: 0.160555 Aug 23 07:21:44.423232 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 436/847] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Aug 23 07:21:44 2022] GET /compute/v2.1/servers/971419a3-e367-44fc-b6b4-10543aa4ab52 => generated 1671 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 07:21:45.446843 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-2a749701-a265-4fb7-ba39-49cacfa92c2b tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Calling method '>' {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:21:45.447480 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.compute.api [None req-2a749701-a265-4fb7-ba39-49cacfa92c2b tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] [instance: 971419a3-e367-44fc-b6b4-10543aa4ab52] Fetching instance by UUID {{(pid=120798) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:21:45.454752 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-2a749701-a265-4fb7-ba39-49cacfa92c2b tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:21:45.455233 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-2a749701-a265-4fb7-ba39-49cacfa92c2b tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:21:45.455699 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-2a749701-a265-4fb7-ba39-49cacfa92c2b tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:21:45.456398 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-2a749701-a265-4fb7-ba39-49cacfa92c2b tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:21:45.456836 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-2a749701-a265-4fb7-ba39-49cacfa92c2b tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:21:45.457249 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-2a749701-a265-4fb7-ba39-49cacfa92c2b tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:21:45.616848 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.policy [None req-2a749701-a265-4fb7-ba39-49cacfa92c2b tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb28547f4b54c4097d2ffc3c533ca67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42af08ef367945939b1f59ffa8af351a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120798) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:21:45.628729 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.policy [None req-2a749701-a265-4fb7-ba39-49cacfa92c2b tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4fb28547f4b54c4097d2ffc3c533ca67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42af08ef367945939b1f59ffa8af351a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120798) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:21:45.630864 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.policy [None req-2a749701-a265-4fb7-ba39-49cacfa92c2b tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4fb28547f4b54c4097d2ffc3c533ca67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42af08ef367945939b1f59ffa8af351a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120798) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:21:45.632660 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [None req-2a749701-a265-4fb7-ba39-49cacfa92c2b tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] 10.222.0.17 "GET /compute/v2.1/servers/971419a3-e367-44fc-b6b4-10543aa4ab52" status: 200 len: 1727 microversion: 2.20 time: 0.190308 Aug 23 07:21:45.648724 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 412/848] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Aug 23 07:21:45 2022] GET /compute/v2.1/servers/971419a3-e367-44fc-b6b4-10543aa4ab52 => generated 1727 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 07:21:46.660584 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-751c6146-0472-4e70-aa03-516d384e85d7 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Calling method '>' {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:21:46.661184 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.compute.api [None req-751c6146-0472-4e70-aa03-516d384e85d7 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] [instance: 971419a3-e367-44fc-b6b4-10543aa4ab52] Fetching instance by UUID {{(pid=120799) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:21:46.671969 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-751c6146-0472-4e70-aa03-516d384e85d7 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:21:46.672738 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-751c6146-0472-4e70-aa03-516d384e85d7 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:21:46.673424 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-751c6146-0472-4e70-aa03-516d384e85d7 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:21:46.674562 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-751c6146-0472-4e70-aa03-516d384e85d7 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:21:46.675282 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-751c6146-0472-4e70-aa03-516d384e85d7 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:21:46.676019 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-751c6146-0472-4e70-aa03-516d384e85d7 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:21:46.816367 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.policy [None req-751c6146-0472-4e70-aa03-516d384e85d7 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb28547f4b54c4097d2ffc3c533ca67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42af08ef367945939b1f59ffa8af351a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120799) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:21:46.824983 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.policy [None req-751c6146-0472-4e70-aa03-516d384e85d7 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4fb28547f4b54c4097d2ffc3c533ca67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42af08ef367945939b1f59ffa8af351a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120799) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:21:46.826472 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.policy [None req-751c6146-0472-4e70-aa03-516d384e85d7 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4fb28547f4b54c4097d2ffc3c533ca67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42af08ef367945939b1f59ffa8af351a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120799) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:21:46.827738 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-751c6146-0472-4e70-aa03-516d384e85d7 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] 10.222.0.17 "GET /compute/v2.1/servers/971419a3-e367-44fc-b6b4-10543aa4ab52" status: 200 len: 1727 microversion: 2.20 time: 0.171120 Aug 23 07:21:46.828297 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 437/849] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Aug 23 07:21:46 2022] GET /compute/v2.1/servers/971419a3-e367-44fc-b6b4-10543aa4ab52 => generated 1727 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 07:21:47.853180 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-132942da-7fc5-47f7-8127-f53862111035 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Calling method '>' {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:21:47.855084 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.compute.api [None req-132942da-7fc5-47f7-8127-f53862111035 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] [instance: 971419a3-e367-44fc-b6b4-10543aa4ab52] Fetching instance by UUID {{(pid=120798) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:21:47.862586 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-132942da-7fc5-47f7-8127-f53862111035 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:21:47.863072 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-132942da-7fc5-47f7-8127-f53862111035 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:21:47.863533 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-132942da-7fc5-47f7-8127-f53862111035 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:21:47.864266 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-132942da-7fc5-47f7-8127-f53862111035 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:21:47.864709 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-132942da-7fc5-47f7-8127-f53862111035 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:21:47.865159 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-132942da-7fc5-47f7-8127-f53862111035 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:21:48.022654 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.policy [None req-132942da-7fc5-47f7-8127-f53862111035 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb28547f4b54c4097d2ffc3c533ca67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42af08ef367945939b1f59ffa8af351a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120798) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:21:48.031404 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.policy [None req-132942da-7fc5-47f7-8127-f53862111035 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4fb28547f4b54c4097d2ffc3c533ca67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42af08ef367945939b1f59ffa8af351a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120798) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:21:48.033035 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.policy [None req-132942da-7fc5-47f7-8127-f53862111035 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4fb28547f4b54c4097d2ffc3c533ca67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42af08ef367945939b1f59ffa8af351a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120798) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:21:48.034472 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [None req-132942da-7fc5-47f7-8127-f53862111035 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] 10.222.0.17 "GET /compute/v2.1/servers/971419a3-e367-44fc-b6b4-10543aa4ab52" status: 200 len: 1727 microversion: 2.20 time: 0.185581 Aug 23 07:21:48.042475 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 413/850] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Aug 23 07:21:47 2022] GET /compute/v2.1/servers/971419a3-e367-44fc-b6b4-10543aa4ab52 => generated 1727 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 07:21:49.066850 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-1db08b94-384b-4788-9e41-8e0248c49642 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Calling method '>' {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:21:49.068075 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.compute.api [None req-1db08b94-384b-4788-9e41-8e0248c49642 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] [instance: 971419a3-e367-44fc-b6b4-10543aa4ab52] Fetching instance by UUID {{(pid=120799) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:21:49.075762 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-1db08b94-384b-4788-9e41-8e0248c49642 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:21:49.076186 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-1db08b94-384b-4788-9e41-8e0248c49642 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:21:49.076630 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-1db08b94-384b-4788-9e41-8e0248c49642 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:21:49.077589 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-1db08b94-384b-4788-9e41-8e0248c49642 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:21:49.078219 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-1db08b94-384b-4788-9e41-8e0248c49642 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:21:49.078642 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-1db08b94-384b-4788-9e41-8e0248c49642 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:21:49.237616 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.policy [None req-1db08b94-384b-4788-9e41-8e0248c49642 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb28547f4b54c4097d2ffc3c533ca67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42af08ef367945939b1f59ffa8af351a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120799) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:21:49.246295 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.policy [None req-1db08b94-384b-4788-9e41-8e0248c49642 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4fb28547f4b54c4097d2ffc3c533ca67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42af08ef367945939b1f59ffa8af351a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120799) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:21:49.247989 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.policy [None req-1db08b94-384b-4788-9e41-8e0248c49642 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4fb28547f4b54c4097d2ffc3c533ca67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42af08ef367945939b1f59ffa8af351a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120799) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:21:49.249161 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-1db08b94-384b-4788-9e41-8e0248c49642 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] 10.222.0.17 "GET /compute/v2.1/servers/971419a3-e367-44fc-b6b4-10543aa4ab52" status: 200 len: 1727 microversion: 2.20 time: 0.187531 Aug 23 07:21:49.249951 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 438/851] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Aug 23 07:21:49 2022] GET /compute/v2.1/servers/971419a3-e367-44fc-b6b4-10543aa4ab52 => generated 1727 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 07:21:50.272207 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-c2b5ad5f-c869-4b69-b6fb-2f12fbaf4fde tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Calling method '>' {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:21:50.273176 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.compute.api [None req-c2b5ad5f-c869-4b69-b6fb-2f12fbaf4fde tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] [instance: 971419a3-e367-44fc-b6b4-10543aa4ab52] Fetching instance by UUID {{(pid=120798) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:21:50.282311 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-c2b5ad5f-c869-4b69-b6fb-2f12fbaf4fde tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:21:50.282930 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-c2b5ad5f-c869-4b69-b6fb-2f12fbaf4fde tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:21:50.283463 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-c2b5ad5f-c869-4b69-b6fb-2f12fbaf4fde tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:21:50.284172 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-c2b5ad5f-c869-4b69-b6fb-2f12fbaf4fde tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:21:50.284634 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-c2b5ad5f-c869-4b69-b6fb-2f12fbaf4fde tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:21:50.285089 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-c2b5ad5f-c869-4b69-b6fb-2f12fbaf4fde tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:21:50.303343 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG dbcounter [-] [120798] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=120798) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:21:50.434156 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.policy [None req-c2b5ad5f-c869-4b69-b6fb-2f12fbaf4fde tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb28547f4b54c4097d2ffc3c533ca67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42af08ef367945939b1f59ffa8af351a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120798) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:21:50.443187 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.policy [None req-c2b5ad5f-c869-4b69-b6fb-2f12fbaf4fde tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4fb28547f4b54c4097d2ffc3c533ca67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42af08ef367945939b1f59ffa8af351a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120798) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:21:50.445183 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.policy [None req-c2b5ad5f-c869-4b69-b6fb-2f12fbaf4fde tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4fb28547f4b54c4097d2ffc3c533ca67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42af08ef367945939b1f59ffa8af351a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120798) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:21:50.446610 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [None req-c2b5ad5f-c869-4b69-b6fb-2f12fbaf4fde tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] 10.222.0.17 "GET /compute/v2.1/servers/971419a3-e367-44fc-b6b4-10543aa4ab52" status: 200 len: 1727 microversion: 2.20 time: 0.178481 Aug 23 07:21:50.447369 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 414/852] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Aug 23 07:21:50 2022] GET /compute/v2.1/servers/971419a3-e367-44fc-b6b4-10543aa4ab52 => generated 1727 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 07:21:51.471069 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-2991f8d8-ea04-4f3b-9120-2ea546fc4d91 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Calling method '>' {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:21:51.471810 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.compute.api [None req-2991f8d8-ea04-4f3b-9120-2ea546fc4d91 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] [instance: 971419a3-e367-44fc-b6b4-10543aa4ab52] Fetching instance by UUID {{(pid=120799) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:21:51.478731 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-2991f8d8-ea04-4f3b-9120-2ea546fc4d91 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:21:51.479224 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-2991f8d8-ea04-4f3b-9120-2ea546fc4d91 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:21:51.479684 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-2991f8d8-ea04-4f3b-9120-2ea546fc4d91 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:21:51.480386 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-2991f8d8-ea04-4f3b-9120-2ea546fc4d91 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:21:51.480835 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-2991f8d8-ea04-4f3b-9120-2ea546fc4d91 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:21:51.481222 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-2991f8d8-ea04-4f3b-9120-2ea546fc4d91 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:21:51.486902 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG dbcounter [-] [120799] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=120799) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:21:51.637369 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.policy [None req-2991f8d8-ea04-4f3b-9120-2ea546fc4d91 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb28547f4b54c4097d2ffc3c533ca67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42af08ef367945939b1f59ffa8af351a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120799) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:21:51.646318 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.policy [None req-2991f8d8-ea04-4f3b-9120-2ea546fc4d91 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4fb28547f4b54c4097d2ffc3c533ca67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42af08ef367945939b1f59ffa8af351a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120799) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:21:51.648377 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.policy [None req-2991f8d8-ea04-4f3b-9120-2ea546fc4d91 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4fb28547f4b54c4097d2ffc3c533ca67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42af08ef367945939b1f59ffa8af351a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120799) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:21:51.649567 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-2991f8d8-ea04-4f3b-9120-2ea546fc4d91 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] 10.222.0.17 "GET /compute/v2.1/servers/971419a3-e367-44fc-b6b4-10543aa4ab52" status: 200 len: 1727 microversion: 2.20 time: 0.182908 Aug 23 07:21:51.667331 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 439/853] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Aug 23 07:21:51 2022] GET /compute/v2.1/servers/971419a3-e367-44fc-b6b4-10543aa4ab52 => generated 1727 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 07:21:52.674927 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-747a3a21-9251-40fc-bf73-ee69e62cc727 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Calling method '>' {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:21:52.675888 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.compute.api [None req-747a3a21-9251-40fc-bf73-ee69e62cc727 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] [instance: 971419a3-e367-44fc-b6b4-10543aa4ab52] Fetching instance by UUID {{(pid=120798) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:21:52.683724 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-747a3a21-9251-40fc-bf73-ee69e62cc727 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:21:52.684315 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-747a3a21-9251-40fc-bf73-ee69e62cc727 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:21:52.687033 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-747a3a21-9251-40fc-bf73-ee69e62cc727 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:21:52.687879 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-747a3a21-9251-40fc-bf73-ee69e62cc727 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:21:52.688403 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-747a3a21-9251-40fc-bf73-ee69e62cc727 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:21:52.688901 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-747a3a21-9251-40fc-bf73-ee69e62cc727 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:21:52.828686 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.policy [None req-747a3a21-9251-40fc-bf73-ee69e62cc727 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb28547f4b54c4097d2ffc3c533ca67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42af08ef367945939b1f59ffa8af351a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120798) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:21:52.838034 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.policy [None req-747a3a21-9251-40fc-bf73-ee69e62cc727 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4fb28547f4b54c4097d2ffc3c533ca67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42af08ef367945939b1f59ffa8af351a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120798) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:21:52.839607 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.policy [None req-747a3a21-9251-40fc-bf73-ee69e62cc727 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4fb28547f4b54c4097d2ffc3c533ca67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42af08ef367945939b1f59ffa8af351a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120798) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:21:52.840799 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [None req-747a3a21-9251-40fc-bf73-ee69e62cc727 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] 10.222.0.17 "GET /compute/v2.1/servers/971419a3-e367-44fc-b6b4-10543aa4ab52" status: 200 len: 1727 microversion: 2.20 time: 0.170285 Aug 23 07:21:52.841356 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 415/854] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Aug 23 07:21:52 2022] GET /compute/v2.1/servers/971419a3-e367-44fc-b6b4-10543aa4ab52 => generated 1727 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 07:21:53.867852 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-d0a8ff08-94ae-42fd-bd0f-00c2689d6965 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Calling method '>' {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:21:53.868563 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.compute.api [None req-d0a8ff08-94ae-42fd-bd0f-00c2689d6965 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] [instance: 971419a3-e367-44fc-b6b4-10543aa4ab52] Fetching instance by UUID {{(pid=120799) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:21:53.877020 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-d0a8ff08-94ae-42fd-bd0f-00c2689d6965 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:21:53.877623 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-d0a8ff08-94ae-42fd-bd0f-00c2689d6965 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:21:53.878154 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-d0a8ff08-94ae-42fd-bd0f-00c2689d6965 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:21:53.879001 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-d0a8ff08-94ae-42fd-bd0f-00c2689d6965 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:21:53.879600 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-d0a8ff08-94ae-42fd-bd0f-00c2689d6965 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:21:53.880121 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-d0a8ff08-94ae-42fd-bd0f-00c2689d6965 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:21:54.036179 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.policy [None req-d0a8ff08-94ae-42fd-bd0f-00c2689d6965 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb28547f4b54c4097d2ffc3c533ca67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42af08ef367945939b1f59ffa8af351a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120799) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:21:54.044919 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.policy [None req-d0a8ff08-94ae-42fd-bd0f-00c2689d6965 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4fb28547f4b54c4097d2ffc3c533ca67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42af08ef367945939b1f59ffa8af351a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120799) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:21:54.046108 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.policy [None req-d0a8ff08-94ae-42fd-bd0f-00c2689d6965 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4fb28547f4b54c4097d2ffc3c533ca67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42af08ef367945939b1f59ffa8af351a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120799) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:21:54.047236 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-d0a8ff08-94ae-42fd-bd0f-00c2689d6965 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] 10.222.0.17 "GET /compute/v2.1/servers/971419a3-e367-44fc-b6b4-10543aa4ab52" status: 200 len: 1727 microversion: 2.20 time: 0.184880 Aug 23 07:21:54.047992 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 440/855] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Aug 23 07:21:53 2022] GET /compute/v2.1/servers/971419a3-e367-44fc-b6b4-10543aa4ab52 => generated 1727 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 07:21:55.071272 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-4ae8412e-0c62-4f20-bcdc-4b2fbb02b98a tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Calling method '>' {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:21:55.071901 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.compute.api [None req-4ae8412e-0c62-4f20-bcdc-4b2fbb02b98a tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] [instance: 971419a3-e367-44fc-b6b4-10543aa4ab52] Fetching instance by UUID {{(pid=120798) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:21:55.074281 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG dbcounter [-] [120798] Writing DB stats nova_api:SELECT=36,nova_api:UPDATE=1 {{(pid=120798) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:21:55.080413 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-4ae8412e-0c62-4f20-bcdc-4b2fbb02b98a tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:21:55.080908 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-4ae8412e-0c62-4f20-bcdc-4b2fbb02b98a tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:21:55.081348 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-4ae8412e-0c62-4f20-bcdc-4b2fbb02b98a tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:21:55.082059 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-4ae8412e-0c62-4f20-bcdc-4b2fbb02b98a tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:21:55.082522 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-4ae8412e-0c62-4f20-bcdc-4b2fbb02b98a tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:21:55.082956 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-4ae8412e-0c62-4f20-bcdc-4b2fbb02b98a tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:21:55.217820 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.policy [None req-4ae8412e-0c62-4f20-bcdc-4b2fbb02b98a tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb28547f4b54c4097d2ffc3c533ca67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42af08ef367945939b1f59ffa8af351a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120798) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:21:55.226629 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.policy [None req-4ae8412e-0c62-4f20-bcdc-4b2fbb02b98a tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4fb28547f4b54c4097d2ffc3c533ca67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42af08ef367945939b1f59ffa8af351a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120798) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:21:55.228225 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.policy [None req-4ae8412e-0c62-4f20-bcdc-4b2fbb02b98a tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4fb28547f4b54c4097d2ffc3c533ca67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42af08ef367945939b1f59ffa8af351a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120798) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:21:55.229404 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [None req-4ae8412e-0c62-4f20-bcdc-4b2fbb02b98a tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] 10.222.0.17 "GET /compute/v2.1/servers/971419a3-e367-44fc-b6b4-10543aa4ab52" status: 200 len: 1727 microversion: 2.20 time: 0.162597 Aug 23 07:21:55.229938 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 416/856] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Aug 23 07:21:55 2022] GET /compute/v2.1/servers/971419a3-e367-44fc-b6b4-10543aa4ab52 => generated 1727 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 07:21:56.253613 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-58508968-2977-4e70-9c8c-bb37c2967a3d tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Calling method '>' {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:21:56.253613 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.compute.api [None req-58508968-2977-4e70-9c8c-bb37c2967a3d tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] [instance: 971419a3-e367-44fc-b6b4-10543aa4ab52] Fetching instance by UUID {{(pid=120799) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:21:56.258719 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG dbcounter [-] [120799] Writing DB stats nova_api:SELECT=32 {{(pid=120799) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:21:56.264700 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-58508968-2977-4e70-9c8c-bb37c2967a3d tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:21:56.265115 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-58508968-2977-4e70-9c8c-bb37c2967a3d tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:21:56.265545 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-58508968-2977-4e70-9c8c-bb37c2967a3d tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:21:56.269176 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-58508968-2977-4e70-9c8c-bb37c2967a3d tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:21:56.269176 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-58508968-2977-4e70-9c8c-bb37c2967a3d tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:21:56.269176 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-58508968-2977-4e70-9c8c-bb37c2967a3d tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:21:56.398957 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.policy [None req-58508968-2977-4e70-9c8c-bb37c2967a3d tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb28547f4b54c4097d2ffc3c533ca67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42af08ef367945939b1f59ffa8af351a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120799) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:21:56.407824 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.policy [None req-58508968-2977-4e70-9c8c-bb37c2967a3d tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4fb28547f4b54c4097d2ffc3c533ca67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42af08ef367945939b1f59ffa8af351a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120799) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:21:56.409349 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.policy [None req-58508968-2977-4e70-9c8c-bb37c2967a3d tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4fb28547f4b54c4097d2ffc3c533ca67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42af08ef367945939b1f59ffa8af351a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120799) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:21:56.410493 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-58508968-2977-4e70-9c8c-bb37c2967a3d tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] 10.222.0.17 "GET /compute/v2.1/servers/971419a3-e367-44fc-b6b4-10543aa4ab52" status: 200 len: 1727 microversion: 2.20 time: 0.161772 Aug 23 07:21:56.411060 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 441/857] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Aug 23 07:21:56 2022] GET /compute/v2.1/servers/971419a3-e367-44fc-b6b4-10543aa4ab52 => generated 1727 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 07:21:57.445537 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-81bb91af-eb9d-4cc8-9adb-10c87475ed25 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Calling method '>' {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:21:57.446496 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.compute.api [None req-81bb91af-eb9d-4cc8-9adb-10c87475ed25 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] [instance: 971419a3-e367-44fc-b6b4-10543aa4ab52] Fetching instance by UUID {{(pid=120798) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:21:57.457547 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-81bb91af-eb9d-4cc8-9adb-10c87475ed25 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:21:57.458348 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-81bb91af-eb9d-4cc8-9adb-10c87475ed25 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:21:57.459069 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-81bb91af-eb9d-4cc8-9adb-10c87475ed25 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:21:57.460289 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-81bb91af-eb9d-4cc8-9adb-10c87475ed25 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:21:57.461029 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-81bb91af-eb9d-4cc8-9adb-10c87475ed25 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:21:57.461809 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-81bb91af-eb9d-4cc8-9adb-10c87475ed25 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:21:57.602805 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.policy [None req-81bb91af-eb9d-4cc8-9adb-10c87475ed25 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb28547f4b54c4097d2ffc3c533ca67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42af08ef367945939b1f59ffa8af351a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120798) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:21:57.612215 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.policy [None req-81bb91af-eb9d-4cc8-9adb-10c87475ed25 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4fb28547f4b54c4097d2ffc3c533ca67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42af08ef367945939b1f59ffa8af351a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120798) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:21:57.614345 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.policy [None req-81bb91af-eb9d-4cc8-9adb-10c87475ed25 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4fb28547f4b54c4097d2ffc3c533ca67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42af08ef367945939b1f59ffa8af351a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120798) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:21:57.615582 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [None req-81bb91af-eb9d-4cc8-9adb-10c87475ed25 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] 10.222.0.17 "GET /compute/v2.1/servers/971419a3-e367-44fc-b6b4-10543aa4ab52" status: 200 len: 1727 microversion: 2.20 time: 0.176572 Aug 23 07:21:57.616143 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 417/858] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Aug 23 07:21:57 2022] GET /compute/v2.1/servers/971419a3-e367-44fc-b6b4-10543aa4ab52 => generated 1727 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 07:21:57.753492 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [req-70bc3d0d-335f-4c76-a14e-05672971fa2b req-5a50a943-1832-4182-b463-727e4c56e82a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "971419a3-e367-44fc-b6b4-10543aa4ab52", "name": "network-vif-plugged", "status": "completed", "tag": "7a341a97-ef9f-44a7-99ba-2be318b77ee7"}]} {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 07:21:57.764046 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [req-70bc3d0d-335f-4c76-a14e-05672971fa2b req-5a50a943-1832-4182-b463-727e4c56e82a service nova] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:21:57.764548 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [req-70bc3d0d-335f-4c76-a14e-05672971fa2b req-5a50a943-1832-4182-b463-727e4c56e82a service nova] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:21:57.764957 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [req-70bc3d0d-335f-4c76-a14e-05672971fa2b req-5a50a943-1832-4182-b463-727e4c56e82a service nova] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:21:57.776534 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.compute.server_external_events [req-70bc3d0d-335f-4c76-a14e-05672971fa2b req-5a50a943-1832-4182-b463-727e4c56e82a service nova] Creating event network-vif-plugged:7a341a97-ef9f-44a7-99ba-2be318b77ee7 for instance 971419a3-e367-44fc-b6b4-10543aa4ab52 on hv-cinder-85409 Aug 23 07:21:57.781931 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [req-70bc3d0d-335f-4c76-a14e-05672971fa2b req-5a50a943-1832-4182-b463-727e4c56e82a service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032268 Aug 23 07:21:57.782600 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 442/859] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Aug 23 07:21:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 07:21:58.638939 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-8ab8dfd3-03b6-498a-8b60-32cf63edb0a2 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Calling method '>' {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:21:58.639616 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.compute.api [None req-8ab8dfd3-03b6-498a-8b60-32cf63edb0a2 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] [instance: 971419a3-e367-44fc-b6b4-10543aa4ab52] Fetching instance by UUID {{(pid=120798) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:21:58.646461 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-8ab8dfd3-03b6-498a-8b60-32cf63edb0a2 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:21:58.646945 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-8ab8dfd3-03b6-498a-8b60-32cf63edb0a2 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:21:58.647375 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-8ab8dfd3-03b6-498a-8b60-32cf63edb0a2 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:21:58.648131 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-8ab8dfd3-03b6-498a-8b60-32cf63edb0a2 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:21:58.648580 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-8ab8dfd3-03b6-498a-8b60-32cf63edb0a2 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:21:58.649004 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-8ab8dfd3-03b6-498a-8b60-32cf63edb0a2 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:21:58.783589 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.policy [None req-8ab8dfd3-03b6-498a-8b60-32cf63edb0a2 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb28547f4b54c4097d2ffc3c533ca67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42af08ef367945939b1f59ffa8af351a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120798) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:21:58.792869 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.policy [None req-8ab8dfd3-03b6-498a-8b60-32cf63edb0a2 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4fb28547f4b54c4097d2ffc3c533ca67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42af08ef367945939b1f59ffa8af351a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120798) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:21:58.794469 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.policy [None req-8ab8dfd3-03b6-498a-8b60-32cf63edb0a2 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4fb28547f4b54c4097d2ffc3c533ca67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42af08ef367945939b1f59ffa8af351a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120798) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:21:58.795685 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [None req-8ab8dfd3-03b6-498a-8b60-32cf63edb0a2 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] 10.222.0.17 "GET /compute/v2.1/servers/971419a3-e367-44fc-b6b4-10543aa4ab52" status: 200 len: 1727 microversion: 2.20 time: 0.160703 Aug 23 07:21:58.796234 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 418/860] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Aug 23 07:21:58 2022] GET /compute/v2.1/servers/971419a3-e367-44fc-b6b4-10543aa4ab52 => generated 1727 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 07:21:59.819362 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-47cb398e-a938-448c-92af-ea33ff535ab9 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Calling method '>' {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:21:59.820215 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.compute.api [None req-47cb398e-a938-448c-92af-ea33ff535ab9 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] [instance: 971419a3-e367-44fc-b6b4-10543aa4ab52] Fetching instance by UUID {{(pid=120799) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:21:59.826961 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-47cb398e-a938-448c-92af-ea33ff535ab9 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:21:59.827587 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-47cb398e-a938-448c-92af-ea33ff535ab9 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:21:59.828082 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-47cb398e-a938-448c-92af-ea33ff535ab9 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:21:59.828858 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-47cb398e-a938-448c-92af-ea33ff535ab9 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:21:59.829377 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-47cb398e-a938-448c-92af-ea33ff535ab9 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:21:59.829866 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-47cb398e-a938-448c-92af-ea33ff535ab9 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:21:59.970346 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.policy [None req-47cb398e-a938-448c-92af-ea33ff535ab9 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb28547f4b54c4097d2ffc3c533ca67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42af08ef367945939b1f59ffa8af351a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120799) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:21:59.979009 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.policy [None req-47cb398e-a938-448c-92af-ea33ff535ab9 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4fb28547f4b54c4097d2ffc3c533ca67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42af08ef367945939b1f59ffa8af351a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120799) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:21:59.980534 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.policy [None req-47cb398e-a938-448c-92af-ea33ff535ab9 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4fb28547f4b54c4097d2ffc3c533ca67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42af08ef367945939b1f59ffa8af351a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120799) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:21:59.981757 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-47cb398e-a938-448c-92af-ea33ff535ab9 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] 10.222.0.17 "GET /compute/v2.1/servers/971419a3-e367-44fc-b6b4-10543aa4ab52" status: 200 len: 1727 microversion: 2.20 time: 0.167397 Aug 23 07:21:59.982331 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 443/861] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Aug 23 07:21:59 2022] GET /compute/v2.1/servers/971419a3-e367-44fc-b6b4-10543aa4ab52 => generated 1727 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 07:22:01.008121 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-12d99c48-7102-4502-8257-241eaa677758 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Calling method '>' {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:22:01.008966 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.compute.api [None req-12d99c48-7102-4502-8257-241eaa677758 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] [instance: 971419a3-e367-44fc-b6b4-10543aa4ab52] Fetching instance by UUID {{(pid=120798) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:22:01.020233 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-12d99c48-7102-4502-8257-241eaa677758 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:22:01.021020 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-12d99c48-7102-4502-8257-241eaa677758 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:22:01.021748 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-12d99c48-7102-4502-8257-241eaa677758 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:22:01.022855 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-12d99c48-7102-4502-8257-241eaa677758 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:22:01.023660 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-12d99c48-7102-4502-8257-241eaa677758 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:22:01.024371 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-12d99c48-7102-4502-8257-241eaa677758 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:22:01.156643 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.policy [None req-12d99c48-7102-4502-8257-241eaa677758 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb28547f4b54c4097d2ffc3c533ca67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42af08ef367945939b1f59ffa8af351a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120798) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:22:01.164828 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.policy [None req-12d99c48-7102-4502-8257-241eaa677758 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4fb28547f4b54c4097d2ffc3c533ca67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42af08ef367945939b1f59ffa8af351a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120798) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:22:01.166537 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.policy [None req-12d99c48-7102-4502-8257-241eaa677758 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4fb28547f4b54c4097d2ffc3c533ca67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42af08ef367945939b1f59ffa8af351a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120798) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:22:01.167710 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [None req-12d99c48-7102-4502-8257-241eaa677758 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] 10.222.0.17 "GET /compute/v2.1/servers/971419a3-e367-44fc-b6b4-10543aa4ab52" status: 200 len: 1714 microversion: 2.20 time: 0.166266 Aug 23 07:22:01.168263 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 419/862] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Aug 23 07:22:00 2022] GET /compute/v2.1/servers/971419a3-e367-44fc-b6b4-10543aa4ab52 => generated 1714 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 07:22:20.696534 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 23 07:22:20.697006 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: Tue Aug 23 07:22:20 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 23 07:22:27.284045 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 23 07:22:27.285175 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: Tue Aug 23 07:22:27 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 23 07:22:32.197920 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-a1bf6a01-cce1-4b6e-b288-7ed256edca18 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Calling method '>' {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:22:32.200085 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.compute.api [None req-a1bf6a01-cce1-4b6e-b288-7ed256edca18 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] [instance: 971419a3-e367-44fc-b6b4-10543aa4ab52] Fetching instance by UUID {{(pid=120799) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:22:32.202362 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG dbcounter [-] [120799] Writing DB stats nova_api:SELECT=5 {{(pid=120799) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:22:32.203229 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG dbcounter [-] [120799] Writing DB stats nova_cell1:SELECT=24 {{(pid=120799) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:22:32.209954 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-a1bf6a01-cce1-4b6e-b288-7ed256edca18 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:22:32.210512 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-a1bf6a01-cce1-4b6e-b288-7ed256edca18 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:22:32.211092 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-a1bf6a01-cce1-4b6e-b288-7ed256edca18 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:22:32.211922 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-a1bf6a01-cce1-4b6e-b288-7ed256edca18 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:22:32.212471 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-a1bf6a01-cce1-4b6e-b288-7ed256edca18 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:22:32.212962 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-a1bf6a01-cce1-4b6e-b288-7ed256edca18 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:22:32.245727 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-a1bf6a01-cce1-4b6e-b288-7ed256edca18 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] 10.222.0.17 "GET /compute/v2.1/servers/971419a3-e367-44fc-b6b4-10543aa4ab52/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.051832 Aug 23 07:22:32.246286 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 444/863] 10.222.0.17 () {60 vars in 1343 bytes} [Tue Aug 23 07:22:32 2022] GET /compute/v2.1/servers/971419a3-e367-44fc-b6b4-10543aa4ab52/os-volume_attachments => generated 25 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:22:32.309841 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-d95bc1c5-2302-47ea-9a7f-d85874bc9385 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Calling method '>' {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:22:32.310412 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.compute.api [None req-d95bc1c5-2302-47ea-9a7f-d85874bc9385 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] [instance: 971419a3-e367-44fc-b6b4-10543aa4ab52] Fetching instance by UUID {{(pid=120798) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:22:32.312404 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG dbcounter [-] [120798] Writing DB stats nova_api:SELECT=7 {{(pid=120798) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:22:32.313061 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG dbcounter [-] [120798] Writing DB stats nova_cell1:SELECT=33 {{(pid=120798) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:22:32.319489 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-d95bc1c5-2302-47ea-9a7f-d85874bc9385 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:22:32.319978 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-d95bc1c5-2302-47ea-9a7f-d85874bc9385 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:22:32.320414 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-d95bc1c5-2302-47ea-9a7f-d85874bc9385 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:22:32.321119 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-d95bc1c5-2302-47ea-9a7f-d85874bc9385 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:22:32.321567 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-d95bc1c5-2302-47ea-9a7f-d85874bc9385 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:22:32.321989 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-d95bc1c5-2302-47ea-9a7f-d85874bc9385 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:22:32.347941 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.compute.api [None req-d95bc1c5-2302-47ea-9a7f-d85874bc9385 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] [instance: 971419a3-e367-44fc-b6b4-10543aa4ab52] Going to try to terminate instance {{(pid=120798) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 07:22:32.429999 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [None req-d95bc1c5-2302-47ea-9a7f-d85874bc9385 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] 10.222.0.17 "DELETE /compute/v2.1/servers/971419a3-e367-44fc-b6b4-10543aa4ab52" status: 204 len: 0 microversion: 2.20 time: 0.123412 Aug 23 07:22:32.430482 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 420/864] 10.222.0.17 () {60 vars in 1280 bytes} [Tue Aug 23 07:22:32 2022] DELETE /compute/v2.1/servers/971419a3-e367-44fc-b6b4-10543aa4ab52 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 23 07:22:32.442436 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-8d4db0dc-70fe-4a8c-969a-76aa35988bbd tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Calling method '>' {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:22:32.443151 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.compute.api [None req-8d4db0dc-70fe-4a8c-969a-76aa35988bbd tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] [instance: 971419a3-e367-44fc-b6b4-10543aa4ab52] Fetching instance by UUID {{(pid=120799) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:22:32.449347 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-8d4db0dc-70fe-4a8c-969a-76aa35988bbd tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:22:32.449796 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-8d4db0dc-70fe-4a8c-969a-76aa35988bbd tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:22:32.450243 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-8d4db0dc-70fe-4a8c-969a-76aa35988bbd tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:22:32.450921 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-8d4db0dc-70fe-4a8c-969a-76aa35988bbd tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:22:32.451332 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-8d4db0dc-70fe-4a8c-969a-76aa35988bbd tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:22:32.451769 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-8d4db0dc-70fe-4a8c-969a-76aa35988bbd tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:22:32.660212 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.policy [None req-8d4db0dc-70fe-4a8c-969a-76aa35988bbd tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb28547f4b54c4097d2ffc3c533ca67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42af08ef367945939b1f59ffa8af351a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120799) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:22:32.672459 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.policy [None req-8d4db0dc-70fe-4a8c-969a-76aa35988bbd tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4fb28547f4b54c4097d2ffc3c533ca67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42af08ef367945939b1f59ffa8af351a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120799) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:22:32.674763 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.policy [None req-8d4db0dc-70fe-4a8c-969a-76aa35988bbd tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4fb28547f4b54c4097d2ffc3c533ca67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42af08ef367945939b1f59ffa8af351a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120799) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:22:32.676183 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-8d4db0dc-70fe-4a8c-969a-76aa35988bbd tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] 10.222.0.17 "GET /compute/v2.1/servers/971419a3-e367-44fc-b6b4-10543aa4ab52" status: 200 len: 1720 microversion: 2.20 time: 0.239516 Aug 23 07:22:32.676772 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 445/865] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Aug 23 07:22:32 2022] GET /compute/v2.1/servers/971419a3-e367-44fc-b6b4-10543aa4ab52 => generated 1720 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 07:22:33.700851 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-7eb0588b-a273-4de0-9bd9-a59728b4c41d tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Calling method '>' {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:22:33.701625 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.compute.api [None req-7eb0588b-a273-4de0-9bd9-a59728b4c41d tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] [instance: 971419a3-e367-44fc-b6b4-10543aa4ab52] Fetching instance by UUID {{(pid=120798) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:22:33.708487 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-7eb0588b-a273-4de0-9bd9-a59728b4c41d tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:22:33.708967 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-7eb0588b-a273-4de0-9bd9-a59728b4c41d tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:22:33.709388 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-7eb0588b-a273-4de0-9bd9-a59728b4c41d tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:22:33.710076 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-7eb0588b-a273-4de0-9bd9-a59728b4c41d tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:22:33.710515 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-7eb0588b-a273-4de0-9bd9-a59728b4c41d tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:22:33.710925 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-7eb0588b-a273-4de0-9bd9-a59728b4c41d tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:22:33.905249 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.policy [None req-7eb0588b-a273-4de0-9bd9-a59728b4c41d tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb28547f4b54c4097d2ffc3c533ca67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42af08ef367945939b1f59ffa8af351a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120798) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:22:33.914169 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.policy [None req-7eb0588b-a273-4de0-9bd9-a59728b4c41d tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4fb28547f4b54c4097d2ffc3c533ca67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42af08ef367945939b1f59ffa8af351a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120798) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:22:33.915702 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.policy [None req-7eb0588b-a273-4de0-9bd9-a59728b4c41d tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4fb28547f4b54c4097d2ffc3c533ca67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42af08ef367945939b1f59ffa8af351a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120798) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:22:33.916865 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [None req-7eb0588b-a273-4de0-9bd9-a59728b4c41d tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] 10.222.0.17 "GET /compute/v2.1/servers/971419a3-e367-44fc-b6b4-10543aa4ab52" status: 200 len: 1720 microversion: 2.20 time: 0.220420 Aug 23 07:22:33.917433 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 421/866] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Aug 23 07:22:33 2022] GET /compute/v2.1/servers/971419a3-e367-44fc-b6b4-10543aa4ab52 => generated 1720 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 07:22:34.939963 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-2c34622d-86b9-4d7d-a837-c87865333ea2 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Calling method '>' {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:22:34.940629 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [req-c8f87d96-40f9-4586-b83f-bcbdf863248e req-b13b4b31-2a2e-45d5-bf0d-af6ff6d21362 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "971419a3-e367-44fc-b6b4-10543aa4ab52", "name": "network-vif-deleted", "tag": "7a341a97-ef9f-44a7-99ba-2be318b77ee7"}]} {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 07:22:34.940988 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.compute.api [None req-2c34622d-86b9-4d7d-a837-c87865333ea2 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] [instance: 971419a3-e367-44fc-b6b4-10543aa4ab52] Fetching instance by UUID {{(pid=120798) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:22:34.948285 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-2c34622d-86b9-4d7d-a837-c87865333ea2 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:22:34.948764 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-2c34622d-86b9-4d7d-a837-c87865333ea2 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:22:34.949175 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-2c34622d-86b9-4d7d-a837-c87865333ea2 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:22:34.949895 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-2c34622d-86b9-4d7d-a837-c87865333ea2 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:22:34.950324 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-2c34622d-86b9-4d7d-a837-c87865333ea2 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:22:34.950744 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-2c34622d-86b9-4d7d-a837-c87865333ea2 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:22:34.958799 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [req-c8f87d96-40f9-4586-b83f-bcbdf863248e req-b13b4b31-2a2e-45d5-bf0d-af6ff6d21362 service nova] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:22:34.959562 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [req-c8f87d96-40f9-4586-b83f-bcbdf863248e req-b13b4b31-2a2e-45d5-bf0d-af6ff6d21362 service nova] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:22:34.960860 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [req-c8f87d96-40f9-4586-b83f-bcbdf863248e req-b13b4b31-2a2e-45d5-bf0d-af6ff6d21362 service nova] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:22:34.977251 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.compute.server_external_events [req-c8f87d96-40f9-4586-b83f-bcbdf863248e req-b13b4b31-2a2e-45d5-bf0d-af6ff6d21362 service nova] Creating event network-vif-deleted:7a341a97-ef9f-44a7-99ba-2be318b77ee7 for instance 971419a3-e367-44fc-b6b4-10543aa4ab52 on hv-cinder-85409 Aug 23 07:22:34.982881 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [req-c8f87d96-40f9-4586-b83f-bcbdf863248e req-b13b4b31-2a2e-45d5-bf0d-af6ff6d21362 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046205 Aug 23 07:22:34.983888 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 446/867] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Aug 23 07:22:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 07:22:35.035565 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.policy [None req-2c34622d-86b9-4d7d-a837-c87865333ea2 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb28547f4b54c4097d2ffc3c533ca67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42af08ef367945939b1f59ffa8af351a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120798) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:22:35.045598 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.policy [None req-2c34622d-86b9-4d7d-a837-c87865333ea2 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4fb28547f4b54c4097d2ffc3c533ca67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42af08ef367945939b1f59ffa8af351a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120798) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:22:35.048143 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.policy [None req-2c34622d-86b9-4d7d-a837-c87865333ea2 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4fb28547f4b54c4097d2ffc3c533ca67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42af08ef367945939b1f59ffa8af351a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120798) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:22:35.050392 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [None req-2c34622d-86b9-4d7d-a837-c87865333ea2 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] 10.222.0.17 "GET /compute/v2.1/servers/971419a3-e367-44fc-b6b4-10543aa4ab52" status: 200 len: 1653 microversion: 2.20 time: 0.114303 Aug 23 07:22:35.051277 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 422/868] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Aug 23 07:22:34 2022] GET /compute/v2.1/servers/971419a3-e367-44fc-b6b4-10543aa4ab52 => generated 1653 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 07:22:36.075287 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-a2ad961b-e4ef-420b-9dd8-2162cae7afd7 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Calling method '>' {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:22:36.075997 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.compute.api [None req-a2ad961b-e4ef-420b-9dd8-2162cae7afd7 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] [instance: 971419a3-e367-44fc-b6b4-10543aa4ab52] Fetching instance by UUID {{(pid=120799) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:22:36.082391 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-a2ad961b-e4ef-420b-9dd8-2162cae7afd7 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:22:36.082867 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-a2ad961b-e4ef-420b-9dd8-2162cae7afd7 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:22:36.083382 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-a2ad961b-e4ef-420b-9dd8-2162cae7afd7 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:22:36.084290 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-a2ad961b-e4ef-420b-9dd8-2162cae7afd7 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:22:36.084731 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-a2ad961b-e4ef-420b-9dd8-2162cae7afd7 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:22:36.085154 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-a2ad961b-e4ef-420b-9dd8-2162cae7afd7 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:22:36.098707 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.wsgi [None req-a2ad961b-e4ef-420b-9dd8-2162cae7afd7 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] HTTP exception thrown: Instance 971419a3-e367-44fc-b6b4-10543aa4ab52 could not be found. Aug 23 07:22:36.100502 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-a2ad961b-e4ef-420b-9dd8-2162cae7afd7 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Request method failure captured: Aug 23 07:22:36.100502 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: request: GET /compute/v2.1/servers/971419a3-e367-44fc-b6b4-10543aa4ab52 HTTP/1.1 Aug 23 07:22:36.100502 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: Accept: application/json Aug 23 07:22:36.100502 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: Accept-Encoding: identity Aug 23 07:22:36.100502 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: Connection: close Aug 23 07:22:36.100502 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: Content-Length: 0 Aug 23 07:22:36.100502 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: Content-Type: application/json Aug 23 07:22:36.100502 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: Host: 10.222.0.17 Aug 23 07:22:36.100502 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: Openstack-System-Scope: None Aug 23 07:22:36.100502 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: User-Agent: python-urllib3/1.26.11 Aug 23 07:22:36.100502 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-Auth-Token: gAAAAABjBH8gf3UChNGPZW_cNDeh-tJLHXLBVzvbBrPSKl-a3HClyt6XlUlyHLtHAEXAIOzYSWxN98rtyIGbmdYmXwgDPpTb73aRo6P-4660YglmDugOz6hR7meQeL1MIMDJnrgZDrTKBX-0PDg6-4h8UUfzoD8XAUx2khQb9L88BQ5JdAEEvSU Aug 23 07:22:36.100502 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-Domain-Id: None Aug 23 07:22:36.100502 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-Domain-Name: None Aug 23 07:22:36.100502 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-Identity-Status: Confirmed Aug 23 07:22:36.100502 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-Is-Admin-Project: True Aug 23 07:22:36.100502 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-Openstack-Nova-Api-Version: 2.20 Aug 23 07:22:36.100502 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-Project-Domain-Id: default Aug 23 07:22:36.100502 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-Project-Domain-Name: Default Aug 23 07:22:36.100502 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-Project-Id: 42af08ef367945939b1f59ffa8af351a Aug 23 07:22:36.100502 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-564110610 Aug 23 07:22:36.100502 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-Role: reader,member Aug 23 07:22:36.100502 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-Roles: reader,member Aug 23 07:22:36.102312 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/42af08ef367945939b1f59ffa8af351a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/42af08ef367945939b1f59ffa8af351a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_42af08ef367945939b1f59ffa8af351a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/42af08ef367945939b1f59ffa8af351a"}]}] Aug 23 07:22:36.102312 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-Tenant: tempest-AttachVolumeShelveTestJSON-564110610 Aug 23 07:22:36.102312 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-Tenant-Id: 42af08ef367945939b1f59ffa8af351a Aug 23 07:22:36.102312 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-564110610 Aug 23 07:22:36.102312 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-User: tempest-AttachVolumeShelveTestJSON-564110610-project Aug 23 07:22:36.102312 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-User-Domain-Id: default Aug 23 07:22:36.102312 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-User-Domain-Name: Default Aug 23 07:22:36.102312 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-User-Id: 4fb28547f4b54c4097d2ffc3c533ca67 Aug 23 07:22:36.102312 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-User-Name: tempest-AttachVolumeShelveTestJSON-564110610-project Aug 23 07:22:36.102312 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: method: > Aug 23 07:22:36.102312 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: exception: Instance 971419a3-e367-44fc-b6b4-10543aa4ab52 could not be found. Aug 23 07:22:36.102312 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: action_args: {'id': '971419a3-e367-44fc-b6b4-10543aa4ab52'} Aug 23 07:22:36.103177 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 07:22:36.103177 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 07:22:36.103177 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 07:22:36.103177 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 07:22:36.103177 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 07:22:36.103177 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 07:22:36.103177 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 07:22:36.103177 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 07:22:36.103177 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 07:22:36.103177 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 07:22:36.103177 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 971419a3-e367-44fc-b6b4-10543aa4ab52 could not be found. Aug 23 07:22:36.103177 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi Aug 23 07:22:36.103177 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 07:22:36.103177 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi Aug 23 07:22:36.103177 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 07:22:36.103177 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 07:22:36.103177 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 07:22:36.103177 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 07:22:36.103177 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 07:22:36.103177 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 07:22:36.104736 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 07:22:36.104736 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 07:22:36.104736 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 07:22:36.104736 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 07:22:36.104736 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 07:22:36.104736 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 07:22:36.104736 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 07:22:36.104736 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 971419a3-e367-44fc-b6b4-10543aa4ab52 could not be found. Aug 23 07:22:36.104736 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi Aug 23 07:22:36.104736 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 07:22:36.104736 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi Aug 23 07:22:36.104736 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 07:22:36.104736 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 07:22:36.104736 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 07:22:36.104736 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 07:22:36.104736 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 07:22:36.104736 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 971419a3-e367-44fc-b6b4-10543aa4ab52 could not be found. Aug 23 07:22:36.104736 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi Aug 23 07:22:36.106065 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-a2ad961b-e4ef-420b-9dd8-2162cae7afd7 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Returning 404 to user: Instance 971419a3-e367-44fc-b6b4-10543aa4ab52 could not be found. {{(pid=120799) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 07:22:36.106065 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-a2ad961b-e4ef-420b-9dd8-2162cae7afd7 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] 10.222.0.17 "GET /compute/v2.1/servers/971419a3-e367-44fc-b6b4-10543aa4ab52" status: 404 len: 111 microversion: 2.20 time: 0.031461 Aug 23 07:22:36.106065 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 447/869] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Aug 23 07:22:36 2022] GET /compute/v2.1/servers/971419a3-e367-44fc-b6b4-10543aa4ab52 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 23 07:22:36.110684 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-0e9e193a-16b9-4181-9c20-efec76667532 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Calling method '.version_select at 0x7fe3c55abb80>' {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:22:36.115580 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR oslo.messaging._drivers.impl_rabbit [None req-0e9e193a-16b9-4181-9c20-efec76667532 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] [c2fe6ff2-6b14-4bc8-880a-00bc497a0a34] AMQP server on 10.222.0.17:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 23 07:22:37.128156 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO oslo.messaging._drivers.impl_rabbit [None req-0e9e193a-16b9-4181-9c20-efec76667532 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] [c2fe6ff2-6b14-4bc8-880a-00bc497a0a34] Reconnected to AMQP server on 10.222.0.17:5672 via [amqp] client with port 56278. Aug 23 07:22:37.157676 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [None req-0e9e193a-16b9-4181-9c20-efec76667532 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-85048611" status: 204 len: 0 microversion: 2.20 time: 1.050813 Aug 23 07:22:37.158272 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 423/870] 10.222.0.17 () {60 vars in 1256 bytes} [Tue Aug 23 07:22:36 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-85048611 => generated 0 bytes in 1052 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 23 07:22:39.234056 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-b7063398-a3cb-45c0-960e-a9b7e0a84d0e tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Calling method '>' {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:22:39.234649 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.compute.api [None req-b7063398-a3cb-45c0-960e-a9b7e0a84d0e tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] [instance: 971419a3-e367-44fc-b6b4-10543aa4ab52] Fetching instance by UUID {{(pid=120799) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:22:39.243576 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-b7063398-a3cb-45c0-960e-a9b7e0a84d0e tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:22:39.244054 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-b7063398-a3cb-45c0-960e-a9b7e0a84d0e tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:22:39.244483 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-b7063398-a3cb-45c0-960e-a9b7e0a84d0e tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:22:39.245176 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-b7063398-a3cb-45c0-960e-a9b7e0a84d0e tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:22:39.245601 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-b7063398-a3cb-45c0-960e-a9b7e0a84d0e tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:22:39.246019 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-b7063398-a3cb-45c0-960e-a9b7e0a84d0e tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:22:39.260248 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.wsgi [None req-b7063398-a3cb-45c0-960e-a9b7e0a84d0e tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] HTTP exception thrown: Instance 971419a3-e367-44fc-b6b4-10543aa4ab52 could not be found. Aug 23 07:22:39.261833 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-b7063398-a3cb-45c0-960e-a9b7e0a84d0e tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Request method failure captured: Aug 23 07:22:39.261833 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: request: DELETE /compute/v2.1/servers/971419a3-e367-44fc-b6b4-10543aa4ab52 HTTP/1.1 Aug 23 07:22:39.261833 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: Accept: application/json Aug 23 07:22:39.261833 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: Accept-Encoding: identity Aug 23 07:22:39.261833 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: Connection: close Aug 23 07:22:39.261833 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: Content-Length: 0 Aug 23 07:22:39.261833 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: Content-Type: application/json Aug 23 07:22:39.261833 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: Host: 10.222.0.17 Aug 23 07:22:39.261833 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: Openstack-System-Scope: None Aug 23 07:22:39.261833 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: User-Agent: python-urllib3/1.26.11 Aug 23 07:22:39.261833 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-Auth-Token: gAAAAABjBH8gf3UChNGPZW_cNDeh-tJLHXLBVzvbBrPSKl-a3HClyt6XlUlyHLtHAEXAIOzYSWxN98rtyIGbmdYmXwgDPpTb73aRo6P-4660YglmDugOz6hR7meQeL1MIMDJnrgZDrTKBX-0PDg6-4h8UUfzoD8XAUx2khQb9L88BQ5JdAEEvSU Aug 23 07:22:39.261833 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-Domain-Id: None Aug 23 07:22:39.261833 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-Domain-Name: None Aug 23 07:22:39.261833 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-Identity-Status: Confirmed Aug 23 07:22:39.261833 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-Is-Admin-Project: True Aug 23 07:22:39.261833 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-Openstack-Nova-Api-Version: 2.20 Aug 23 07:22:39.261833 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-Project-Domain-Id: default Aug 23 07:22:39.261833 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-Project-Domain-Name: Default Aug 23 07:22:39.261833 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-Project-Id: 42af08ef367945939b1f59ffa8af351a Aug 23 07:22:39.261833 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-564110610 Aug 23 07:22:39.261833 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-Role: reader,member Aug 23 07:22:39.261833 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-Roles: reader,member Aug 23 07:22:39.263301 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/42af08ef367945939b1f59ffa8af351a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/42af08ef367945939b1f59ffa8af351a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_42af08ef367945939b1f59ffa8af351a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/42af08ef367945939b1f59ffa8af351a"}]}] Aug 23 07:22:39.263301 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-Tenant: tempest-AttachVolumeShelveTestJSON-564110610 Aug 23 07:22:39.263301 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-Tenant-Id: 42af08ef367945939b1f59ffa8af351a Aug 23 07:22:39.263301 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-564110610 Aug 23 07:22:39.263301 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-User: tempest-AttachVolumeShelveTestJSON-564110610-project Aug 23 07:22:39.263301 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-User-Domain-Id: default Aug 23 07:22:39.263301 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-User-Domain-Name: Default Aug 23 07:22:39.263301 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-User-Id: 4fb28547f4b54c4097d2ffc3c533ca67 Aug 23 07:22:39.263301 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-User-Name: tempest-AttachVolumeShelveTestJSON-564110610-project Aug 23 07:22:39.263301 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: method: > Aug 23 07:22:39.263301 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: exception: Instance 971419a3-e367-44fc-b6b4-10543aa4ab52 could not be found. Aug 23 07:22:39.263301 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: action_args: {'id': '971419a3-e367-44fc-b6b4-10543aa4ab52'} Aug 23 07:22:39.264084 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 07:22:39.264084 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 07:22:39.264084 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 07:22:39.264084 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 07:22:39.264084 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 07:22:39.264084 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 07:22:39.264084 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 07:22:39.264084 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 07:22:39.264084 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 07:22:39.264084 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 07:22:39.264084 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 971419a3-e367-44fc-b6b4-10543aa4ab52 could not be found. Aug 23 07:22:39.264084 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi Aug 23 07:22:39.264084 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 07:22:39.264084 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi Aug 23 07:22:39.264084 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 07:22:39.264084 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 07:22:39.264084 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 07:22:39.264084 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 07:22:39.264084 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 07:22:39.264084 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 07:22:39.265639 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 07:22:39.265639 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 23 07:22:39.265639 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 23 07:22:39.265639 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 23 07:22:39.265639 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 23 07:22:39.265639 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 07:22:39.265639 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 07:22:39.265639 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 07:22:39.265639 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 07:22:39.265639 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 971419a3-e367-44fc-b6b4-10543aa4ab52 could not be found. Aug 23 07:22:39.265639 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi Aug 23 07:22:39.265639 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 07:22:39.265639 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi Aug 23 07:22:39.265639 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 07:22:39.265639 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 07:22:39.265639 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 07:22:39.265639 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 07:22:39.265639 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 07:22:39.265639 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 971419a3-e367-44fc-b6b4-10543aa4ab52 could not be found. Aug 23 07:22:39.265639 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi Aug 23 07:22:39.267239 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-b7063398-a3cb-45c0-960e-a9b7e0a84d0e tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Returning 404 to user: Instance 971419a3-e367-44fc-b6b4-10543aa4ab52 could not be found. {{(pid=120799) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 07:22:39.267239 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-b7063398-a3cb-45c0-960e-a9b7e0a84d0e tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] 10.222.0.17 "DELETE /compute/v2.1/servers/971419a3-e367-44fc-b6b4-10543aa4ab52" status: 404 len: 111 microversion: 2.20 time: 0.035358 Aug 23 07:22:39.267239 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 448/871] 10.222.0.17 () {60 vars in 1280 bytes} [Tue Aug 23 07:22:39 2022] DELETE /compute/v2.1/servers/971419a3-e367-44fc-b6b4-10543aa4ab52 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 23 07:22:39.272906 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-c8c3352b-fcfd-4696-a70f-010fbb8f9da3 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Calling method '>' {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:22:39.273575 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.compute.api [None req-c8c3352b-fcfd-4696-a70f-010fbb8f9da3 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] [instance: 971419a3-e367-44fc-b6b4-10543aa4ab52] Fetching instance by UUID {{(pid=120798) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:22:39.279975 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-c8c3352b-fcfd-4696-a70f-010fbb8f9da3 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:22:39.280464 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-c8c3352b-fcfd-4696-a70f-010fbb8f9da3 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:22:39.280903 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-c8c3352b-fcfd-4696-a70f-010fbb8f9da3 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:22:39.281588 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-c8c3352b-fcfd-4696-a70f-010fbb8f9da3 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:22:39.282038 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-c8c3352b-fcfd-4696-a70f-010fbb8f9da3 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:22:39.282458 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-c8c3352b-fcfd-4696-a70f-010fbb8f9da3 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:22:39.296260 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.wsgi [None req-c8c3352b-fcfd-4696-a70f-010fbb8f9da3 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] HTTP exception thrown: Instance 971419a3-e367-44fc-b6b4-10543aa4ab52 could not be found. Aug 23 07:22:39.297937 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-c8c3352b-fcfd-4696-a70f-010fbb8f9da3 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Request method failure captured: Aug 23 07:22:39.297937 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: request: GET /compute/v2.1/servers/971419a3-e367-44fc-b6b4-10543aa4ab52 HTTP/1.1 Aug 23 07:22:39.297937 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: Accept: application/json Aug 23 07:22:39.297937 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: Accept-Encoding: identity Aug 23 07:22:39.297937 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: Connection: close Aug 23 07:22:39.297937 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: Content-Length: 0 Aug 23 07:22:39.297937 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: Content-Type: application/json Aug 23 07:22:39.297937 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: Host: 10.222.0.17 Aug 23 07:22:39.297937 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: Openstack-System-Scope: None Aug 23 07:22:39.297937 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: User-Agent: python-urllib3/1.26.11 Aug 23 07:22:39.297937 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-Auth-Token: gAAAAABjBH8gf3UChNGPZW_cNDeh-tJLHXLBVzvbBrPSKl-a3HClyt6XlUlyHLtHAEXAIOzYSWxN98rtyIGbmdYmXwgDPpTb73aRo6P-4660YglmDugOz6hR7meQeL1MIMDJnrgZDrTKBX-0PDg6-4h8UUfzoD8XAUx2khQb9L88BQ5JdAEEvSU Aug 23 07:22:39.297937 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-Domain-Id: None Aug 23 07:22:39.297937 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-Domain-Name: None Aug 23 07:22:39.297937 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-Identity-Status: Confirmed Aug 23 07:22:39.297937 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-Is-Admin-Project: True Aug 23 07:22:39.297937 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-Openstack-Nova-Api-Version: 2.20 Aug 23 07:22:39.297937 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-Project-Domain-Id: default Aug 23 07:22:39.297937 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-Project-Domain-Name: Default Aug 23 07:22:39.297937 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-Project-Id: 42af08ef367945939b1f59ffa8af351a Aug 23 07:22:39.297937 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-564110610 Aug 23 07:22:39.297937 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-Role: reader,member Aug 23 07:22:39.297937 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-Roles: reader,member Aug 23 07:22:39.299468 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/42af08ef367945939b1f59ffa8af351a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/42af08ef367945939b1f59ffa8af351a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_42af08ef367945939b1f59ffa8af351a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/42af08ef367945939b1f59ffa8af351a"}]}] Aug 23 07:22:39.299468 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-Tenant: tempest-AttachVolumeShelveTestJSON-564110610 Aug 23 07:22:39.299468 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-Tenant-Id: 42af08ef367945939b1f59ffa8af351a Aug 23 07:22:39.299468 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-564110610 Aug 23 07:22:39.299468 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-User: tempest-AttachVolumeShelveTestJSON-564110610-project Aug 23 07:22:39.299468 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-User-Domain-Id: default Aug 23 07:22:39.299468 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-User-Domain-Name: Default Aug 23 07:22:39.299468 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-User-Id: 4fb28547f4b54c4097d2ffc3c533ca67 Aug 23 07:22:39.299468 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-User-Name: tempest-AttachVolumeShelveTestJSON-564110610-project Aug 23 07:22:39.299468 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: method: > Aug 23 07:22:39.299468 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: exception: Instance 971419a3-e367-44fc-b6b4-10543aa4ab52 could not be found. Aug 23 07:22:39.299468 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: action_args: {'id': '971419a3-e367-44fc-b6b4-10543aa4ab52'} Aug 23 07:22:39.300411 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 07:22:39.300411 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 07:22:39.300411 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 07:22:39.300411 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 07:22:39.300411 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 07:22:39.300411 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 07:22:39.300411 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 07:22:39.300411 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 07:22:39.300411 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 07:22:39.300411 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 07:22:39.300411 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 971419a3-e367-44fc-b6b4-10543aa4ab52 could not be found. Aug 23 07:22:39.300411 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi Aug 23 07:22:39.300411 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 07:22:39.300411 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi Aug 23 07:22:39.300411 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 07:22:39.300411 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 07:22:39.300411 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 07:22:39.300411 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 07:22:39.300411 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 07:22:39.300411 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 07:22:39.301716 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 07:22:39.301716 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 07:22:39.301716 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 07:22:39.301716 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 07:22:39.301716 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 07:22:39.301716 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 07:22:39.301716 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 07:22:39.301716 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 971419a3-e367-44fc-b6b4-10543aa4ab52 could not be found. Aug 23 07:22:39.301716 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi Aug 23 07:22:39.301716 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 07:22:39.301716 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi Aug 23 07:22:39.301716 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 07:22:39.301716 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 07:22:39.301716 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 07:22:39.301716 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 07:22:39.301716 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 07:22:39.301716 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 971419a3-e367-44fc-b6b4-10543aa4ab52 could not be found. Aug 23 07:22:39.301716 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi Aug 23 07:22:39.303065 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-c8c3352b-fcfd-4696-a70f-010fbb8f9da3 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Returning 404 to user: Instance 971419a3-e367-44fc-b6b4-10543aa4ab52 could not be found. {{(pid=120798) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 07:22:39.303065 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [None req-c8c3352b-fcfd-4696-a70f-010fbb8f9da3 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] 10.222.0.17 "GET /compute/v2.1/servers/971419a3-e367-44fc-b6b4-10543aa4ab52" status: 404 len: 111 microversion: 2.20 time: 0.031022 Aug 23 07:22:39.303065 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 424/872] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Aug 23 07:22:39 2022] GET /compute/v2.1/servers/971419a3-e367-44fc-b6b4-10543aa4ab52 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 23 07:22:40.463985 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-d51566e1-3b32-4ccd-85af-af0be6fcd752 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Calling method '>' {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:22:40.464515 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.compute.api [None req-d51566e1-3b32-4ccd-85af-af0be6fcd752 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] [instance: d1a4fd6e-9323-416e-b844-5e526565774e] Fetching instance by UUID {{(pid=120799) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:22:40.471717 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-d51566e1-3b32-4ccd-85af-af0be6fcd752 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:22:40.472195 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-d51566e1-3b32-4ccd-85af-af0be6fcd752 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:22:40.472627 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-d51566e1-3b32-4ccd-85af-af0be6fcd752 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:22:40.473308 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-d51566e1-3b32-4ccd-85af-af0be6fcd752 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:22:40.473759 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-d51566e1-3b32-4ccd-85af-af0be6fcd752 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:22:40.474177 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-d51566e1-3b32-4ccd-85af-af0be6fcd752 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:22:40.487970 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.wsgi [None req-d51566e1-3b32-4ccd-85af-af0be6fcd752 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] HTTP exception thrown: Instance d1a4fd6e-9323-416e-b844-5e526565774e could not be found. Aug 23 07:22:40.489520 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-d51566e1-3b32-4ccd-85af-af0be6fcd752 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Request method failure captured: Aug 23 07:22:40.489520 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: request: DELETE /compute/v2.1/servers/d1a4fd6e-9323-416e-b844-5e526565774e HTTP/1.1 Aug 23 07:22:40.489520 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: Accept: application/json Aug 23 07:22:40.489520 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: Accept-Encoding: identity Aug 23 07:22:40.489520 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: Connection: close Aug 23 07:22:40.489520 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: Content-Length: 0 Aug 23 07:22:40.489520 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: Content-Type: application/json Aug 23 07:22:40.489520 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: Host: 10.222.0.17 Aug 23 07:22:40.489520 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: Openstack-System-Scope: None Aug 23 07:22:40.489520 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: User-Agent: python-urllib3/1.26.11 Aug 23 07:22:40.489520 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-Auth-Token: gAAAAABjBH8gf3UChNGPZW_cNDeh-tJLHXLBVzvbBrPSKl-a3HClyt6XlUlyHLtHAEXAIOzYSWxN98rtyIGbmdYmXwgDPpTb73aRo6P-4660YglmDugOz6hR7meQeL1MIMDJnrgZDrTKBX-0PDg6-4h8UUfzoD8XAUx2khQb9L88BQ5JdAEEvSU Aug 23 07:22:40.489520 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-Domain-Id: None Aug 23 07:22:40.489520 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-Domain-Name: None Aug 23 07:22:40.489520 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-Identity-Status: Confirmed Aug 23 07:22:40.489520 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-Is-Admin-Project: True Aug 23 07:22:40.489520 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-Openstack-Nova-Api-Version: 2.20 Aug 23 07:22:40.489520 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-Project-Domain-Id: default Aug 23 07:22:40.489520 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-Project-Domain-Name: Default Aug 23 07:22:40.489520 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-Project-Id: 42af08ef367945939b1f59ffa8af351a Aug 23 07:22:40.489520 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-564110610 Aug 23 07:22:40.489520 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-Role: reader,member Aug 23 07:22:40.489520 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-Roles: reader,member Aug 23 07:22:40.491187 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/42af08ef367945939b1f59ffa8af351a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/42af08ef367945939b1f59ffa8af351a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_42af08ef367945939b1f59ffa8af351a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/42af08ef367945939b1f59ffa8af351a"}]}] Aug 23 07:22:40.491187 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-Tenant: tempest-AttachVolumeShelveTestJSON-564110610 Aug 23 07:22:40.491187 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-Tenant-Id: 42af08ef367945939b1f59ffa8af351a Aug 23 07:22:40.491187 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-564110610 Aug 23 07:22:40.491187 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-User: tempest-AttachVolumeShelveTestJSON-564110610-project Aug 23 07:22:40.491187 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-User-Domain-Id: default Aug 23 07:22:40.491187 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-User-Domain-Name: Default Aug 23 07:22:40.491187 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-User-Id: 4fb28547f4b54c4097d2ffc3c533ca67 Aug 23 07:22:40.491187 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-User-Name: tempest-AttachVolumeShelveTestJSON-564110610-project Aug 23 07:22:40.491187 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: method: > Aug 23 07:22:40.491187 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: exception: Instance d1a4fd6e-9323-416e-b844-5e526565774e could not be found. Aug 23 07:22:40.491187 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: action_args: {'id': 'd1a4fd6e-9323-416e-b844-5e526565774e'} Aug 23 07:22:40.492257 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 07:22:40.492257 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 07:22:40.492257 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 07:22:40.492257 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 07:22:40.492257 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 07:22:40.492257 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 07:22:40.492257 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 07:22:40.492257 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 07:22:40.492257 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 07:22:40.492257 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 07:22:40.492257 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d1a4fd6e-9323-416e-b844-5e526565774e could not be found. Aug 23 07:22:40.492257 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi Aug 23 07:22:40.492257 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 07:22:40.492257 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi Aug 23 07:22:40.492257 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 07:22:40.492257 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 07:22:40.492257 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 07:22:40.492257 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 07:22:40.492257 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 07:22:40.492257 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 07:22:40.493683 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 07:22:40.493683 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 23 07:22:40.493683 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 23 07:22:40.493683 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 23 07:22:40.493683 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 23 07:22:40.493683 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 07:22:40.493683 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 07:22:40.493683 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 07:22:40.493683 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 07:22:40.493683 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d1a4fd6e-9323-416e-b844-5e526565774e could not be found. Aug 23 07:22:40.493683 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi Aug 23 07:22:40.493683 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 07:22:40.493683 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi Aug 23 07:22:40.493683 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 07:22:40.493683 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 07:22:40.493683 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 07:22:40.493683 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 07:22:40.493683 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 07:22:40.493683 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d1a4fd6e-9323-416e-b844-5e526565774e could not be found. Aug 23 07:22:40.493683 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi Aug 23 07:22:40.495611 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-d51566e1-3b32-4ccd-85af-af0be6fcd752 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Returning 404 to user: Instance d1a4fd6e-9323-416e-b844-5e526565774e could not be found. {{(pid=120799) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 07:22:40.495611 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-d51566e1-3b32-4ccd-85af-af0be6fcd752 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] 10.222.0.17 "DELETE /compute/v2.1/servers/d1a4fd6e-9323-416e-b844-5e526565774e" status: 404 len: 111 microversion: 2.20 time: 0.030835 Aug 23 07:22:40.495611 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 449/873] 10.222.0.17 () {60 vars in 1280 bytes} [Tue Aug 23 07:22:40 2022] DELETE /compute/v2.1/servers/d1a4fd6e-9323-416e-b844-5e526565774e => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 23 07:22:40.501609 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-f1bf0894-452c-4c9e-8d31-4a711af9d6b8 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Calling method '>' {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:22:40.502257 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.compute.api [None req-f1bf0894-452c-4c9e-8d31-4a711af9d6b8 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] [instance: d1a4fd6e-9323-416e-b844-5e526565774e] Fetching instance by UUID {{(pid=120798) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:22:40.514164 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-f1bf0894-452c-4c9e-8d31-4a711af9d6b8 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:22:40.514933 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-f1bf0894-452c-4c9e-8d31-4a711af9d6b8 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:22:40.515692 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-f1bf0894-452c-4c9e-8d31-4a711af9d6b8 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:22:40.516808 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-f1bf0894-452c-4c9e-8d31-4a711af9d6b8 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:22:40.517476 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-f1bf0894-452c-4c9e-8d31-4a711af9d6b8 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:22:40.518124 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-f1bf0894-452c-4c9e-8d31-4a711af9d6b8 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:22:40.539204 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.wsgi [None req-f1bf0894-452c-4c9e-8d31-4a711af9d6b8 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] HTTP exception thrown: Instance d1a4fd6e-9323-416e-b844-5e526565774e could not be found. Aug 23 07:22:40.543741 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-f1bf0894-452c-4c9e-8d31-4a711af9d6b8 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Request method failure captured: Aug 23 07:22:40.543741 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: request: GET /compute/v2.1/servers/d1a4fd6e-9323-416e-b844-5e526565774e HTTP/1.1 Aug 23 07:22:40.543741 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: Accept: application/json Aug 23 07:22:40.543741 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: Accept-Encoding: identity Aug 23 07:22:40.543741 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: Connection: close Aug 23 07:22:40.543741 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: Content-Length: 0 Aug 23 07:22:40.543741 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: Content-Type: application/json Aug 23 07:22:40.543741 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: Host: 10.222.0.17 Aug 23 07:22:40.543741 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: Openstack-System-Scope: None Aug 23 07:22:40.543741 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: User-Agent: python-urllib3/1.26.11 Aug 23 07:22:40.543741 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-Auth-Token: gAAAAABjBH8gf3UChNGPZW_cNDeh-tJLHXLBVzvbBrPSKl-a3HClyt6XlUlyHLtHAEXAIOzYSWxN98rtyIGbmdYmXwgDPpTb73aRo6P-4660YglmDugOz6hR7meQeL1MIMDJnrgZDrTKBX-0PDg6-4h8UUfzoD8XAUx2khQb9L88BQ5JdAEEvSU Aug 23 07:22:40.543741 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-Domain-Id: None Aug 23 07:22:40.543741 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-Domain-Name: None Aug 23 07:22:40.543741 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-Identity-Status: Confirmed Aug 23 07:22:40.543741 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-Is-Admin-Project: True Aug 23 07:22:40.543741 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-Openstack-Nova-Api-Version: 2.20 Aug 23 07:22:40.543741 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-Project-Domain-Id: default Aug 23 07:22:40.543741 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-Project-Domain-Name: Default Aug 23 07:22:40.543741 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-Project-Id: 42af08ef367945939b1f59ffa8af351a Aug 23 07:22:40.543741 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-564110610 Aug 23 07:22:40.543741 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-Role: reader,member Aug 23 07:22:40.543741 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-Roles: reader,member Aug 23 07:22:40.545340 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/42af08ef367945939b1f59ffa8af351a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/42af08ef367945939b1f59ffa8af351a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_42af08ef367945939b1f59ffa8af351a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/42af08ef367945939b1f59ffa8af351a"}]}] Aug 23 07:22:40.545340 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-Tenant: tempest-AttachVolumeShelveTestJSON-564110610 Aug 23 07:22:40.545340 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-Tenant-Id: 42af08ef367945939b1f59ffa8af351a Aug 23 07:22:40.545340 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-564110610 Aug 23 07:22:40.545340 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-User: tempest-AttachVolumeShelveTestJSON-564110610-project Aug 23 07:22:40.545340 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-User-Domain-Id: default Aug 23 07:22:40.545340 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-User-Domain-Name: Default Aug 23 07:22:40.545340 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-User-Id: 4fb28547f4b54c4097d2ffc3c533ca67 Aug 23 07:22:40.545340 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-User-Name: tempest-AttachVolumeShelveTestJSON-564110610-project Aug 23 07:22:40.545340 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: method: > Aug 23 07:22:40.545340 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: exception: Instance d1a4fd6e-9323-416e-b844-5e526565774e could not be found. Aug 23 07:22:40.545340 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: action_args: {'id': 'd1a4fd6e-9323-416e-b844-5e526565774e'} Aug 23 07:22:40.546324 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 07:22:40.546324 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 07:22:40.546324 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 07:22:40.546324 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 07:22:40.546324 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 07:22:40.546324 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 07:22:40.546324 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 07:22:40.546324 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 07:22:40.546324 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 07:22:40.546324 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 07:22:40.546324 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d1a4fd6e-9323-416e-b844-5e526565774e could not be found. Aug 23 07:22:40.546324 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi Aug 23 07:22:40.546324 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 07:22:40.546324 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi Aug 23 07:22:40.546324 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 07:22:40.546324 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 07:22:40.546324 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 07:22:40.546324 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 07:22:40.546324 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 07:22:40.546324 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 07:22:40.548424 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 07:22:40.548424 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 07:22:40.548424 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 07:22:40.548424 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 07:22:40.548424 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 07:22:40.548424 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 07:22:40.548424 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 07:22:40.548424 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d1a4fd6e-9323-416e-b844-5e526565774e could not be found. Aug 23 07:22:40.548424 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi Aug 23 07:22:40.548424 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 07:22:40.548424 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi Aug 23 07:22:40.548424 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 07:22:40.548424 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 07:22:40.548424 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 07:22:40.548424 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 07:22:40.548424 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 07:22:40.548424 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d1a4fd6e-9323-416e-b844-5e526565774e could not be found. Aug 23 07:22:40.548424 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi Aug 23 07:22:40.550313 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-f1bf0894-452c-4c9e-8d31-4a711af9d6b8 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] Returning 404 to user: Instance d1a4fd6e-9323-416e-b844-5e526565774e could not be found. {{(pid=120798) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 07:22:40.550313 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [None req-f1bf0894-452c-4c9e-8d31-4a711af9d6b8 tempest-AttachVolumeShelveTestJSON-564110610 tempest-AttachVolumeShelveTestJSON-564110610-project] 10.222.0.17 "GET /compute/v2.1/servers/d1a4fd6e-9323-416e-b844-5e526565774e" status: 404 len: 111 microversion: 2.20 time: 0.049486 Aug 23 07:22:40.550313 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 425/874] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Aug 23 07:22:40 2022] GET /compute/v2.1/servers/d1a4fd6e-9323-416e-b844-5e526565774e => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 23 07:22:42.951553 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-65878c28-2cec-4855-b26a-d53007ecf00d tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Calling method '>' {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:22:42.952088 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.compute.api [None req-65878c28-2cec-4855-b26a-d53007ecf00d tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] [instance: d364cacb-afc7-4499-ab81-7e15d47f0b40] Fetching instance by UUID {{(pid=120799) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:22:42.963516 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-65878c28-2cec-4855-b26a-d53007ecf00d tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:22:42.964344 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-65878c28-2cec-4855-b26a-d53007ecf00d tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:22:42.965048 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-65878c28-2cec-4855-b26a-d53007ecf00d tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:22:42.966248 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-65878c28-2cec-4855-b26a-d53007ecf00d tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:22:42.966838 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-65878c28-2cec-4855-b26a-d53007ecf00d tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:22:42.967135 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-65878c28-2cec-4855-b26a-d53007ecf00d tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:22:42.995031 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.compute.api [None req-65878c28-2cec-4855-b26a-d53007ecf00d tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] [instance: d364cacb-afc7-4499-ab81-7e15d47f0b40] Going to try to terminate instance {{(pid=120799) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 07:22:43.029948 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [req-df2218e0-4fa3-4457-b783-1d704206d551 req-8b873bea-90dc-44d9-bfb0-0fc3ac4ce9a4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d364cacb-afc7-4499-ab81-7e15d47f0b40", "tag": "58b621ad-94f4-4882-b5ed-7393dd3d6b95"}]} {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 07:22:43.040787 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [req-df2218e0-4fa3-4457-b783-1d704206d551 req-8b873bea-90dc-44d9-bfb0-0fc3ac4ce9a4 service nova] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:22:43.041794 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [req-df2218e0-4fa3-4457-b783-1d704206d551 req-8b873bea-90dc-44d9-bfb0-0fc3ac4ce9a4 service nova] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:22:43.042426 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [req-df2218e0-4fa3-4457-b783-1d704206d551 req-8b873bea-90dc-44d9-bfb0-0fc3ac4ce9a4 service nova] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:22:43.053701 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.compute.server_external_events [req-df2218e0-4fa3-4457-b783-1d704206d551 req-8b873bea-90dc-44d9-bfb0-0fc3ac4ce9a4 service nova] Creating event network-changed:58b621ad-94f4-4882-b5ed-7393dd3d6b95 for instance d364cacb-afc7-4499-ab81-7e15d47f0b40 on hv-cinder-85409 Aug 23 07:22:43.060413 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [req-df2218e0-4fa3-4457-b783-1d704206d551 req-8b873bea-90dc-44d9-bfb0-0fc3ac4ce9a4 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.100671 Aug 23 07:22:43.061316 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 426/875] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Aug 23 07:22:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 07:22:43.104733 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-65878c28-2cec-4855-b26a-d53007ecf00d tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] 10.222.0.17 "DELETE /compute/v2.1/servers/d364cacb-afc7-4499-ab81-7e15d47f0b40" status: 204 len: 0 microversion: 2.1 time: 0.160321 Aug 23 07:22:43.105583 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 450/876] 10.222.0.17 () {58 vars in 1239 bytes} [Tue Aug 23 07:22:42 2022] DELETE /compute/v2.1/servers/d364cacb-afc7-4499-ab81-7e15d47f0b40 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 23 07:22:43.115490 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-4c5d4b7e-c48a-491e-a3c6-2e1aee1c9cba tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Calling method '>' {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:22:43.116199 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.compute.api [None req-4c5d4b7e-c48a-491e-a3c6-2e1aee1c9cba tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] [instance: d364cacb-afc7-4499-ab81-7e15d47f0b40] Fetching instance by UUID {{(pid=120798) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:22:43.124362 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-4c5d4b7e-c48a-491e-a3c6-2e1aee1c9cba tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:22:43.125023 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-4c5d4b7e-c48a-491e-a3c6-2e1aee1c9cba tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:22:43.125563 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-4c5d4b7e-c48a-491e-a3c6-2e1aee1c9cba tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:22:43.126280 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-4c5d4b7e-c48a-491e-a3c6-2e1aee1c9cba tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:22:43.126735 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-4c5d4b7e-c48a-491e-a3c6-2e1aee1c9cba tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:22:43.127163 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-4c5d4b7e-c48a-491e-a3c6-2e1aee1c9cba tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:22:43.333067 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.policy [None req-4c5d4b7e-c48a-491e-a3c6-2e1aee1c9cba tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffd12f09606b4e6ba12f63b976df1884', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43b271d00f74eb7aa3d0719315c5a99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120798) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:22:43.343373 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [None req-4c5d4b7e-c48a-491e-a3c6-2e1aee1c9cba tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] 10.222.0.17 "GET /compute/v2.1/servers/d364cacb-afc7-4499-ab81-7e15d47f0b40" status: 200 len: 1578 microversion: 2.1 time: 0.232325 Aug 23 07:22:43.344414 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 427/877] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:22:43 2022] GET /compute/v2.1/servers/d364cacb-afc7-4499-ab81-7e15d47f0b40 => generated 1578 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:22:44.367748 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-7a3d7475-6ffa-4031-8ac2-5582940a79de tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Calling method '>' {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:22:44.368434 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.compute.api [None req-7a3d7475-6ffa-4031-8ac2-5582940a79de tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] [instance: d364cacb-afc7-4499-ab81-7e15d47f0b40] Fetching instance by UUID {{(pid=120799) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:22:44.374853 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-7a3d7475-6ffa-4031-8ac2-5582940a79de tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:22:44.375320 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-7a3d7475-6ffa-4031-8ac2-5582940a79de tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:22:44.375774 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-7a3d7475-6ffa-4031-8ac2-5582940a79de tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:22:44.376662 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-7a3d7475-6ffa-4031-8ac2-5582940a79de tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:22:44.377103 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-7a3d7475-6ffa-4031-8ac2-5582940a79de tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:22:44.377520 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-7a3d7475-6ffa-4031-8ac2-5582940a79de tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:22:44.513791 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.policy [None req-7a3d7475-6ffa-4031-8ac2-5582940a79de tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffd12f09606b4e6ba12f63b976df1884', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43b271d00f74eb7aa3d0719315c5a99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120799) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:22:44.521604 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-7a3d7475-6ffa-4031-8ac2-5582940a79de tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] 10.222.0.17 "GET /compute/v2.1/servers/d364cacb-afc7-4499-ab81-7e15d47f0b40" status: 200 len: 1578 microversion: 2.1 time: 0.158095 Aug 23 07:22:44.522164 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 451/878] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:22:44 2022] GET /compute/v2.1/servers/d364cacb-afc7-4499-ab81-7e15d47f0b40 => generated 1578 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:22:45.071320 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [req-2e9f643e-9f35-4d8d-b51f-28da4bb97800 req-48b8eb00-08df-4a86-9031-80d1a5a4b2bd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d364cacb-afc7-4499-ab81-7e15d47f0b40", "name": "network-vif-deleted", "tag": "58b621ad-94f4-4882-b5ed-7393dd3d6b95"}]} {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 07:22:45.082487 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [req-2e9f643e-9f35-4d8d-b51f-28da4bb97800 req-48b8eb00-08df-4a86-9031-80d1a5a4b2bd service nova] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:22:45.083187 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [req-2e9f643e-9f35-4d8d-b51f-28da4bb97800 req-48b8eb00-08df-4a86-9031-80d1a5a4b2bd service nova] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:22:45.083784 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [req-2e9f643e-9f35-4d8d-b51f-28da4bb97800 req-48b8eb00-08df-4a86-9031-80d1a5a4b2bd service nova] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:22:45.096302 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.compute.server_external_events [req-2e9f643e-9f35-4d8d-b51f-28da4bb97800 req-48b8eb00-08df-4a86-9031-80d1a5a4b2bd service nova] Creating event network-vif-deleted:58b621ad-94f4-4882-b5ed-7393dd3d6b95 for instance d364cacb-afc7-4499-ab81-7e15d47f0b40 on hv-cinder-85409 Aug 23 07:22:45.101510 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [req-2e9f643e-9f35-4d8d-b51f-28da4bb97800 req-48b8eb00-08df-4a86-9031-80d1a5a4b2bd service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035195 Aug 23 07:22:45.102361 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 428/879] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Aug 23 07:22:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 07:22:45.543378 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-23e9d1e6-f017-457b-84ae-3acf4b9d7187 tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Calling method '>' {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:22:45.544161 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.compute.api [None req-23e9d1e6-f017-457b-84ae-3acf4b9d7187 tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] [instance: d364cacb-afc7-4499-ab81-7e15d47f0b40] Fetching instance by UUID {{(pid=120799) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:22:45.551008 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-23e9d1e6-f017-457b-84ae-3acf4b9d7187 tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:22:45.551616 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-23e9d1e6-f017-457b-84ae-3acf4b9d7187 tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:22:45.552105 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-23e9d1e6-f017-457b-84ae-3acf4b9d7187 tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:22:45.552883 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-23e9d1e6-f017-457b-84ae-3acf4b9d7187 tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:22:45.553387 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-23e9d1e6-f017-457b-84ae-3acf4b9d7187 tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:22:45.553860 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-23e9d1e6-f017-457b-84ae-3acf4b9d7187 tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:22:45.587145 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-23e9d1e6-f017-457b-84ae-3acf4b9d7187 tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:22:45.587600 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-23e9d1e6-f017-457b-84ae-3acf4b9d7187 tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:22:45.588271 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-23e9d1e6-f017-457b-84ae-3acf4b9d7187 tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:22:45.588716 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.objects.instance [None req-23e9d1e6-f017-457b-84ae-3acf4b9d7187 tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Lazy-loading 'fault' on Instance uuid d364cacb-afc7-4499-ab81-7e15d47f0b40 {{(pid=120799) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 07:22:45.634278 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.policy [None req-23e9d1e6-f017-457b-84ae-3acf4b9d7187 tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffd12f09606b4e6ba12f63b976df1884', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43b271d00f74eb7aa3d0719315c5a99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120799) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:22:45.645073 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-23e9d1e6-f017-457b-84ae-3acf4b9d7187 tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] 10.222.0.17 "GET /compute/v2.1/servers/d364cacb-afc7-4499-ab81-7e15d47f0b40" status: 200 len: 1231 microversion: 2.1 time: 0.106582 Aug 23 07:22:45.645924 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 452/880] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:22:45 2022] GET /compute/v2.1/servers/d364cacb-afc7-4499-ab81-7e15d47f0b40 => generated 1231 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 07:22:46.669884 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-4aa63daf-9ee1-4783-ae4e-dfd4219f56fe tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Calling method '>' {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:22:46.670455 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.compute.api [None req-4aa63daf-9ee1-4783-ae4e-dfd4219f56fe tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] [instance: d364cacb-afc7-4499-ab81-7e15d47f0b40] Fetching instance by UUID {{(pid=120798) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:22:46.678258 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-4aa63daf-9ee1-4783-ae4e-dfd4219f56fe tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:22:46.678905 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-4aa63daf-9ee1-4783-ae4e-dfd4219f56fe tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:22:46.679133 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-4aa63daf-9ee1-4783-ae4e-dfd4219f56fe tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:22:46.680040 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-4aa63daf-9ee1-4783-ae4e-dfd4219f56fe tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:22:46.680485 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-4aa63daf-9ee1-4783-ae4e-dfd4219f56fe tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:22:46.680900 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-4aa63daf-9ee1-4783-ae4e-dfd4219f56fe tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:22:46.701551 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.wsgi [None req-4aa63daf-9ee1-4783-ae4e-dfd4219f56fe tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] HTTP exception thrown: Instance d364cacb-afc7-4499-ab81-7e15d47f0b40 could not be found. Aug 23 07:22:46.703211 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-4aa63daf-9ee1-4783-ae4e-dfd4219f56fe tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Request method failure captured: Aug 23 07:22:46.703211 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: request: GET /compute/v2.1/servers/d364cacb-afc7-4499-ab81-7e15d47f0b40 HTTP/1.1 Aug 23 07:22:46.703211 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: Accept: application/json Aug 23 07:22:46.703211 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: Accept-Encoding: identity Aug 23 07:22:46.703211 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: Connection: close Aug 23 07:22:46.703211 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: Content-Length: 0 Aug 23 07:22:46.703211 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: Content-Type: application/json Aug 23 07:22:46.703211 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: Host: 10.222.0.17 Aug 23 07:22:46.703211 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: Openstack-System-Scope: None Aug 23 07:22:46.703211 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: User-Agent: python-urllib3/1.26.11 Aug 23 07:22:46.703211 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-Auth-Token: gAAAAABjBH6P-jieul6AKjLkQNxUQwwgT2fi8Bci5j8MffQf2AuPopMIy52WWi9L58wzK15-su-lWN-ZQ9-gsTbwBITO3GTIew5NLlk5lc5ISYP5453RzZuvVuMnc-3ttHjqotPkrTBqzUxKdCeedTYXi_LdjHTI3SusmhIkqFZ-BB_c7Wz6nIY Aug 23 07:22:46.703211 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-Domain-Id: None Aug 23 07:22:46.703211 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-Domain-Name: None Aug 23 07:22:46.703211 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-Identity-Status: Confirmed Aug 23 07:22:46.703211 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-Is-Admin-Project: True Aug 23 07:22:46.703211 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-Project-Domain-Id: default Aug 23 07:22:46.703211 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-Project-Domain-Name: Default Aug 23 07:22:46.703211 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-Project-Id: f43b271d00f74eb7aa3d0719315c5a99 Aug 23 07:22:46.703211 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-Project-Name: tempest-TestVolumeBootPattern-1818187997 Aug 23 07:22:46.703211 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-Role: reader,member Aug 23 07:22:46.703211 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-Roles: reader,member Aug 23 07:22:46.704867 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/f43b271d00f74eb7aa3d0719315c5a99"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/f43b271d00f74eb7aa3d0719315c5a99"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_f43b271d00f74eb7aa3d0719315c5a99"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/f43b271d00f74eb7aa3d0719315c5a99"}]}] Aug 23 07:22:46.704867 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-Tenant: tempest-TestVolumeBootPattern-1818187997 Aug 23 07:22:46.704867 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-Tenant-Id: f43b271d00f74eb7aa3d0719315c5a99 Aug 23 07:22:46.704867 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-Tenant-Name: tempest-TestVolumeBootPattern-1818187997 Aug 23 07:22:46.704867 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-User: tempest-TestVolumeBootPattern-1818187997-project Aug 23 07:22:46.704867 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-User-Domain-Id: default Aug 23 07:22:46.704867 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-User-Domain-Name: Default Aug 23 07:22:46.704867 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-User-Id: ffd12f09606b4e6ba12f63b976df1884 Aug 23 07:22:46.704867 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-User-Name: tempest-TestVolumeBootPattern-1818187997-project Aug 23 07:22:46.704867 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: method: > Aug 23 07:22:46.704867 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: exception: Instance d364cacb-afc7-4499-ab81-7e15d47f0b40 could not be found. Aug 23 07:22:46.704867 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: action_args: {'id': 'd364cacb-afc7-4499-ab81-7e15d47f0b40'} Aug 23 07:22:46.705775 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 07:22:46.705775 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 07:22:46.705775 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 07:22:46.705775 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 07:22:46.705775 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 07:22:46.705775 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 07:22:46.705775 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 07:22:46.705775 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 07:22:46.705775 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 07:22:46.705775 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 07:22:46.705775 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d364cacb-afc7-4499-ab81-7e15d47f0b40 could not be found. Aug 23 07:22:46.705775 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi Aug 23 07:22:46.705775 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 07:22:46.705775 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi Aug 23 07:22:46.705775 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 07:22:46.705775 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 07:22:46.705775 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 07:22:46.705775 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 07:22:46.705775 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 07:22:46.705775 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 07:22:46.707261 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 07:22:46.707261 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 07:22:46.707261 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 07:22:46.707261 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 07:22:46.707261 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 07:22:46.707261 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 07:22:46.707261 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 07:22:46.707261 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d364cacb-afc7-4499-ab81-7e15d47f0b40 could not be found. Aug 23 07:22:46.707261 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi Aug 23 07:22:46.707261 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 07:22:46.707261 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi Aug 23 07:22:46.707261 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 07:22:46.707261 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 07:22:46.707261 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 07:22:46.707261 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 07:22:46.707261 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 07:22:46.707261 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d364cacb-afc7-4499-ab81-7e15d47f0b40 could not be found. Aug 23 07:22:46.707261 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi Aug 23 07:22:46.708635 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-4aa63daf-9ee1-4783-ae4e-dfd4219f56fe tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Returning 404 to user: Instance d364cacb-afc7-4499-ab81-7e15d47f0b40 could not be found. {{(pid=120798) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 07:22:46.708635 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [None req-4aa63daf-9ee1-4783-ae4e-dfd4219f56fe tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] 10.222.0.17 "GET /compute/v2.1/servers/d364cacb-afc7-4499-ab81-7e15d47f0b40" status: 404 len: 111 microversion: 2.1 time: 0.040539 Aug 23 07:22:46.708824 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 429/881] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:22:46 2022] GET /compute/v2.1/servers/d364cacb-afc7-4499-ab81-7e15d47f0b40 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 07:22:49.727076 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-5fe2ce8e-6ac4-4050-b189-3900a02df571 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Action: 'create', calling method: .version_select at 0x7fe3c5622430>, body: {"keypair": {"name": "tempest-keypair-1690136964", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDQs93mvbKwXp8APbV/8mEi1S7481rlta0RbZUsijIaoYLT57eCU8PxbePPE5Wa2M6oKCiQzVrTicEA68Fd/2+BMihdumzU+bEfrrAaF0pO/1xNoR3+t2bL9vTpxruq2Dg=="}} {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 07:22:49.744948 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.quota [None req-5fe2ce8e-6ac4-4050-b189-3900a02df571 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Getting quotas for project cfc6e299d69345a3be46c0052d914742. Resources: {'key_pairs'} {{(pid=120799) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 07:22:49.749213 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.quota [None req-5fe2ce8e-6ac4-4050-b189-3900a02df571 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Getting quotas for user dbf1799461f6485ea88d25d89559906e and project cfc6e299d69345a3be46c0052d914742. Resources: {'key_pairs'} {{(pid=120799) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 07:22:49.780423 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-5fe2ce8e-6ac4-4050-b189-3900a02df571 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.201614 Aug 23 07:22:49.787720 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 453/882] 10.222.0.17 () {60 vars in 1159 bytes} [Tue Aug 23 07:22:49 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 07:22:50.013486 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-c8605e4d-5489-4e66-b038-ab29a22b7164 tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Calling method '>' {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:22:50.013982 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.compute.api [None req-c8605e4d-5489-4e66-b038-ab29a22b7164 tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] [instance: 19beb62f-fdd9-4e6c-9d20-2abc3b5dfd16] Fetching instance by UUID {{(pid=120798) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:22:50.021163 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-c8605e4d-5489-4e66-b038-ab29a22b7164 tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:22:50.022497 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-c8605e4d-5489-4e66-b038-ab29a22b7164 tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:22:50.023163 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-c8605e4d-5489-4e66-b038-ab29a22b7164 tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:22:50.024124 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-c8605e4d-5489-4e66-b038-ab29a22b7164 tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:22:50.024801 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-c8605e4d-5489-4e66-b038-ab29a22b7164 tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:22:50.025510 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-c8605e4d-5489-4e66-b038-ab29a22b7164 tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:22:50.030174 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [req-77804dca-f142-423b-b856-79fcbfda2f30 req-16fd50b3-c5db-43df-b8b5-d00e402c613f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "19beb62f-fdd9-4e6c-9d20-2abc3b5dfd16", "tag": "22874e03-587e-473a-8f08-37ed4393d34c"}]} {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 07:22:50.314155 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.compute.api [None req-c8605e4d-5489-4e66-b038-ab29a22b7164 tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] [instance: 19beb62f-fdd9-4e6c-9d20-2abc3b5dfd16] Going to try to terminate instance {{(pid=120798) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 07:22:50.322262 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [req-77804dca-f142-423b-b856-79fcbfda2f30 req-16fd50b3-c5db-43df-b8b5-d00e402c613f service nova] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:22:50.324849 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [req-77804dca-f142-423b-b856-79fcbfda2f30 req-16fd50b3-c5db-43df-b8b5-d00e402c613f service nova] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:22:50.325458 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [req-77804dca-f142-423b-b856-79fcbfda2f30 req-16fd50b3-c5db-43df-b8b5-d00e402c613f service nova] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:22:50.338802 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.compute.server_external_events [req-77804dca-f142-423b-b856-79fcbfda2f30 req-16fd50b3-c5db-43df-b8b5-d00e402c613f service nova] Creating event network-changed:22874e03-587e-473a-8f08-37ed4393d34c for instance 19beb62f-fdd9-4e6c-9d20-2abc3b5dfd16 on hv-cinder-85409 Aug 23 07:22:50.347391 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [req-77804dca-f142-423b-b856-79fcbfda2f30 req-16fd50b3-c5db-43df-b8b5-d00e402c613f service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.321638 Aug 23 07:22:50.350989 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 454/883] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Aug 23 07:22:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 07:22:50.462946 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [None req-c8605e4d-5489-4e66-b038-ab29a22b7164 tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] 10.222.0.17 "DELETE /compute/v2.1/servers/19beb62f-fdd9-4e6c-9d20-2abc3b5dfd16" status: 204 len: 0 microversion: 2.1 time: 0.451918 Aug 23 07:22:50.465267 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 430/884] 10.222.0.17 () {58 vars in 1239 bytes} [Tue Aug 23 07:22:50 2022] DELETE /compute/v2.1/servers/19beb62f-fdd9-4e6c-9d20-2abc3b5dfd16 => generated 0 bytes in 456 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 23 07:22:50.478658 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-fa5587be-99f4-45f0-bc2c-07c869032f24 tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Calling method '>' {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:22:50.480328 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.compute.api [None req-fa5587be-99f4-45f0-bc2c-07c869032f24 tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] [instance: 19beb62f-fdd9-4e6c-9d20-2abc3b5dfd16] Fetching instance by UUID {{(pid=120799) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:22:50.491006 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-fa5587be-99f4-45f0-bc2c-07c869032f24 tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:22:50.492284 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-fa5587be-99f4-45f0-bc2c-07c869032f24 tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:22:50.493244 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-fa5587be-99f4-45f0-bc2c-07c869032f24 tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:22:50.503172 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-fa5587be-99f4-45f0-bc2c-07c869032f24 tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:22:50.504540 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-fa5587be-99f4-45f0-bc2c-07c869032f24 tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:22:50.505706 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-fa5587be-99f4-45f0-bc2c-07c869032f24 tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:22:50.675621 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.policy [None req-fa5587be-99f4-45f0-bc2c-07c869032f24 tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffd12f09606b4e6ba12f63b976df1884', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43b271d00f74eb7aa3d0719315c5a99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120799) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:22:50.693940 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-fa5587be-99f4-45f0-bc2c-07c869032f24 tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] 10.222.0.17 "GET /compute/v2.1/servers/19beb62f-fdd9-4e6c-9d20-2abc3b5dfd16" status: 200 len: 1579 microversion: 2.1 time: 0.223638 Aug 23 07:22:50.695056 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 455/885] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:22:50 2022] GET /compute/v2.1/servers/19beb62f-fdd9-4e6c-9d20-2abc3b5dfd16 => generated 1579 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:22:51.430064 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-79329057-3bec-4630-9a2a-89061bce1d9e tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1813955854", "imageRef": "b899fd65-02ae-4b43-bac7-86f38fc3f224", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "224a8638-16a9-4af0-b7bb-fc84a3d1973a"}], "security_groups": [{"name": "tempest-securitygroup--1192835558"}], "key_name": "tempest-keypair-1690136964", "user_data": "}} {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 07:22:51.600411 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.network.neutron [None req-79329057-3bec-4630-9a2a-89061bce1d9e tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] validate_networks() for [('224a8638-16a9-4af0-b7bb-fc84a3d1973a', None, None, None, None, None)] {{(pid=120798) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 23 07:22:51.730493 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-793b5d2a-6aa7-4f19-9ee9-db4f208fa292 tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Calling method '>' {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:22:51.731068 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.compute.api [None req-793b5d2a-6aa7-4f19-9ee9-db4f208fa292 tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] [instance: 19beb62f-fdd9-4e6c-9d20-2abc3b5dfd16] Fetching instance by UUID {{(pid=120799) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:22:51.742211 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-793b5d2a-6aa7-4f19-9ee9-db4f208fa292 tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:22:51.742724 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-793b5d2a-6aa7-4f19-9ee9-db4f208fa292 tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:22:51.743471 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-793b5d2a-6aa7-4f19-9ee9-db4f208fa292 tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:22:51.744458 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-793b5d2a-6aa7-4f19-9ee9-db4f208fa292 tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:22:51.745250 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-793b5d2a-6aa7-4f19-9ee9-db4f208fa292 tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:22:51.746194 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-793b5d2a-6aa7-4f19-9ee9-db4f208fa292 tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:22:52.087578 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.policy [None req-793b5d2a-6aa7-4f19-9ee9-db4f208fa292 tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffd12f09606b4e6ba12f63b976df1884', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43b271d00f74eb7aa3d0719315c5a99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120799) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:22:52.102165 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-793b5d2a-6aa7-4f19-9ee9-db4f208fa292 tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] 10.222.0.17 "GET /compute/v2.1/servers/19beb62f-fdd9-4e6c-9d20-2abc3b5dfd16" status: 200 len: 1579 microversion: 2.1 time: 0.375922 Aug 23 07:22:52.116530 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 456/886] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:22:51 2022] GET /compute/v2.1/servers/19beb62f-fdd9-4e6c-9d20-2abc3b5dfd16 => generated 1579 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 07:22:52.385923 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.virt.hardware [None req-79329057-3bec-4630-9a2a-89061bce1d9e tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Flavor limits 0:0:0 {{(pid=120798) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 07:22:52.386354 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.virt.hardware [None req-79329057-3bec-4630-9a2a-89061bce1d9e tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Image limits 0:0:0 {{(pid=120798) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 07:22:52.386821 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.virt.hardware [None req-79329057-3bec-4630-9a2a-89061bce1d9e tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Flavor pref 0:0:0 {{(pid=120798) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 07:22:52.387490 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.virt.hardware [None req-79329057-3bec-4630-9a2a-89061bce1d9e tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Image pref 0:0:0 {{(pid=120798) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 07:22:52.388149 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.virt.hardware [None req-79329057-3bec-4630-9a2a-89061bce1d9e tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120798) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 07:22:52.402416 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-79329057-3bec-4630-9a2a-89061bce1d9e tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:22:52.403465 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-79329057-3bec-4630-9a2a-89061bce1d9e tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:22:52.403921 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-79329057-3bec-4630-9a2a-89061bce1d9e tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:22:52.404669 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-79329057-3bec-4630-9a2a-89061bce1d9e tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:22:52.405140 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-79329057-3bec-4630-9a2a-89061bce1d9e tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:22:52.405633 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-79329057-3bec-4630-9a2a-89061bce1d9e tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:22:52.431273 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.quota [None req-79329057-3bec-4630-9a2a-89061bce1d9e tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Getting quotas for project cfc6e299d69345a3be46c0052d914742. Resources: {'ram', 'instances', 'cores'} {{(pid=120798) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 07:22:52.436610 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.quota [None req-79329057-3bec-4630-9a2a-89061bce1d9e tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Getting quotas for user dbf1799461f6485ea88d25d89559906e and project cfc6e299d69345a3be46c0052d914742. Resources: {'ram', 'instances', 'cores'} {{(pid=120798) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 07:22:52.449994 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.compute.api [None req-79329057-3bec-4630-9a2a-89061bce1d9e tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Going to run 1 instances... {{(pid=120798) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 23 07:22:52.453085 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.compute.api [None req-79329057-3bec-4630-9a2a-89061bce1d9e tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] [instance: 409e70de-71fb-4ecd-ad90-41217f78bd4d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b899fd65-02ae-4b43-bac7-86f38fc3f224',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120798) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 07:22:52.504781 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [None req-79329057-3bec-4630-9a2a-89061bce1d9e tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.079354 Aug 23 07:22:52.516896 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-d7058776-07a1-401d-8b0f-08e26d5aa210 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Calling method '>' {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:22:52.517594 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.compute.api [None req-d7058776-07a1-401d-8b0f-08e26d5aa210 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] [instance: 409e70de-71fb-4ecd-ad90-41217f78bd4d] Fetching instance by UUID {{(pid=120799) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:22:52.520536 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 431/887] 10.222.0.17 () {60 vars in 1147 bytes} [Tue Aug 23 07:22:51 2022] POST /compute/v2.1/servers => generated 402 bytes in 1087 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 23 07:22:52.603007 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.policy [None req-d7058776-07a1-401d-8b0f-08e26d5aa210 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbf1799461f6485ea88d25d89559906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfc6e299d69345a3be46c0052d914742', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120799) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:22:52.612283 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-d7058776-07a1-401d-8b0f-08e26d5aa210 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] 10.222.0.17 "GET /compute/v2.1/servers/409e70de-71fb-4ecd-ad90-41217f78bd4d" status: 200 len: 1238 microversion: 2.1 time: 0.098853 Aug 23 07:22:52.613231 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 457/888] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:22:52 2022] GET /compute/v2.1/servers/409e70de-71fb-4ecd-ad90-41217f78bd4d => generated 1238 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:22:52.770618 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [req-b7884c06-96f4-4863-b819-c9341163b56a req-dc64eb41-bb7e-4cf6-b3a2-8e9c643fbfff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "19beb62f-fdd9-4e6c-9d20-2abc3b5dfd16", "name": "network-vif-deleted", "tag": "22874e03-587e-473a-8f08-37ed4393d34c"}]} {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 07:22:52.786424 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [req-b7884c06-96f4-4863-b819-c9341163b56a req-dc64eb41-bb7e-4cf6-b3a2-8e9c643fbfff service nova] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:22:52.787306 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [req-b7884c06-96f4-4863-b819-c9341163b56a req-dc64eb41-bb7e-4cf6-b3a2-8e9c643fbfff service nova] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:22:52.787977 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [req-b7884c06-96f4-4863-b819-c9341163b56a req-dc64eb41-bb7e-4cf6-b3a2-8e9c643fbfff service nova] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:22:52.802226 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.compute.server_external_events [req-b7884c06-96f4-4863-b819-c9341163b56a req-dc64eb41-bb7e-4cf6-b3a2-8e9c643fbfff service nova] Creating event network-vif-deleted:22874e03-587e-473a-8f08-37ed4393d34c for instance 19beb62f-fdd9-4e6c-9d20-2abc3b5dfd16 on hv-cinder-85409 Aug 23 07:22:52.810120 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [req-b7884c06-96f4-4863-b819-c9341163b56a req-dc64eb41-bb7e-4cf6-b3a2-8e9c643fbfff service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043074 Aug 23 07:22:52.810980 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 432/889] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Aug 23 07:22:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 07:22:53.126731 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-17b41af7-6ee2-4c7b-8de6-10a046cc72be tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Calling method '>' {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:22:53.127503 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.compute.api [None req-17b41af7-6ee2-4c7b-8de6-10a046cc72be tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] [instance: 19beb62f-fdd9-4e6c-9d20-2abc3b5dfd16] Fetching instance by UUID {{(pid=120799) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:22:53.134690 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-17b41af7-6ee2-4c7b-8de6-10a046cc72be tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:22:53.135534 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-17b41af7-6ee2-4c7b-8de6-10a046cc72be tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:22:53.136554 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-17b41af7-6ee2-4c7b-8de6-10a046cc72be tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:22:53.137351 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-17b41af7-6ee2-4c7b-8de6-10a046cc72be tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:22:53.137878 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-17b41af7-6ee2-4c7b-8de6-10a046cc72be tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:22:53.138370 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-17b41af7-6ee2-4c7b-8de6-10a046cc72be tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:22:53.175934 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-17b41af7-6ee2-4c7b-8de6-10a046cc72be tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:22:53.176420 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-17b41af7-6ee2-4c7b-8de6-10a046cc72be tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:22:53.177110 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-17b41af7-6ee2-4c7b-8de6-10a046cc72be tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:22:53.177566 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.objects.instance [None req-17b41af7-6ee2-4c7b-8de6-10a046cc72be tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Lazy-loading 'fault' on Instance uuid 19beb62f-fdd9-4e6c-9d20-2abc3b5dfd16 {{(pid=120799) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 07:22:53.222782 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.policy [None req-17b41af7-6ee2-4c7b-8de6-10a046cc72be tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffd12f09606b4e6ba12f63b976df1884', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43b271d00f74eb7aa3d0719315c5a99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120799) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:22:53.232711 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-17b41af7-6ee2-4c7b-8de6-10a046cc72be tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] 10.222.0.17 "GET /compute/v2.1/servers/19beb62f-fdd9-4e6c-9d20-2abc3b5dfd16" status: 200 len: 1230 microversion: 2.1 time: 0.110406 Aug 23 07:22:53.239942 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 458/890] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:22:53 2022] GET /compute/v2.1/servers/19beb62f-fdd9-4e6c-9d20-2abc3b5dfd16 => generated 1230 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:22:53.639515 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-93a1e8fc-682d-49ef-a235-d80e6245dd91 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Calling method '>' {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:22:53.640237 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.compute.api [None req-93a1e8fc-682d-49ef-a235-d80e6245dd91 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] [instance: 409e70de-71fb-4ecd-ad90-41217f78bd4d] Fetching instance by UUID {{(pid=120798) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:22:53.646850 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-93a1e8fc-682d-49ef-a235-d80e6245dd91 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:22:53.647343 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-93a1e8fc-682d-49ef-a235-d80e6245dd91 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:22:53.647817 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-93a1e8fc-682d-49ef-a235-d80e6245dd91 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:22:53.648545 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-93a1e8fc-682d-49ef-a235-d80e6245dd91 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:22:53.648976 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-93a1e8fc-682d-49ef-a235-d80e6245dd91 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:22:53.649396 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-93a1e8fc-682d-49ef-a235-d80e6245dd91 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:22:53.728007 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.policy [None req-93a1e8fc-682d-49ef-a235-d80e6245dd91 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbf1799461f6485ea88d25d89559906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfc6e299d69345a3be46c0052d914742', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120798) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:22:53.737683 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [None req-93a1e8fc-682d-49ef-a235-d80e6245dd91 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] 10.222.0.17 "GET /compute/v2.1/servers/409e70de-71fb-4ecd-ad90-41217f78bd4d" status: 200 len: 1290 microversion: 2.1 time: 0.108391 Aug 23 07:22:53.738491 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 433/891] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:22:53 2022] GET /compute/v2.1/servers/409e70de-71fb-4ecd-ad90-41217f78bd4d => generated 1290 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:22:54.255129 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-62dc551d-93c7-4cbf-8c2a-f788f82a26ea tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Calling method '>' {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:22:54.256274 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.compute.api [None req-62dc551d-93c7-4cbf-8c2a-f788f82a26ea tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] [instance: 19beb62f-fdd9-4e6c-9d20-2abc3b5dfd16] Fetching instance by UUID {{(pid=120799) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:22:54.264175 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-62dc551d-93c7-4cbf-8c2a-f788f82a26ea tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:22:54.264691 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-62dc551d-93c7-4cbf-8c2a-f788f82a26ea tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:22:54.265123 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-62dc551d-93c7-4cbf-8c2a-f788f82a26ea tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:22:54.265835 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-62dc551d-93c7-4cbf-8c2a-f788f82a26ea tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:22:54.266278 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-62dc551d-93c7-4cbf-8c2a-f788f82a26ea tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:22:54.266685 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-62dc551d-93c7-4cbf-8c2a-f788f82a26ea tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:22:54.280827 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.wsgi [None req-62dc551d-93c7-4cbf-8c2a-f788f82a26ea tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] HTTP exception thrown: Instance 19beb62f-fdd9-4e6c-9d20-2abc3b5dfd16 could not be found. Aug 23 07:22:54.282623 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-62dc551d-93c7-4cbf-8c2a-f788f82a26ea tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Request method failure captured: Aug 23 07:22:54.282623 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: request: GET /compute/v2.1/servers/19beb62f-fdd9-4e6c-9d20-2abc3b5dfd16 HTTP/1.1 Aug 23 07:22:54.282623 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: Accept: application/json Aug 23 07:22:54.282623 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: Accept-Encoding: identity Aug 23 07:22:54.282623 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: Connection: close Aug 23 07:22:54.282623 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: Content-Length: 0 Aug 23 07:22:54.282623 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: Content-Type: application/json Aug 23 07:22:54.282623 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: Host: 10.222.0.17 Aug 23 07:22:54.282623 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: Openstack-System-Scope: None Aug 23 07:22:54.282623 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: User-Agent: python-urllib3/1.26.11 Aug 23 07:22:54.282623 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-Auth-Token: gAAAAABjBH6P-jieul6AKjLkQNxUQwwgT2fi8Bci5j8MffQf2AuPopMIy52WWi9L58wzK15-su-lWN-ZQ9-gsTbwBITO3GTIew5NLlk5lc5ISYP5453RzZuvVuMnc-3ttHjqotPkrTBqzUxKdCeedTYXi_LdjHTI3SusmhIkqFZ-BB_c7Wz6nIY Aug 23 07:22:54.282623 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-Domain-Id: None Aug 23 07:22:54.282623 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-Domain-Name: None Aug 23 07:22:54.282623 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-Identity-Status: Confirmed Aug 23 07:22:54.282623 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-Is-Admin-Project: True Aug 23 07:22:54.282623 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-Project-Domain-Id: default Aug 23 07:22:54.282623 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-Project-Domain-Name: Default Aug 23 07:22:54.282623 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-Project-Id: f43b271d00f74eb7aa3d0719315c5a99 Aug 23 07:22:54.282623 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-Project-Name: tempest-TestVolumeBootPattern-1818187997 Aug 23 07:22:54.282623 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-Role: reader,member Aug 23 07:22:54.282623 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-Roles: reader,member Aug 23 07:22:54.284100 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/f43b271d00f74eb7aa3d0719315c5a99"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/f43b271d00f74eb7aa3d0719315c5a99"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_f43b271d00f74eb7aa3d0719315c5a99"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/f43b271d00f74eb7aa3d0719315c5a99"}]}] Aug 23 07:22:54.284100 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-Tenant: tempest-TestVolumeBootPattern-1818187997 Aug 23 07:22:54.284100 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-Tenant-Id: f43b271d00f74eb7aa3d0719315c5a99 Aug 23 07:22:54.284100 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-Tenant-Name: tempest-TestVolumeBootPattern-1818187997 Aug 23 07:22:54.284100 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-User: tempest-TestVolumeBootPattern-1818187997-project Aug 23 07:22:54.284100 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-User-Domain-Id: default Aug 23 07:22:54.284100 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-User-Domain-Name: Default Aug 23 07:22:54.284100 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-User-Id: ffd12f09606b4e6ba12f63b976df1884 Aug 23 07:22:54.284100 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-User-Name: tempest-TestVolumeBootPattern-1818187997-project Aug 23 07:22:54.284100 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: method: > Aug 23 07:22:54.284100 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: exception: Instance 19beb62f-fdd9-4e6c-9d20-2abc3b5dfd16 could not be found. Aug 23 07:22:54.284100 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: action_args: {'id': '19beb62f-fdd9-4e6c-9d20-2abc3b5dfd16'} Aug 23 07:22:54.284912 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 07:22:54.284912 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 07:22:54.284912 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 07:22:54.284912 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 07:22:54.284912 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 07:22:54.284912 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 07:22:54.284912 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 07:22:54.284912 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 07:22:54.284912 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 07:22:54.284912 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 07:22:54.284912 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 19beb62f-fdd9-4e6c-9d20-2abc3b5dfd16 could not be found. Aug 23 07:22:54.284912 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi Aug 23 07:22:54.284912 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 07:22:54.284912 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi Aug 23 07:22:54.284912 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 07:22:54.284912 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 07:22:54.284912 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 07:22:54.284912 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 07:22:54.284912 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 07:22:54.284912 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 07:22:54.287123 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 07:22:54.287123 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 07:22:54.287123 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 07:22:54.287123 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 07:22:54.287123 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 07:22:54.287123 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 07:22:54.287123 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 07:22:54.287123 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 19beb62f-fdd9-4e6c-9d20-2abc3b5dfd16 could not be found. Aug 23 07:22:54.287123 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi Aug 23 07:22:54.287123 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 07:22:54.287123 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi Aug 23 07:22:54.287123 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 07:22:54.287123 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 07:22:54.287123 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 07:22:54.287123 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 07:22:54.287123 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 07:22:54.287123 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 19beb62f-fdd9-4e6c-9d20-2abc3b5dfd16 could not be found. Aug 23 07:22:54.287123 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi Aug 23 07:22:54.288328 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-62dc551d-93c7-4cbf-8c2a-f788f82a26ea tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Returning 404 to user: Instance 19beb62f-fdd9-4e6c-9d20-2abc3b5dfd16 could not be found. {{(pid=120799) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 07:22:54.288328 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-62dc551d-93c7-4cbf-8c2a-f788f82a26ea tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] 10.222.0.17 "GET /compute/v2.1/servers/19beb62f-fdd9-4e6c-9d20-2abc3b5dfd16" status: 404 len: 111 microversion: 2.1 time: 0.033994 Aug 23 07:22:54.288328 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 459/892] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:22:54 2022] GET /compute/v2.1/servers/19beb62f-fdd9-4e6c-9d20-2abc3b5dfd16 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 07:22:54.757508 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-645fcec4-da16-479c-a14a-58ee82e46822 tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Calling method '>' {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:22:54.758068 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-4281aab4-b972-4c20-9201-e9d3fdc50833 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Calling method '>' {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:22:54.758161 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.compute.api [None req-645fcec4-da16-479c-a14a-58ee82e46822 tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] [instance: 74919866-69a0-460a-999a-b344d1cbc336] Fetching instance by UUID {{(pid=120798) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:22:54.758642 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.compute.api [None req-4281aab4-b972-4c20-9201-e9d3fdc50833 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] [instance: 409e70de-71fb-4ecd-ad90-41217f78bd4d] Fetching instance by UUID {{(pid=120799) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:22:54.765681 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-4281aab4-b972-4c20-9201-e9d3fdc50833 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:22:54.765885 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-645fcec4-da16-479c-a14a-58ee82e46822 tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:22:54.766155 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-4281aab4-b972-4c20-9201-e9d3fdc50833 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:22:54.766749 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-645fcec4-da16-479c-a14a-58ee82e46822 tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:22:54.766885 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-4281aab4-b972-4c20-9201-e9d3fdc50833 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:22:54.767187 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-645fcec4-da16-479c-a14a-58ee82e46822 tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:22:54.767465 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-4281aab4-b972-4c20-9201-e9d3fdc50833 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:22:54.768048 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-645fcec4-da16-479c-a14a-58ee82e46822 tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:22:54.768676 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-645fcec4-da16-479c-a14a-58ee82e46822 tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:22:54.768795 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-4281aab4-b972-4c20-9201-e9d3fdc50833 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:22:54.769140 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-4281aab4-b972-4c20-9201-e9d3fdc50833 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:22:54.769626 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-645fcec4-da16-479c-a14a-58ee82e46822 tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:22:54.788057 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.wsgi [None req-645fcec4-da16-479c-a14a-58ee82e46822 tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] HTTP exception thrown: Instance 74919866-69a0-460a-999a-b344d1cbc336 could not be found. Aug 23 07:22:54.789926 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-645fcec4-da16-479c-a14a-58ee82e46822 tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Request method failure captured: Aug 23 07:22:54.789926 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: request: DELETE /compute/v2.1/servers/74919866-69a0-460a-999a-b344d1cbc336 HTTP/1.1 Aug 23 07:22:54.789926 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: Accept: application/json Aug 23 07:22:54.789926 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: Accept-Encoding: identity Aug 23 07:22:54.789926 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: Connection: close Aug 23 07:22:54.789926 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: Content-Length: 0 Aug 23 07:22:54.789926 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: Content-Type: application/json Aug 23 07:22:54.789926 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: Host: 10.222.0.17 Aug 23 07:22:54.789926 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: Openstack-System-Scope: None Aug 23 07:22:54.789926 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: User-Agent: python-urllib3/1.26.11 Aug 23 07:22:54.789926 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-Auth-Token: gAAAAABjBH6P-jieul6AKjLkQNxUQwwgT2fi8Bci5j8MffQf2AuPopMIy52WWi9L58wzK15-su-lWN-ZQ9-gsTbwBITO3GTIew5NLlk5lc5ISYP5453RzZuvVuMnc-3ttHjqotPkrTBqzUxKdCeedTYXi_LdjHTI3SusmhIkqFZ-BB_c7Wz6nIY Aug 23 07:22:54.789926 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-Domain-Id: None Aug 23 07:22:54.789926 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-Domain-Name: None Aug 23 07:22:54.789926 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-Identity-Status: Confirmed Aug 23 07:22:54.789926 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-Is-Admin-Project: True Aug 23 07:22:54.789926 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-Project-Domain-Id: default Aug 23 07:22:54.789926 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-Project-Domain-Name: Default Aug 23 07:22:54.789926 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-Project-Id: f43b271d00f74eb7aa3d0719315c5a99 Aug 23 07:22:54.789926 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-Project-Name: tempest-TestVolumeBootPattern-1818187997 Aug 23 07:22:54.789926 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-Role: reader,member Aug 23 07:22:54.789926 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-Roles: reader,member Aug 23 07:22:54.792072 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/f43b271d00f74eb7aa3d0719315c5a99"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/f43b271d00f74eb7aa3d0719315c5a99"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_f43b271d00f74eb7aa3d0719315c5a99"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/f43b271d00f74eb7aa3d0719315c5a99"}]}] Aug 23 07:22:54.792072 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-Tenant: tempest-TestVolumeBootPattern-1818187997 Aug 23 07:22:54.792072 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-Tenant-Id: f43b271d00f74eb7aa3d0719315c5a99 Aug 23 07:22:54.792072 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-Tenant-Name: tempest-TestVolumeBootPattern-1818187997 Aug 23 07:22:54.792072 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-User: tempest-TestVolumeBootPattern-1818187997-project Aug 23 07:22:54.792072 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-User-Domain-Id: default Aug 23 07:22:54.792072 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-User-Domain-Name: Default Aug 23 07:22:54.792072 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-User-Id: ffd12f09606b4e6ba12f63b976df1884 Aug 23 07:22:54.792072 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-User-Name: tempest-TestVolumeBootPattern-1818187997-project Aug 23 07:22:54.792072 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: method: > Aug 23 07:22:54.792072 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: exception: Instance 74919866-69a0-460a-999a-b344d1cbc336 could not be found. Aug 23 07:22:54.792072 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: action_args: {'id': '74919866-69a0-460a-999a-b344d1cbc336'} Aug 23 07:22:54.793061 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 07:22:54.793061 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 07:22:54.793061 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 07:22:54.793061 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 07:22:54.793061 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 07:22:54.793061 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 07:22:54.793061 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 07:22:54.793061 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 07:22:54.793061 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 07:22:54.793061 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 07:22:54.793061 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 74919866-69a0-460a-999a-b344d1cbc336 could not be found. Aug 23 07:22:54.793061 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi Aug 23 07:22:54.793061 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 07:22:54.793061 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi Aug 23 07:22:54.793061 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 07:22:54.793061 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 07:22:54.793061 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 07:22:54.793061 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 07:22:54.793061 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 07:22:54.793061 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 07:22:54.794520 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 07:22:54.794520 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 23 07:22:54.794520 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 23 07:22:54.794520 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 23 07:22:54.794520 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 23 07:22:54.794520 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 07:22:54.794520 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 07:22:54.794520 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 07:22:54.794520 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 07:22:54.794520 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 74919866-69a0-460a-999a-b344d1cbc336 could not be found. Aug 23 07:22:54.794520 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi Aug 23 07:22:54.794520 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 07:22:54.794520 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi Aug 23 07:22:54.794520 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 07:22:54.794520 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 07:22:54.794520 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 07:22:54.794520 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 07:22:54.794520 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 07:22:54.794520 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 74919866-69a0-460a-999a-b344d1cbc336 could not be found. Aug 23 07:22:54.794520 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi Aug 23 07:22:54.797193 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-645fcec4-da16-479c-a14a-58ee82e46822 tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Returning 404 to user: Instance 74919866-69a0-460a-999a-b344d1cbc336 could not be found. {{(pid=120798) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 07:22:54.798246 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [None req-645fcec4-da16-479c-a14a-58ee82e46822 tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] 10.222.0.17 "DELETE /compute/v2.1/servers/74919866-69a0-460a-999a-b344d1cbc336" status: 404 len: 111 microversion: 2.1 time: 0.047387 Aug 23 07:22:54.802089 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 434/893] 10.222.0.17 () {58 vars in 1239 bytes} [Tue Aug 23 07:22:54 2022] DELETE /compute/v2.1/servers/74919866-69a0-460a-999a-b344d1cbc336 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 07:22:54.808604 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-2056d8f5-a5a5-426f-8def-19a6887a8e01 tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Calling method '>' {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:22:54.809725 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.compute.api [None req-2056d8f5-a5a5-426f-8def-19a6887a8e01 tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] [instance: 74919866-69a0-460a-999a-b344d1cbc336] Fetching instance by UUID {{(pid=120798) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:22:54.816204 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-2056d8f5-a5a5-426f-8def-19a6887a8e01 tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:22:54.817760 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-2056d8f5-a5a5-426f-8def-19a6887a8e01 tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:22:54.818370 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-2056d8f5-a5a5-426f-8def-19a6887a8e01 tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:22:54.819278 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-2056d8f5-a5a5-426f-8def-19a6887a8e01 tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:22:54.819975 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-2056d8f5-a5a5-426f-8def-19a6887a8e01 tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:22:54.820571 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-2056d8f5-a5a5-426f-8def-19a6887a8e01 tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:22:54.836290 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.wsgi [None req-2056d8f5-a5a5-426f-8def-19a6887a8e01 tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] HTTP exception thrown: Instance 74919866-69a0-460a-999a-b344d1cbc336 could not be found. Aug 23 07:22:54.839108 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-2056d8f5-a5a5-426f-8def-19a6887a8e01 tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Request method failure captured: Aug 23 07:22:54.839108 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: request: GET /compute/v2.1/servers/74919866-69a0-460a-999a-b344d1cbc336 HTTP/1.1 Aug 23 07:22:54.839108 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: Accept: application/json Aug 23 07:22:54.839108 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: Accept-Encoding: identity Aug 23 07:22:54.839108 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: Connection: close Aug 23 07:22:54.839108 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: Content-Length: 0 Aug 23 07:22:54.839108 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: Content-Type: application/json Aug 23 07:22:54.839108 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: Host: 10.222.0.17 Aug 23 07:22:54.839108 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: Openstack-System-Scope: None Aug 23 07:22:54.839108 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: User-Agent: python-urllib3/1.26.11 Aug 23 07:22:54.839108 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-Auth-Token: gAAAAABjBH6P-jieul6AKjLkQNxUQwwgT2fi8Bci5j8MffQf2AuPopMIy52WWi9L58wzK15-su-lWN-ZQ9-gsTbwBITO3GTIew5NLlk5lc5ISYP5453RzZuvVuMnc-3ttHjqotPkrTBqzUxKdCeedTYXi_LdjHTI3SusmhIkqFZ-BB_c7Wz6nIY Aug 23 07:22:54.839108 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-Domain-Id: None Aug 23 07:22:54.839108 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-Domain-Name: None Aug 23 07:22:54.839108 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-Identity-Status: Confirmed Aug 23 07:22:54.839108 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-Is-Admin-Project: True Aug 23 07:22:54.839108 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-Project-Domain-Id: default Aug 23 07:22:54.839108 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-Project-Domain-Name: Default Aug 23 07:22:54.839108 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-Project-Id: f43b271d00f74eb7aa3d0719315c5a99 Aug 23 07:22:54.839108 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-Project-Name: tempest-TestVolumeBootPattern-1818187997 Aug 23 07:22:54.839108 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-Role: reader,member Aug 23 07:22:54.839108 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-Roles: reader,member Aug 23 07:22:54.840535 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/f43b271d00f74eb7aa3d0719315c5a99"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/f43b271d00f74eb7aa3d0719315c5a99"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_f43b271d00f74eb7aa3d0719315c5a99"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/f43b271d00f74eb7aa3d0719315c5a99"}]}] Aug 23 07:22:54.840535 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-Tenant: tempest-TestVolumeBootPattern-1818187997 Aug 23 07:22:54.840535 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-Tenant-Id: f43b271d00f74eb7aa3d0719315c5a99 Aug 23 07:22:54.840535 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-Tenant-Name: tempest-TestVolumeBootPattern-1818187997 Aug 23 07:22:54.840535 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-User: tempest-TestVolumeBootPattern-1818187997-project Aug 23 07:22:54.840535 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-User-Domain-Id: default Aug 23 07:22:54.840535 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-User-Domain-Name: Default Aug 23 07:22:54.840535 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-User-Id: ffd12f09606b4e6ba12f63b976df1884 Aug 23 07:22:54.840535 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-User-Name: tempest-TestVolumeBootPattern-1818187997-project Aug 23 07:22:54.840535 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: method: > Aug 23 07:22:54.840535 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: exception: Instance 74919866-69a0-460a-999a-b344d1cbc336 could not be found. Aug 23 07:22:54.840535 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: action_args: {'id': '74919866-69a0-460a-999a-b344d1cbc336'} Aug 23 07:22:54.841266 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 07:22:54.841266 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 07:22:54.841266 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 07:22:54.841266 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 07:22:54.841266 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 07:22:54.841266 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 07:22:54.841266 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 07:22:54.841266 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 07:22:54.841266 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 07:22:54.841266 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 07:22:54.841266 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 74919866-69a0-460a-999a-b344d1cbc336 could not be found. Aug 23 07:22:54.841266 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi Aug 23 07:22:54.841266 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 07:22:54.841266 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi Aug 23 07:22:54.841266 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 07:22:54.841266 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 07:22:54.841266 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 07:22:54.841266 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 07:22:54.841266 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 07:22:54.841266 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 07:22:54.842449 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 07:22:54.842449 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 07:22:54.842449 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 07:22:54.842449 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 07:22:54.842449 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 07:22:54.842449 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 07:22:54.842449 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 07:22:54.842449 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 74919866-69a0-460a-999a-b344d1cbc336 could not be found. Aug 23 07:22:54.842449 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi Aug 23 07:22:54.842449 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 07:22:54.842449 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi Aug 23 07:22:54.842449 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 07:22:54.842449 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 07:22:54.842449 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 07:22:54.842449 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 07:22:54.842449 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 07:22:54.842449 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 74919866-69a0-460a-999a-b344d1cbc336 could not be found. Aug 23 07:22:54.842449 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi Aug 23 07:22:54.845230 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-2056d8f5-a5a5-426f-8def-19a6887a8e01 tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Returning 404 to user: Instance 74919866-69a0-460a-999a-b344d1cbc336 could not be found. {{(pid=120798) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 07:22:54.846097 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [None req-2056d8f5-a5a5-426f-8def-19a6887a8e01 tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] 10.222.0.17 "GET /compute/v2.1/servers/74919866-69a0-460a-999a-b344d1cbc336" status: 404 len: 111 microversion: 2.1 time: 0.042205 Aug 23 07:22:54.850362 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 435/894] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:22:54 2022] GET /compute/v2.1/servers/74919866-69a0-460a-999a-b344d1cbc336 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 07:22:54.976636 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.policy [None req-4281aab4-b972-4c20-9201-e9d3fdc50833 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbf1799461f6485ea88d25d89559906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfc6e299d69345a3be46c0052d914742', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120799) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:22:54.985727 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-4281aab4-b972-4c20-9201-e9d3fdc50833 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] 10.222.0.17 "GET /compute/v2.1/servers/409e70de-71fb-4ecd-ad90-41217f78bd4d" status: 200 len: 1364 microversion: 2.1 time: 0.231551 Aug 23 07:22:54.986547 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 460/895] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:22:54 2022] GET /compute/v2.1/servers/409e70de-71fb-4ecd-ad90-41217f78bd4d => generated 1364 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:22:55.376396 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [req-3b1a8b76-5ac7-41dd-88cc-188ffb268c79 req-23de943e-56d2-4a01-af51-641415f088eb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "409e70de-71fb-4ecd-ad90-41217f78bd4d", "tag": "31769f6b-7f3f-474d-8c5c-af6f1e507baa"}]} {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 07:22:55.389703 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [req-3b1a8b76-5ac7-41dd-88cc-188ffb268c79 req-23de943e-56d2-4a01-af51-641415f088eb service nova] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:22:55.390219 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [req-3b1a8b76-5ac7-41dd-88cc-188ffb268c79 req-23de943e-56d2-4a01-af51-641415f088eb service nova] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:22:55.390610 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [req-3b1a8b76-5ac7-41dd-88cc-188ffb268c79 req-23de943e-56d2-4a01-af51-641415f088eb service nova] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:22:55.404813 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.compute.server_external_events [req-3b1a8b76-5ac7-41dd-88cc-188ffb268c79 req-23de943e-56d2-4a01-af51-641415f088eb service nova] Creating event network-changed:31769f6b-7f3f-474d-8c5c-af6f1e507baa for instance 409e70de-71fb-4ecd-ad90-41217f78bd4d on hv-cinder-85409 Aug 23 07:22:55.409784 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [req-3b1a8b76-5ac7-41dd-88cc-188ffb268c79 req-23de943e-56d2-4a01-af51-641415f088eb service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037349 Aug 23 07:22:55.410583 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 436/896] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Aug 23 07:22:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 07:22:56.012645 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-636bb597-be97-48f4-a2e6-309658275c20 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Calling method '>' {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:22:56.013155 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.compute.api [None req-636bb597-be97-48f4-a2e6-309658275c20 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] [instance: 409e70de-71fb-4ecd-ad90-41217f78bd4d] Fetching instance by UUID {{(pid=120799) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:22:56.020235 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-636bb597-be97-48f4-a2e6-309658275c20 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:22:56.020911 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-636bb597-be97-48f4-a2e6-309658275c20 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:22:56.021550 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-636bb597-be97-48f4-a2e6-309658275c20 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:22:56.022247 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-636bb597-be97-48f4-a2e6-309658275c20 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:22:56.022697 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-636bb597-be97-48f4-a2e6-309658275c20 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:22:56.023115 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-636bb597-be97-48f4-a2e6-309658275c20 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:22:56.217194 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.policy [None req-636bb597-be97-48f4-a2e6-309658275c20 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbf1799461f6485ea88d25d89559906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfc6e299d69345a3be46c0052d914742', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120799) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:22:56.226910 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-636bb597-be97-48f4-a2e6-309658275c20 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] 10.222.0.17 "GET /compute/v2.1/servers/409e70de-71fb-4ecd-ad90-41217f78bd4d" status: 200 len: 1364 microversion: 2.1 time: 0.220490 Aug 23 07:22:56.227566 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 461/897] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:22:56 2022] GET /compute/v2.1/servers/409e70de-71fb-4ecd-ad90-41217f78bd4d => generated 1364 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:22:56.255363 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-304b3b0e-2199-451d-943f-8829822c5e2d tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] Calling method '.version_select at 0x7fe3c75f7550>' {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:22:56.275995 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [None req-304b3b0e-2199-451d-943f-8829822c5e2d tempest-TestVolumeBootPattern-1818187997 tempest-TestVolumeBootPattern-1818187997-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1565151740" status: 202 len: 0 microversion: 2.1 time: 0.024700 Aug 23 07:22:56.276586 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 437/898] 10.222.0.17 () {58 vars in 1263 bytes} [Tue Aug 23 07:22:56 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1565151740 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 07:22:57.248469 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-0fb71863-bc54-4456-a5e7-90b552a916a2 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Calling method '>' {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:22:57.249063 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.compute.api [None req-0fb71863-bc54-4456-a5e7-90b552a916a2 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] [instance: 409e70de-71fb-4ecd-ad90-41217f78bd4d] Fetching instance by UUID {{(pid=120799) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:22:57.255758 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-0fb71863-bc54-4456-a5e7-90b552a916a2 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:22:57.256237 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-0fb71863-bc54-4456-a5e7-90b552a916a2 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:22:57.256662 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-0fb71863-bc54-4456-a5e7-90b552a916a2 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:22:57.257399 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-0fb71863-bc54-4456-a5e7-90b552a916a2 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:22:57.257846 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-0fb71863-bc54-4456-a5e7-90b552a916a2 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:22:57.258248 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-0fb71863-bc54-4456-a5e7-90b552a916a2 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:22:57.394061 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.policy [None req-0fb71863-bc54-4456-a5e7-90b552a916a2 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbf1799461f6485ea88d25d89559906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfc6e299d69345a3be46c0052d914742', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120799) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:22:57.401884 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-0fb71863-bc54-4456-a5e7-90b552a916a2 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] 10.222.0.17 "GET /compute/v2.1/servers/409e70de-71fb-4ecd-ad90-41217f78bd4d" status: 200 len: 1364 microversion: 2.1 time: 0.157391 Aug 23 07:22:57.402446 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 462/899] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:22:57 2022] GET /compute/v2.1/servers/409e70de-71fb-4ecd-ad90-41217f78bd4d => generated 1364 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:22:58.423514 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-f51a975b-abc4-4be6-9329-6179b0dacb5e tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Calling method '>' {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:22:58.424919 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.compute.api [None req-f51a975b-abc4-4be6-9329-6179b0dacb5e tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] [instance: 409e70de-71fb-4ecd-ad90-41217f78bd4d] Fetching instance by UUID {{(pid=120798) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:22:58.434265 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-f51a975b-abc4-4be6-9329-6179b0dacb5e tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:22:58.434869 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-f51a975b-abc4-4be6-9329-6179b0dacb5e tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:22:58.435609 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-f51a975b-abc4-4be6-9329-6179b0dacb5e tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:22:58.436549 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-f51a975b-abc4-4be6-9329-6179b0dacb5e tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:22:58.437209 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-f51a975b-abc4-4be6-9329-6179b0dacb5e tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:22:58.437775 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-f51a975b-abc4-4be6-9329-6179b0dacb5e tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:22:58.916411 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.policy [None req-f51a975b-abc4-4be6-9329-6179b0dacb5e tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbf1799461f6485ea88d25d89559906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfc6e299d69345a3be46c0052d914742', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120798) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:22:58.923931 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [None req-f51a975b-abc4-4be6-9329-6179b0dacb5e tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] 10.222.0.17 "GET /compute/v2.1/servers/409e70de-71fb-4ecd-ad90-41217f78bd4d" status: 200 len: 1364 microversion: 2.1 time: 0.504827 Aug 23 07:22:58.924475 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 438/900] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:22:58 2022] GET /compute/v2.1/servers/409e70de-71fb-4ecd-ad90-41217f78bd4d => generated 1364 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:22:59.944541 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-885724e8-b70a-4f55-8444-f0b0d5474c13 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Calling method '>' {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:22:59.945141 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.compute.api [None req-885724e8-b70a-4f55-8444-f0b0d5474c13 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] [instance: 409e70de-71fb-4ecd-ad90-41217f78bd4d] Fetching instance by UUID {{(pid=120799) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:22:59.952035 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-885724e8-b70a-4f55-8444-f0b0d5474c13 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:22:59.953068 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-885724e8-b70a-4f55-8444-f0b0d5474c13 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:22:59.953749 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-885724e8-b70a-4f55-8444-f0b0d5474c13 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:22:59.954665 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-885724e8-b70a-4f55-8444-f0b0d5474c13 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:22:59.955117 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-885724e8-b70a-4f55-8444-f0b0d5474c13 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:22:59.955572 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-885724e8-b70a-4f55-8444-f0b0d5474c13 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:23:00.121644 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.policy [None req-885724e8-b70a-4f55-8444-f0b0d5474c13 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbf1799461f6485ea88d25d89559906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfc6e299d69345a3be46c0052d914742', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120799) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:23:00.129560 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [req-736ca547-e915-4cad-a3e2-a150e1bb099f req-0c288321-4301-49cc-b4d0-f31f57422723 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "409e70de-71fb-4ecd-ad90-41217f78bd4d", "name": "network-vif-plugged", "status": "completed", "tag": "31769f6b-7f3f-474d-8c5c-af6f1e507baa"}]} {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 07:23:00.132307 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-885724e8-b70a-4f55-8444-f0b0d5474c13 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] 10.222.0.17 "GET /compute/v2.1/servers/409e70de-71fb-4ecd-ad90-41217f78bd4d" status: 200 len: 1364 microversion: 2.1 time: 0.191496 Aug 23 07:23:00.143158 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 463/901] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:22:59 2022] GET /compute/v2.1/servers/409e70de-71fb-4ecd-ad90-41217f78bd4d => generated 1364 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:23:00.143628 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [req-736ca547-e915-4cad-a3e2-a150e1bb099f req-0c288321-4301-49cc-b4d0-f31f57422723 service nova] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:23:00.144177 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [req-736ca547-e915-4cad-a3e2-a150e1bb099f req-0c288321-4301-49cc-b4d0-f31f57422723 service nova] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:23:00.144681 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [req-736ca547-e915-4cad-a3e2-a150e1bb099f req-0c288321-4301-49cc-b4d0-f31f57422723 service nova] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:23:00.157542 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.compute.server_external_events [req-736ca547-e915-4cad-a3e2-a150e1bb099f req-0c288321-4301-49cc-b4d0-f31f57422723 service nova] Creating event network-vif-plugged:31769f6b-7f3f-474d-8c5c-af6f1e507baa for instance 409e70de-71fb-4ecd-ad90-41217f78bd4d on hv-cinder-85409 Aug 23 07:23:00.162792 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [req-736ca547-e915-4cad-a3e2-a150e1bb099f req-0c288321-4301-49cc-b4d0-f31f57422723 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037884 Aug 23 07:23:00.163399 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 439/902] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Aug 23 07:23:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 07:23:01.154542 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-e9e0dce6-de5a-41ae-b408-51799ecfa2a6 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Calling method '>' {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:23:01.155156 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.compute.api [None req-e9e0dce6-de5a-41ae-b408-51799ecfa2a6 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] [instance: 409e70de-71fb-4ecd-ad90-41217f78bd4d] Fetching instance by UUID {{(pid=120799) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:23:01.162701 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-e9e0dce6-de5a-41ae-b408-51799ecfa2a6 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:23:01.163480 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-e9e0dce6-de5a-41ae-b408-51799ecfa2a6 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:23:01.164095 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-e9e0dce6-de5a-41ae-b408-51799ecfa2a6 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:23:01.165310 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-e9e0dce6-de5a-41ae-b408-51799ecfa2a6 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:23:01.166176 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-e9e0dce6-de5a-41ae-b408-51799ecfa2a6 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:23:01.166772 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-e9e0dce6-de5a-41ae-b408-51799ecfa2a6 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:23:01.171225 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG dbcounter [-] [120799] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120799) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:23:01.309857 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.policy [None req-e9e0dce6-de5a-41ae-b408-51799ecfa2a6 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbf1799461f6485ea88d25d89559906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfc6e299d69345a3be46c0052d914742', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120799) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:23:01.317702 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-e9e0dce6-de5a-41ae-b408-51799ecfa2a6 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] 10.222.0.17 "GET /compute/v2.1/servers/409e70de-71fb-4ecd-ad90-41217f78bd4d" status: 200 len: 1364 microversion: 2.1 time: 0.167269 Aug 23 07:23:01.318270 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 464/903] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:23:01 2022] GET /compute/v2.1/servers/409e70de-71fb-4ecd-ad90-41217f78bd4d => generated 1364 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:23:02.339816 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-e96b8a95-3418-478d-8800-92d6ec46489a tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Calling method '>' {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:23:02.340672 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.compute.api [None req-e96b8a95-3418-478d-8800-92d6ec46489a tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] [instance: 409e70de-71fb-4ecd-ad90-41217f78bd4d] Fetching instance by UUID {{(pid=120798) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:23:02.342624 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG dbcounter [-] [120798] Writing DB stats nova_api:SELECT=66,nova_api:UPDATE=2,nova_api:DELETE=2,nova_api:INSERT=3 {{(pid=120798) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:23:02.348530 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-e96b8a95-3418-478d-8800-92d6ec46489a tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:23:02.349009 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-e96b8a95-3418-478d-8800-92d6ec46489a tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:23:02.349438 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-e96b8a95-3418-478d-8800-92d6ec46489a tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:23:02.350155 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-e96b8a95-3418-478d-8800-92d6ec46489a tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:23:02.350604 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-e96b8a95-3418-478d-8800-92d6ec46489a tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:23:02.351026 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-e96b8a95-3418-478d-8800-92d6ec46489a tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:23:02.354512 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG dbcounter [-] [120798] Writing DB stats nova_cell1:SELECT=81,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120798) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:23:02.419580 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG dbcounter [-] [120798] Writing DB stats nova_cell0:SELECT=2 {{(pid=120798) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:23:02.445801 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG dbcounter [-] [120798] Writing DB stats nova_cell0:SELECT=6 {{(pid=120798) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:23:02.553878 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.policy [None req-e96b8a95-3418-478d-8800-92d6ec46489a tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbf1799461f6485ea88d25d89559906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfc6e299d69345a3be46c0052d914742', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120798) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:23:02.562161 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [None req-e96b8a95-3418-478d-8800-92d6ec46489a tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] 10.222.0.17 "GET /compute/v2.1/servers/409e70de-71fb-4ecd-ad90-41217f78bd4d" status: 200 len: 1550 microversion: 2.1 time: 0.227264 Aug 23 07:23:02.577707 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 440/904] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:23:02 2022] GET /compute/v2.1/servers/409e70de-71fb-4ecd-ad90-41217f78bd4d => generated 1550 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:23:02.582855 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-48d8aaea-2a6c-4b42-bc3f-c93f23dec838 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Calling method '>' {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:23:02.583375 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.compute.api [None req-48d8aaea-2a6c-4b42-bc3f-c93f23dec838 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] [instance: 409e70de-71fb-4ecd-ad90-41217f78bd4d] Fetching instance by UUID {{(pid=120799) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:23:02.589418 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG dbcounter [-] [120799] Writing DB stats nova_api:SELECT=63,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=120799) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:23:02.591451 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-48d8aaea-2a6c-4b42-bc3f-c93f23dec838 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:23:02.592164 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-48d8aaea-2a6c-4b42-bc3f-c93f23dec838 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:23:02.592993 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-48d8aaea-2a6c-4b42-bc3f-c93f23dec838 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:23:02.594219 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-48d8aaea-2a6c-4b42-bc3f-c93f23dec838 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:23:02.594908 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-48d8aaea-2a6c-4b42-bc3f-c93f23dec838 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:23:02.595292 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-48d8aaea-2a6c-4b42-bc3f-c93f23dec838 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:23:02.612771 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG dbcounter [-] [120799] Writing DB stats nova_cell0:SELECT=6 {{(pid=120799) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:23:02.691165 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-48d8aaea-2a6c-4b42-bc3f-c93f23dec838 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] 10.222.0.17 "GET /compute/v2.1/servers/409e70de-71fb-4ecd-ad90-41217f78bd4d/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.112119 Aug 23 07:23:02.691790 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 465/905] 10.222.0.17 () {58 vars in 1275 bytes} [Tue Aug 23 07:23:02 2022] GET /compute/v2.1/servers/409e70de-71fb-4ecd-ad90-41217f78bd4d/os-interface => generated 285 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 07:23:03.878324 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [req-4056cf5d-6851-4e07-b8a9-94497ac3c451 req-25c81839-050e-42d7-8de7-212198b62124 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "409e70de-71fb-4ecd-ad90-41217f78bd4d", "tag": "31769f6b-7f3f-474d-8c5c-af6f1e507baa"}]} {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 07:23:03.889245 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [req-4056cf5d-6851-4e07-b8a9-94497ac3c451 req-25c81839-050e-42d7-8de7-212198b62124 service nova] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:23:03.889726 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [req-4056cf5d-6851-4e07-b8a9-94497ac3c451 req-25c81839-050e-42d7-8de7-212198b62124 service nova] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:23:03.890335 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [req-4056cf5d-6851-4e07-b8a9-94497ac3c451 req-25c81839-050e-42d7-8de7-212198b62124 service nova] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:23:03.903739 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.compute.server_external_events [req-4056cf5d-6851-4e07-b8a9-94497ac3c451 req-25c81839-050e-42d7-8de7-212198b62124 service nova] Creating event network-changed:31769f6b-7f3f-474d-8c5c-af6f1e507baa for instance 409e70de-71fb-4ecd-ad90-41217f78bd4d on hv-cinder-85409 Aug 23 07:23:03.908761 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [req-4056cf5d-6851-4e07-b8a9-94497ac3c451 req-25c81839-050e-42d7-8de7-212198b62124 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.204324 Aug 23 07:23:03.909808 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 441/906] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Aug 23 07:23:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 07:23:37.789429 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG dbcounter [-] [120799] Writing DB stats nova_cell1:SELECT=8 {{(pid=120799) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:23:37.790555 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG dbcounter [-] [120799] Writing DB stats nova_api:SELECT=1 {{(pid=120799) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:23:37.798518 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-eba362b3-c277-4fab-949f-a401d66e5b41 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Calling method '>' {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:23:37.798996 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.compute.api [None req-eba362b3-c277-4fab-949f-a401d66e5b41 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] [instance: 409e70de-71fb-4ecd-ad90-41217f78bd4d] Fetching instance by UUID {{(pid=120799) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:23:37.805902 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-eba362b3-c277-4fab-949f-a401d66e5b41 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:23:37.806378 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-eba362b3-c277-4fab-949f-a401d66e5b41 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:23:37.806805 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-eba362b3-c277-4fab-949f-a401d66e5b41 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:23:37.807517 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-eba362b3-c277-4fab-949f-a401d66e5b41 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:23:37.807963 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-eba362b3-c277-4fab-949f-a401d66e5b41 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:23:37.808377 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-eba362b3-c277-4fab-949f-a401d66e5b41 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:23:37.832011 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-eba362b3-c277-4fab-949f-a401d66e5b41 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] 10.222.0.17 "GET /compute/v2.1/servers/409e70de-71fb-4ecd-ad90-41217f78bd4d/ips" status: 200 len: 146 microversion: 2.1 time: 0.045533 Aug 23 07:23:37.832561 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 466/907] 10.222.0.17 () {58 vars in 1248 bytes} [Tue Aug 23 07:23:37 2022] GET /compute/v2.1/servers/409e70de-71fb-4ecd-ad90-41217f78bd4d/ips => generated 146 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 07:23:40.118874 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG dbcounter [-] [120798] Writing DB stats nova_api:SELECT=3 {{(pid=120798) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:23:40.119655 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG dbcounter [-] [120798] Writing DB stats nova_cell1:SELECT=7 {{(pid=120798) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:23:40.124065 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-378a2425-53f9-4f3b-88eb-3bdd203157aa tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "614d2fa1-b9eb-4747-9d64-9cd687484655"}} {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 07:23:40.126424 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.compute.api [None req-378a2425-53f9-4f3b-88eb-3bdd203157aa tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] [instance: 409e70de-71fb-4ecd-ad90-41217f78bd4d] Fetching instance by UUID {{(pid=120798) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:23:40.133525 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-378a2425-53f9-4f3b-88eb-3bdd203157aa tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:23:40.133992 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-378a2425-53f9-4f3b-88eb-3bdd203157aa tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:23:40.134417 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-378a2425-53f9-4f3b-88eb-3bdd203157aa tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:23:40.135080 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-378a2425-53f9-4f3b-88eb-3bdd203157aa tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:23:40.135550 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-378a2425-53f9-4f3b-88eb-3bdd203157aa tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:23:40.135955 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-378a2425-53f9-4f3b-88eb-3bdd203157aa tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:23:40.400954 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [None req-378a2425-53f9-4f3b-88eb-3bdd203157aa tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] 10.222.0.17 "POST /compute/v2.1/servers/409e70de-71fb-4ecd-ad90-41217f78bd4d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.283509 Aug 23 07:23:40.401567 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 442/908] 10.222.0.17 () {60 vars in 1323 bytes} [Tue Aug 23 07:23:40 2022] POST /compute/v2.1/servers/409e70de-71fb-4ecd-ad90-41217f78bd4d/os-volume_attachments => generated 194 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 07:23:46.918016 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-43514b54-2cf9-4100-b0a3-0d8c29e5ec18 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 07:23:46.924600 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-43514b54-2cf9-4100-b0a3-0d8c29e5ec18 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:23:46.925076 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-43514b54-2cf9-4100-b0a3-0d8c29e5ec18 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:23:46.925500 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-43514b54-2cf9-4100-b0a3-0d8c29e5ec18 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:23:46.986648 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.compute.api [None req-43514b54-2cf9-4100-b0a3-0d8c29e5ec18 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] [instance: 409e70de-71fb-4ecd-ad90-41217f78bd4d] Going to try to stop instance {{(pid=120799) force_stop /opt/stack/nova/nova/compute/api.py:2749}} Aug 23 07:23:47.035653 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-43514b54-2cf9-4100-b0a3-0d8c29e5ec18 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] 10.222.0.17 "POST /compute/v2.1/servers/409e70de-71fb-4ecd-ad90-41217f78bd4d/action" status: 202 len: 0 microversion: 2.1 time: 0.121058 Aug 23 07:23:47.036576 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 467/909] 10.222.0.17 () {60 vars in 1278 bytes} [Tue Aug 23 07:23:46 2022] POST /compute/v2.1/servers/409e70de-71fb-4ecd-ad90-41217f78bd4d/action => generated 0 bytes in 123 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 07:23:47.046348 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-349401f4-9668-45c3-a1e9-f719731ad873 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Calling method '>' {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:23:47.046975 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.compute.api [None req-349401f4-9668-45c3-a1e9-f719731ad873 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] [instance: 409e70de-71fb-4ecd-ad90-41217f78bd4d] Fetching instance by UUID {{(pid=120798) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:23:47.053801 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-349401f4-9668-45c3-a1e9-f719731ad873 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:23:47.054289 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-349401f4-9668-45c3-a1e9-f719731ad873 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:23:47.054725 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-349401f4-9668-45c3-a1e9-f719731ad873 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:23:47.055506 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-349401f4-9668-45c3-a1e9-f719731ad873 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:23:47.056014 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-349401f4-9668-45c3-a1e9-f719731ad873 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:23:47.056449 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-349401f4-9668-45c3-a1e9-f719731ad873 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:23:47.195631 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.policy [None req-349401f4-9668-45c3-a1e9-f719731ad873 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbf1799461f6485ea88d25d89559906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfc6e299d69345a3be46c0052d914742', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120798) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:23:47.204080 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [None req-349401f4-9668-45c3-a1e9-f719731ad873 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] 10.222.0.17 "GET /compute/v2.1/servers/409e70de-71fb-4ecd-ad90-41217f78bd4d" status: 200 len: 1725 microversion: 2.1 time: 0.162573 Aug 23 07:23:47.204632 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 443/910] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:23:47 2022] GET /compute/v2.1/servers/409e70de-71fb-4ecd-ad90-41217f78bd4d => generated 1725 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:23:48.234584 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-2e09470b-691a-4c6a-a273-62862bbea988 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Calling method '>' {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:23:48.235761 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.compute.api [None req-2e09470b-691a-4c6a-a273-62862bbea988 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] [instance: 409e70de-71fb-4ecd-ad90-41217f78bd4d] Fetching instance by UUID {{(pid=120799) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:23:48.244015 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-2e09470b-691a-4c6a-a273-62862bbea988 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:23:48.244497 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-2e09470b-691a-4c6a-a273-62862bbea988 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:23:48.244932 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-2e09470b-691a-4c6a-a273-62862bbea988 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:23:48.245613 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-2e09470b-691a-4c6a-a273-62862bbea988 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:23:48.246064 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-2e09470b-691a-4c6a-a273-62862bbea988 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:23:48.246482 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-2e09470b-691a-4c6a-a273-62862bbea988 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:23:48.385450 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.policy [None req-2e09470b-691a-4c6a-a273-62862bbea988 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbf1799461f6485ea88d25d89559906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfc6e299d69345a3be46c0052d914742', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120799) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:23:48.394007 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-2e09470b-691a-4c6a-a273-62862bbea988 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] 10.222.0.17 "GET /compute/v2.1/servers/409e70de-71fb-4ecd-ad90-41217f78bd4d" status: 200 len: 1725 microversion: 2.1 time: 0.168009 Aug 23 07:23:48.394545 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 468/911] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:23:48 2022] GET /compute/v2.1/servers/409e70de-71fb-4ecd-ad90-41217f78bd4d => generated 1725 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:23:49.417151 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-868a0a03-c06e-4861-85dc-8785e32d6731 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Calling method '>' {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:23:49.418126 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.compute.api [None req-868a0a03-c06e-4861-85dc-8785e32d6731 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] [instance: 409e70de-71fb-4ecd-ad90-41217f78bd4d] Fetching instance by UUID {{(pid=120798) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:23:49.427821 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-868a0a03-c06e-4861-85dc-8785e32d6731 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:23:49.428344 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-868a0a03-c06e-4861-85dc-8785e32d6731 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:23:49.428783 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-868a0a03-c06e-4861-85dc-8785e32d6731 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:23:49.429480 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-868a0a03-c06e-4861-85dc-8785e32d6731 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:23:49.429936 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-868a0a03-c06e-4861-85dc-8785e32d6731 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:23:49.430362 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-868a0a03-c06e-4861-85dc-8785e32d6731 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:23:49.574477 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.policy [None req-868a0a03-c06e-4861-85dc-8785e32d6731 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbf1799461f6485ea88d25d89559906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfc6e299d69345a3be46c0052d914742', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120798) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:23:49.587498 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [None req-868a0a03-c06e-4861-85dc-8785e32d6731 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] 10.222.0.17 "GET /compute/v2.1/servers/409e70de-71fb-4ecd-ad90-41217f78bd4d" status: 200 len: 1725 microversion: 2.1 time: 0.176045 Aug 23 07:23:49.588130 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 444/912] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:23:49 2022] GET /compute/v2.1/servers/409e70de-71fb-4ecd-ad90-41217f78bd4d => generated 1725 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:23:50.609171 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-ad2287d2-5b2d-4d89-8e04-dec6d092d2b0 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Calling method '>' {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:23:50.609790 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.compute.api [None req-ad2287d2-5b2d-4d89-8e04-dec6d092d2b0 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] [instance: 409e70de-71fb-4ecd-ad90-41217f78bd4d] Fetching instance by UUID {{(pid=120799) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:23:50.616612 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-ad2287d2-5b2d-4d89-8e04-dec6d092d2b0 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:23:50.617098 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-ad2287d2-5b2d-4d89-8e04-dec6d092d2b0 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:23:50.617531 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-ad2287d2-5b2d-4d89-8e04-dec6d092d2b0 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:23:50.618218 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-ad2287d2-5b2d-4d89-8e04-dec6d092d2b0 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:23:50.618668 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-ad2287d2-5b2d-4d89-8e04-dec6d092d2b0 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:23:50.619103 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-ad2287d2-5b2d-4d89-8e04-dec6d092d2b0 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:23:50.759939 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.policy [None req-ad2287d2-5b2d-4d89-8e04-dec6d092d2b0 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbf1799461f6485ea88d25d89559906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfc6e299d69345a3be46c0052d914742', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120799) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:23:50.768457 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-ad2287d2-5b2d-4d89-8e04-dec6d092d2b0 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] 10.222.0.17 "GET /compute/v2.1/servers/409e70de-71fb-4ecd-ad90-41217f78bd4d" status: 200 len: 1725 microversion: 2.1 time: 0.163387 Aug 23 07:23:50.769020 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 469/913] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:23:50 2022] GET /compute/v2.1/servers/409e70de-71fb-4ecd-ad90-41217f78bd4d => generated 1725 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:23:51.791191 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-b6931cd1-bc2b-422f-9755-7d4e7d54b497 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Calling method '>' {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:23:51.791825 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.compute.api [None req-b6931cd1-bc2b-422f-9755-7d4e7d54b497 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] [instance: 409e70de-71fb-4ecd-ad90-41217f78bd4d] Fetching instance by UUID {{(pid=120798) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:23:51.798978 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-b6931cd1-bc2b-422f-9755-7d4e7d54b497 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:23:51.799458 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-b6931cd1-bc2b-422f-9755-7d4e7d54b497 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:23:51.799920 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-b6931cd1-bc2b-422f-9755-7d4e7d54b497 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:23:51.800661 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-b6931cd1-bc2b-422f-9755-7d4e7d54b497 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:23:51.801112 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-b6931cd1-bc2b-422f-9755-7d4e7d54b497 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:23:51.801535 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-b6931cd1-bc2b-422f-9755-7d4e7d54b497 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:23:51.942053 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.policy [None req-b6931cd1-bc2b-422f-9755-7d4e7d54b497 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbf1799461f6485ea88d25d89559906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfc6e299d69345a3be46c0052d914742', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120798) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:23:51.951098 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [None req-b6931cd1-bc2b-422f-9755-7d4e7d54b497 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] 10.222.0.17 "GET /compute/v2.1/servers/409e70de-71fb-4ecd-ad90-41217f78bd4d" status: 200 len: 1725 microversion: 2.1 time: 0.164219 Aug 23 07:23:51.951708 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 445/914] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:23:51 2022] GET /compute/v2.1/servers/409e70de-71fb-4ecd-ad90-41217f78bd4d => generated 1725 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:23:52.973506 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-2a9e9298-0bab-42ad-bb86-6840344412b3 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Calling method '>' {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:23:52.974075 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.compute.api [None req-2a9e9298-0bab-42ad-bb86-6840344412b3 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] [instance: 409e70de-71fb-4ecd-ad90-41217f78bd4d] Fetching instance by UUID {{(pid=120799) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:23:52.981709 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-2a9e9298-0bab-42ad-bb86-6840344412b3 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:23:52.982195 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-2a9e9298-0bab-42ad-bb86-6840344412b3 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:23:52.982627 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-2a9e9298-0bab-42ad-bb86-6840344412b3 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:23:52.983324 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-2a9e9298-0bab-42ad-bb86-6840344412b3 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:23:52.983805 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-2a9e9298-0bab-42ad-bb86-6840344412b3 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:23:52.984226 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-2a9e9298-0bab-42ad-bb86-6840344412b3 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:23:53.116301 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.policy [None req-2a9e9298-0bab-42ad-bb86-6840344412b3 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbf1799461f6485ea88d25d89559906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfc6e299d69345a3be46c0052d914742', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120799) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:23:53.126153 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-2a9e9298-0bab-42ad-bb86-6840344412b3 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] 10.222.0.17 "GET /compute/v2.1/servers/409e70de-71fb-4ecd-ad90-41217f78bd4d" status: 200 len: 1725 microversion: 2.1 time: 0.157166 Aug 23 07:23:53.126681 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 470/915] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:23:52 2022] GET /compute/v2.1/servers/409e70de-71fb-4ecd-ad90-41217f78bd4d => generated 1725 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:23:54.153095 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-e325c65f-9ba5-44e0-ba4b-be1c68cbc65b tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Calling method '>' {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:23:54.153949 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.compute.api [None req-e325c65f-9ba5-44e0-ba4b-be1c68cbc65b tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] [instance: 409e70de-71fb-4ecd-ad90-41217f78bd4d] Fetching instance by UUID {{(pid=120798) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:23:54.162265 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-e325c65f-9ba5-44e0-ba4b-be1c68cbc65b tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:23:54.162863 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-e325c65f-9ba5-44e0-ba4b-be1c68cbc65b tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:23:54.163461 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-e325c65f-9ba5-44e0-ba4b-be1c68cbc65b tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:23:54.164330 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-e325c65f-9ba5-44e0-ba4b-be1c68cbc65b tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:23:54.164886 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-e325c65f-9ba5-44e0-ba4b-be1c68cbc65b tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:23:54.165412 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-e325c65f-9ba5-44e0-ba4b-be1c68cbc65b tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:23:54.312019 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.policy [None req-e325c65f-9ba5-44e0-ba4b-be1c68cbc65b tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbf1799461f6485ea88d25d89559906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfc6e299d69345a3be46c0052d914742', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120798) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:23:54.324408 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [None req-e325c65f-9ba5-44e0-ba4b-be1c68cbc65b tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] 10.222.0.17 "GET /compute/v2.1/servers/409e70de-71fb-4ecd-ad90-41217f78bd4d" status: 200 len: 1725 microversion: 2.1 time: 0.177864 Aug 23 07:23:54.325149 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 446/916] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:23:54 2022] GET /compute/v2.1/servers/409e70de-71fb-4ecd-ad90-41217f78bd4d => generated 1725 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:23:55.353271 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-66fe8166-926d-48ff-a08d-c0a2127779f9 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Calling method '>' {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:23:55.353917 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.compute.api [None req-66fe8166-926d-48ff-a08d-c0a2127779f9 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] [instance: 409e70de-71fb-4ecd-ad90-41217f78bd4d] Fetching instance by UUID {{(pid=120799) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:23:55.361234 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-66fe8166-926d-48ff-a08d-c0a2127779f9 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:23:55.361717 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-66fe8166-926d-48ff-a08d-c0a2127779f9 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:23:55.362151 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-66fe8166-926d-48ff-a08d-c0a2127779f9 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:23:55.362837 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-66fe8166-926d-48ff-a08d-c0a2127779f9 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:23:55.363280 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-66fe8166-926d-48ff-a08d-c0a2127779f9 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:23:55.363726 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-66fe8166-926d-48ff-a08d-c0a2127779f9 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:23:55.513679 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.policy [None req-66fe8166-926d-48ff-a08d-c0a2127779f9 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbf1799461f6485ea88d25d89559906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfc6e299d69345a3be46c0052d914742', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120799) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:23:55.525576 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-66fe8166-926d-48ff-a08d-c0a2127779f9 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] 10.222.0.17 "GET /compute/v2.1/servers/409e70de-71fb-4ecd-ad90-41217f78bd4d" status: 200 len: 1725 microversion: 2.1 time: 0.177477 Aug 23 07:23:55.526300 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 471/917] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:23:55 2022] GET /compute/v2.1/servers/409e70de-71fb-4ecd-ad90-41217f78bd4d => generated 1725 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:23:56.551150 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-6e925d27-088c-4096-9ae9-a4a97ccf4295 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Calling method '>' {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:23:56.552152 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.compute.api [None req-6e925d27-088c-4096-9ae9-a4a97ccf4295 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] [instance: 409e70de-71fb-4ecd-ad90-41217f78bd4d] Fetching instance by UUID {{(pid=120798) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:23:56.560423 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-6e925d27-088c-4096-9ae9-a4a97ccf4295 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:23:56.560903 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-6e925d27-088c-4096-9ae9-a4a97ccf4295 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:23:56.561328 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-6e925d27-088c-4096-9ae9-a4a97ccf4295 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:23:56.562012 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-6e925d27-088c-4096-9ae9-a4a97ccf4295 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:23:56.562459 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-6e925d27-088c-4096-9ae9-a4a97ccf4295 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:23:56.562884 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-6e925d27-088c-4096-9ae9-a4a97ccf4295 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:23:56.708470 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.policy [None req-6e925d27-088c-4096-9ae9-a4a97ccf4295 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbf1799461f6485ea88d25d89559906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfc6e299d69345a3be46c0052d914742', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120798) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:23:56.717535 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [None req-6e925d27-088c-4096-9ae9-a4a97ccf4295 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] 10.222.0.17 "GET /compute/v2.1/servers/409e70de-71fb-4ecd-ad90-41217f78bd4d" status: 200 len: 1725 microversion: 2.1 time: 0.172936 Aug 23 07:23:56.718099 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 447/918] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:23:56 2022] GET /compute/v2.1/servers/409e70de-71fb-4ecd-ad90-41217f78bd4d => generated 1725 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:23:57.744232 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-40110c13-23dd-4cdb-bf09-e103b0fb3c1b tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Calling method '>' {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:23:57.745218 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.compute.api [None req-40110c13-23dd-4cdb-bf09-e103b0fb3c1b tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] [instance: 409e70de-71fb-4ecd-ad90-41217f78bd4d] Fetching instance by UUID {{(pid=120799) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:23:57.755983 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-40110c13-23dd-4cdb-bf09-e103b0fb3c1b tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:23:57.756777 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-40110c13-23dd-4cdb-bf09-e103b0fb3c1b tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:23:57.757749 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-40110c13-23dd-4cdb-bf09-e103b0fb3c1b tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:23:57.758469 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-40110c13-23dd-4cdb-bf09-e103b0fb3c1b tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:23:57.758910 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-40110c13-23dd-4cdb-bf09-e103b0fb3c1b tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:23:57.759327 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-40110c13-23dd-4cdb-bf09-e103b0fb3c1b tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:23:57.909023 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.policy [None req-40110c13-23dd-4cdb-bf09-e103b0fb3c1b tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbf1799461f6485ea88d25d89559906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfc6e299d69345a3be46c0052d914742', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120799) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:23:57.921525 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-40110c13-23dd-4cdb-bf09-e103b0fb3c1b tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] 10.222.0.17 "GET /compute/v2.1/servers/409e70de-71fb-4ecd-ad90-41217f78bd4d" status: 200 len: 1725 microversion: 2.1 time: 0.184080 Aug 23 07:23:57.922200 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 472/919] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:23:57 2022] GET /compute/v2.1/servers/409e70de-71fb-4ecd-ad90-41217f78bd4d => generated 1725 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:23:58.948640 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-481961a8-b952-4963-92d3-186f41d47d5d tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Calling method '>' {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:23:58.949218 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.compute.api [None req-481961a8-b952-4963-92d3-186f41d47d5d tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] [instance: 409e70de-71fb-4ecd-ad90-41217f78bd4d] Fetching instance by UUID {{(pid=120798) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:23:58.959182 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-481961a8-b952-4963-92d3-186f41d47d5d tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:23:58.959774 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-481961a8-b952-4963-92d3-186f41d47d5d tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:23:58.960255 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-481961a8-b952-4963-92d3-186f41d47d5d tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:23:58.961244 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-481961a8-b952-4963-92d3-186f41d47d5d tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:23:58.961767 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-481961a8-b952-4963-92d3-186f41d47d5d tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:23:58.962312 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-481961a8-b952-4963-92d3-186f41d47d5d tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:23:59.117313 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.policy [None req-481961a8-b952-4963-92d3-186f41d47d5d tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbf1799461f6485ea88d25d89559906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfc6e299d69345a3be46c0052d914742', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120798) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:23:59.130869 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [None req-481961a8-b952-4963-92d3-186f41d47d5d tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] 10.222.0.17 "GET /compute/v2.1/servers/409e70de-71fb-4ecd-ad90-41217f78bd4d" status: 200 len: 1725 microversion: 2.1 time: 0.188846 Aug 23 07:23:59.131873 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 448/920] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:23:58 2022] GET /compute/v2.1/servers/409e70de-71fb-4ecd-ad90-41217f78bd4d => generated 1725 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:24:00.155339 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-1bc1fe87-0df2-43c8-aed5-db414aad7589 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Calling method '>' {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:24:00.155931 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.compute.api [None req-1bc1fe87-0df2-43c8-aed5-db414aad7589 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] [instance: 409e70de-71fb-4ecd-ad90-41217f78bd4d] Fetching instance by UUID {{(pid=120799) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:24:00.162919 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-1bc1fe87-0df2-43c8-aed5-db414aad7589 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:24:00.163388 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-1bc1fe87-0df2-43c8-aed5-db414aad7589 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:24:00.163837 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-1bc1fe87-0df2-43c8-aed5-db414aad7589 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:24:00.164514 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-1bc1fe87-0df2-43c8-aed5-db414aad7589 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:24:00.164982 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-1bc1fe87-0df2-43c8-aed5-db414aad7589 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:24:00.165373 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-1bc1fe87-0df2-43c8-aed5-db414aad7589 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:24:00.310350 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.policy [None req-1bc1fe87-0df2-43c8-aed5-db414aad7589 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbf1799461f6485ea88d25d89559906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfc6e299d69345a3be46c0052d914742', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120799) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:24:00.319050 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-1bc1fe87-0df2-43c8-aed5-db414aad7589 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] 10.222.0.17 "GET /compute/v2.1/servers/409e70de-71fb-4ecd-ad90-41217f78bd4d" status: 200 len: 1725 microversion: 2.1 time: 0.167677 Aug 23 07:24:00.319689 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 473/921] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:24:00 2022] GET /compute/v2.1/servers/409e70de-71fb-4ecd-ad90-41217f78bd4d => generated 1725 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:24:01.345242 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-b179433e-b532-4640-a74b-13fa41d8271d tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Calling method '>' {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:24:01.345890 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.compute.api [None req-b179433e-b532-4640-a74b-13fa41d8271d tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] [instance: 409e70de-71fb-4ecd-ad90-41217f78bd4d] Fetching instance by UUID {{(pid=120798) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:24:01.355746 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-b179433e-b532-4640-a74b-13fa41d8271d tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:24:01.356215 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-b179433e-b532-4640-a74b-13fa41d8271d tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:24:01.356651 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-b179433e-b532-4640-a74b-13fa41d8271d tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:24:01.357347 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-b179433e-b532-4640-a74b-13fa41d8271d tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:24:01.357803 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-b179433e-b532-4640-a74b-13fa41d8271d tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:24:01.358231 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-b179433e-b532-4640-a74b-13fa41d8271d tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:24:01.500184 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.policy [None req-b179433e-b532-4640-a74b-13fa41d8271d tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbf1799461f6485ea88d25d89559906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfc6e299d69345a3be46c0052d914742', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120798) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:24:01.512589 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [None req-b179433e-b532-4640-a74b-13fa41d8271d tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] 10.222.0.17 "GET /compute/v2.1/servers/409e70de-71fb-4ecd-ad90-41217f78bd4d" status: 200 len: 1725 microversion: 2.1 time: 0.174181 Aug 23 07:24:01.513119 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 449/922] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:24:01 2022] GET /compute/v2.1/servers/409e70de-71fb-4ecd-ad90-41217f78bd4d => generated 1725 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:24:02.534088 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-8ea8fba2-f79e-4dbb-aa85-856dd18c4a30 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Calling method '>' {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:24:02.534866 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.compute.api [None req-8ea8fba2-f79e-4dbb-aa85-856dd18c4a30 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] [instance: 409e70de-71fb-4ecd-ad90-41217f78bd4d] Fetching instance by UUID {{(pid=120799) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:24:02.542498 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-8ea8fba2-f79e-4dbb-aa85-856dd18c4a30 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:24:02.543024 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-8ea8fba2-f79e-4dbb-aa85-856dd18c4a30 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:24:02.543539 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-8ea8fba2-f79e-4dbb-aa85-856dd18c4a30 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:24:02.544290 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-8ea8fba2-f79e-4dbb-aa85-856dd18c4a30 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:24:02.544786 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-8ea8fba2-f79e-4dbb-aa85-856dd18c4a30 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:24:02.545250 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-8ea8fba2-f79e-4dbb-aa85-856dd18c4a30 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:24:02.689312 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.policy [None req-8ea8fba2-f79e-4dbb-aa85-856dd18c4a30 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbf1799461f6485ea88d25d89559906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfc6e299d69345a3be46c0052d914742', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120799) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:24:02.697594 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-8ea8fba2-f79e-4dbb-aa85-856dd18c4a30 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] 10.222.0.17 "GET /compute/v2.1/servers/409e70de-71fb-4ecd-ad90-41217f78bd4d" status: 200 len: 1725 microversion: 2.1 time: 0.167890 Aug 23 07:24:02.698510 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 474/923] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:24:02 2022] GET /compute/v2.1/servers/409e70de-71fb-4ecd-ad90-41217f78bd4d => generated 1725 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:24:03.721382 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-59870945-c8e3-4a52-946d-3bccb3ed3dcc tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Calling method '>' {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:24:03.721961 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.compute.api [None req-59870945-c8e3-4a52-946d-3bccb3ed3dcc tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] [instance: 409e70de-71fb-4ecd-ad90-41217f78bd4d] Fetching instance by UUID {{(pid=120798) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:24:03.731243 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-59870945-c8e3-4a52-946d-3bccb3ed3dcc tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:24:03.731759 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-59870945-c8e3-4a52-946d-3bccb3ed3dcc tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:24:03.732215 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-59870945-c8e3-4a52-946d-3bccb3ed3dcc tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:24:03.732934 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-59870945-c8e3-4a52-946d-3bccb3ed3dcc tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:24:03.733384 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-59870945-c8e3-4a52-946d-3bccb3ed3dcc tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:24:03.733806 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-59870945-c8e3-4a52-946d-3bccb3ed3dcc tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:24:03.867071 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.policy [None req-59870945-c8e3-4a52-946d-3bccb3ed3dcc tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbf1799461f6485ea88d25d89559906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfc6e299d69345a3be46c0052d914742', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120798) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:24:03.875729 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [None req-59870945-c8e3-4a52-946d-3bccb3ed3dcc tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] 10.222.0.17 "GET /compute/v2.1/servers/409e70de-71fb-4ecd-ad90-41217f78bd4d" status: 200 len: 1725 microversion: 2.1 time: 0.160903 Aug 23 07:24:03.876263 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 450/924] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:24:03 2022] GET /compute/v2.1/servers/409e70de-71fb-4ecd-ad90-41217f78bd4d => generated 1725 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:24:04.901382 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-c9b095da-b627-4434-8025-ab7e453aff9c tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Calling method '>' {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:24:04.902334 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.compute.api [None req-c9b095da-b627-4434-8025-ab7e453aff9c tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] [instance: 409e70de-71fb-4ecd-ad90-41217f78bd4d] Fetching instance by UUID {{(pid=120799) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:24:04.910087 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-c9b095da-b627-4434-8025-ab7e453aff9c tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:24:04.910573 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-c9b095da-b627-4434-8025-ab7e453aff9c tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:24:04.910999 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-c9b095da-b627-4434-8025-ab7e453aff9c tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:24:04.911790 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-c9b095da-b627-4434-8025-ab7e453aff9c tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:24:04.912158 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-c9b095da-b627-4434-8025-ab7e453aff9c tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:24:04.912581 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-c9b095da-b627-4434-8025-ab7e453aff9c tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:24:05.054925 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.policy [None req-c9b095da-b627-4434-8025-ab7e453aff9c tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbf1799461f6485ea88d25d89559906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfc6e299d69345a3be46c0052d914742', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120799) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:24:05.065597 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-c9b095da-b627-4434-8025-ab7e453aff9c tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] 10.222.0.17 "GET /compute/v2.1/servers/409e70de-71fb-4ecd-ad90-41217f78bd4d" status: 200 len: 1725 microversion: 2.1 time: 0.170934 Aug 23 07:24:05.066164 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 475/925] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:24:04 2022] GET /compute/v2.1/servers/409e70de-71fb-4ecd-ad90-41217f78bd4d => generated 1725 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:24:06.090877 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-c4fb2f8a-f71b-412b-90e7-56586985ac33 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Calling method '>' {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:24:06.091829 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.compute.api [None req-c4fb2f8a-f71b-412b-90e7-56586985ac33 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] [instance: 409e70de-71fb-4ecd-ad90-41217f78bd4d] Fetching instance by UUID {{(pid=120798) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:24:06.100278 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-c4fb2f8a-f71b-412b-90e7-56586985ac33 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:24:06.100771 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-c4fb2f8a-f71b-412b-90e7-56586985ac33 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:24:06.101210 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-c4fb2f8a-f71b-412b-90e7-56586985ac33 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:24:06.101915 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-c4fb2f8a-f71b-412b-90e7-56586985ac33 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:24:06.102401 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-c4fb2f8a-f71b-412b-90e7-56586985ac33 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:24:06.102824 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-c4fb2f8a-f71b-412b-90e7-56586985ac33 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:24:06.238621 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.policy [None req-c4fb2f8a-f71b-412b-90e7-56586985ac33 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbf1799461f6485ea88d25d89559906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfc6e299d69345a3be46c0052d914742', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120798) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:24:06.247296 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [None req-c4fb2f8a-f71b-412b-90e7-56586985ac33 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] 10.222.0.17 "GET /compute/v2.1/servers/409e70de-71fb-4ecd-ad90-41217f78bd4d" status: 200 len: 1725 microversion: 2.1 time: 0.163259 Aug 23 07:24:06.247946 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 451/926] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:24:06 2022] GET /compute/v2.1/servers/409e70de-71fb-4ecd-ad90-41217f78bd4d => generated 1725 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:24:07.272033 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-92628eed-946e-4ef9-b187-cccc004a049e tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Calling method '>' {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:24:07.272894 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.compute.api [None req-92628eed-946e-4ef9-b187-cccc004a049e tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] [instance: 409e70de-71fb-4ecd-ad90-41217f78bd4d] Fetching instance by UUID {{(pid=120799) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:24:07.283277 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-92628eed-946e-4ef9-b187-cccc004a049e tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:24:07.284126 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-92628eed-946e-4ef9-b187-cccc004a049e tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:24:07.284788 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-92628eed-946e-4ef9-b187-cccc004a049e tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:24:07.285890 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-92628eed-946e-4ef9-b187-cccc004a049e tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:24:07.286583 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-92628eed-946e-4ef9-b187-cccc004a049e tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:24:07.287229 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-92628eed-946e-4ef9-b187-cccc004a049e tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:24:07.432283 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.policy [None req-92628eed-946e-4ef9-b187-cccc004a049e tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbf1799461f6485ea88d25d89559906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfc6e299d69345a3be46c0052d914742', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120799) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:24:07.444966 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-92628eed-946e-4ef9-b187-cccc004a049e tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] 10.222.0.17 "GET /compute/v2.1/servers/409e70de-71fb-4ecd-ad90-41217f78bd4d" status: 200 len: 1725 microversion: 2.1 time: 0.178570 Aug 23 07:24:07.445678 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 476/927] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:24:07 2022] GET /compute/v2.1/servers/409e70de-71fb-4ecd-ad90-41217f78bd4d => generated 1725 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:24:08.470590 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-707dd5b9-8e2f-4487-be9d-331726b6a731 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Calling method '>' {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:24:08.471232 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.compute.api [None req-707dd5b9-8e2f-4487-be9d-331726b6a731 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] [instance: 409e70de-71fb-4ecd-ad90-41217f78bd4d] Fetching instance by UUID {{(pid=120798) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:24:08.478121 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-707dd5b9-8e2f-4487-be9d-331726b6a731 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:24:08.478600 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-707dd5b9-8e2f-4487-be9d-331726b6a731 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:24:08.479025 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-707dd5b9-8e2f-4487-be9d-331726b6a731 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:24:08.479736 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-707dd5b9-8e2f-4487-be9d-331726b6a731 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:24:08.480181 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-707dd5b9-8e2f-4487-be9d-331726b6a731 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:24:08.480592 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-707dd5b9-8e2f-4487-be9d-331726b6a731 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:24:08.615033 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.policy [None req-707dd5b9-8e2f-4487-be9d-331726b6a731 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbf1799461f6485ea88d25d89559906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfc6e299d69345a3be46c0052d914742', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120798) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:24:08.624041 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [None req-707dd5b9-8e2f-4487-be9d-331726b6a731 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] 10.222.0.17 "GET /compute/v2.1/servers/409e70de-71fb-4ecd-ad90-41217f78bd4d" status: 200 len: 1702 microversion: 2.1 time: 0.158977 Aug 23 07:24:08.624573 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 452/928] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:24:08 2022] GET /compute/v2.1/servers/409e70de-71fb-4ecd-ad90-41217f78bd4d => generated 1702 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:24:08.647500 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-c59439f8-2b39-4e14-bc71-7081349bf9b7 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 07:24:08.650574 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG dbcounter [-] [120799] Writing DB stats nova_api:SELECT=23 {{(pid=120799) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:24:08.656050 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-c59439f8-2b39-4e14-bc71-7081349bf9b7 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:24:08.656646 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-c59439f8-2b39-4e14-bc71-7081349bf9b7 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:24:08.657422 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-c59439f8-2b39-4e14-bc71-7081349bf9b7 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:24:08.661798 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG dbcounter [-] [120799] Writing DB stats nova_cell1:SELECT=69,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120799) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:24:08.685087 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.compute.api [None req-c59439f8-2b39-4e14-bc71-7081349bf9b7 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] [instance: 409e70de-71fb-4ecd-ad90-41217f78bd4d] Going to try to start instance {{(pid=120799) start /opt/stack/nova/nova/compute/api.py:2772}} Aug 23 07:24:08.730591 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-c59439f8-2b39-4e14-bc71-7081349bf9b7 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] 10.222.0.17 "POST /compute/v2.1/servers/409e70de-71fb-4ecd-ad90-41217f78bd4d/action" status: 202 len: 0 microversion: 2.1 time: 0.089428 Aug 23 07:24:08.731119 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 477/929] 10.222.0.17 () {60 vars in 1278 bytes} [Tue Aug 23 07:24:08 2022] POST /compute/v2.1/servers/409e70de-71fb-4ecd-ad90-41217f78bd4d/action => generated 0 bytes in 91 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 07:24:08.739737 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-f4976eb4-3443-40bc-8eb5-03cb7484bf8a tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Calling method '>' {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:24:08.740425 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.compute.api [None req-f4976eb4-3443-40bc-8eb5-03cb7484bf8a tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] [instance: 409e70de-71fb-4ecd-ad90-41217f78bd4d] Fetching instance by UUID {{(pid=120798) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:24:08.746633 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-f4976eb4-3443-40bc-8eb5-03cb7484bf8a tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:24:08.747219 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-f4976eb4-3443-40bc-8eb5-03cb7484bf8a tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:24:08.747740 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-f4976eb4-3443-40bc-8eb5-03cb7484bf8a tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:24:08.748863 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-f4976eb4-3443-40bc-8eb5-03cb7484bf8a tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:24:08.749330 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-f4976eb4-3443-40bc-8eb5-03cb7484bf8a tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:24:08.749810 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-f4976eb4-3443-40bc-8eb5-03cb7484bf8a tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:24:09.147844 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.policy [None req-f4976eb4-3443-40bc-8eb5-03cb7484bf8a tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbf1799461f6485ea88d25d89559906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfc6e299d69345a3be46c0052d914742', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120798) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:24:09.156166 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [None req-f4976eb4-3443-40bc-8eb5-03cb7484bf8a tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] 10.222.0.17 "GET /compute/v2.1/servers/409e70de-71fb-4ecd-ad90-41217f78bd4d" status: 200 len: 1711 microversion: 2.1 time: 0.420523 Aug 23 07:24:09.156874 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 453/930] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:24:08 2022] GET /compute/v2.1/servers/409e70de-71fb-4ecd-ad90-41217f78bd4d => generated 1711 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:24:10.181290 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-399e4e25-098f-4cee-a18f-6b24cae01e49 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Calling method '>' {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:24:10.182050 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.compute.api [None req-399e4e25-098f-4cee-a18f-6b24cae01e49 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] [instance: 409e70de-71fb-4ecd-ad90-41217f78bd4d] Fetching instance by UUID {{(pid=120799) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:24:10.190677 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-399e4e25-098f-4cee-a18f-6b24cae01e49 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:24:10.191203 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-399e4e25-098f-4cee-a18f-6b24cae01e49 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:24:10.191670 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-399e4e25-098f-4cee-a18f-6b24cae01e49 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:24:10.192582 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-399e4e25-098f-4cee-a18f-6b24cae01e49 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:24:10.193308 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-399e4e25-098f-4cee-a18f-6b24cae01e49 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:24:10.193755 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-399e4e25-098f-4cee-a18f-6b24cae01e49 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:24:10.339927 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.policy [None req-399e4e25-098f-4cee-a18f-6b24cae01e49 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbf1799461f6485ea88d25d89559906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfc6e299d69345a3be46c0052d914742', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120799) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:24:10.353404 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-399e4e25-098f-4cee-a18f-6b24cae01e49 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] 10.222.0.17 "GET /compute/v2.1/servers/409e70de-71fb-4ecd-ad90-41217f78bd4d" status: 200 len: 1715 microversion: 2.1 time: 0.177188 Aug 23 07:24:10.354086 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 478/931] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:24:10 2022] GET /compute/v2.1/servers/409e70de-71fb-4ecd-ad90-41217f78bd4d => generated 1715 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:24:42.748666 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-a7400cc4-442d-4722-b1b9-0ccf0b74eb85 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Calling method '>' {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:24:42.749248 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.compute.api [None req-a7400cc4-442d-4722-b1b9-0ccf0b74eb85 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] [instance: 409e70de-71fb-4ecd-ad90-41217f78bd4d] Fetching instance by UUID {{(pid=120798) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:24:42.751314 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG dbcounter [-] [120798] Writing DB stats nova_api:SELECT=24 {{(pid=120798) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:24:42.751949 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG dbcounter [-] [120798] Writing DB stats nova_cell1:SELECT=77,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120798) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:24:42.757911 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-a7400cc4-442d-4722-b1b9-0ccf0b74eb85 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:24:42.758414 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-a7400cc4-442d-4722-b1b9-0ccf0b74eb85 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:24:42.758849 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-a7400cc4-442d-4722-b1b9-0ccf0b74eb85 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:24:42.759556 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-a7400cc4-442d-4722-b1b9-0ccf0b74eb85 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:24:42.760004 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-a7400cc4-442d-4722-b1b9-0ccf0b74eb85 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:24:42.760428 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-a7400cc4-442d-4722-b1b9-0ccf0b74eb85 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:24:42.863447 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.objects.instance [None req-a7400cc4-442d-4722-b1b9-0ccf0b74eb85 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Lazy-loading 'services' on Instance uuid 409e70de-71fb-4ecd-ad90-41217f78bd4d {{(pid=120798) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 07:24:42.947954 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [None req-a7400cc4-442d-4722-b1b9-0ccf0b74eb85 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] 10.222.0.17 "DELETE /compute/v2.1/servers/409e70de-71fb-4ecd-ad90-41217f78bd4d/os-volume_attachments/614d2fa1-b9eb-4747-9d64-9cd687484655" status: 202 len: 0 microversion: 2.1 time: 0.203473 Aug 23 07:24:42.948548 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 454/932] 10.222.0.17 () {58 vars in 1416 bytes} [Tue Aug 23 07:24:42 2022] DELETE /compute/v2.1/servers/409e70de-71fb-4ecd-ad90-41217f78bd4d/os-volume_attachments/614d2fa1-b9eb-4747-9d64-9cd687484655 => generated 0 bytes in 205 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 07:24:44.074858 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-ca44b226-f44e-4dd8-b1bf-d19872b1607d tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 07:24:44.077306 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG dbcounter [-] [120799] Writing DB stats nova_api:SELECT=3 {{(pid=120799) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:24:44.077960 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG dbcounter [-] [120799] Writing DB stats nova_cell1:SELECT=15,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120799) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:24:44.083896 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-ca44b226-f44e-4dd8-b1bf-d19872b1607d tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:24:44.084370 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-ca44b226-f44e-4dd8-b1bf-d19872b1607d tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:24:44.084797 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-ca44b226-f44e-4dd8-b1bf-d19872b1607d tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:24:44.108283 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.compute.api [None req-ca44b226-f44e-4dd8-b1bf-d19872b1607d tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] [instance: 409e70de-71fb-4ecd-ad90-41217f78bd4d] Going to try to stop instance {{(pid=120799) force_stop /opt/stack/nova/nova/compute/api.py:2749}} Aug 23 07:24:44.159292 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-ca44b226-f44e-4dd8-b1bf-d19872b1607d tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] 10.222.0.17 "POST /compute/v2.1/servers/409e70de-71fb-4ecd-ad90-41217f78bd4d/action" status: 202 len: 0 microversion: 2.1 time: 0.088599 Aug 23 07:24:44.160076 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 479/933] 10.222.0.17 () {60 vars in 1278 bytes} [Tue Aug 23 07:24:44 2022] POST /compute/v2.1/servers/409e70de-71fb-4ecd-ad90-41217f78bd4d/action => generated 0 bytes in 91 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 07:24:44.170082 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-e7271d33-e872-4fb7-99d6-597d8e1fe7a1 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Calling method '>' {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:24:44.170952 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.compute.api [None req-e7271d33-e872-4fb7-99d6-597d8e1fe7a1 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] [instance: 409e70de-71fb-4ecd-ad90-41217f78bd4d] Fetching instance by UUID {{(pid=120798) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:24:44.177854 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-e7271d33-e872-4fb7-99d6-597d8e1fe7a1 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:24:44.178307 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-e7271d33-e872-4fb7-99d6-597d8e1fe7a1 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:24:44.178795 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-e7271d33-e872-4fb7-99d6-597d8e1fe7a1 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:24:44.179517 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-e7271d33-e872-4fb7-99d6-597d8e1fe7a1 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:24:44.179962 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-e7271d33-e872-4fb7-99d6-597d8e1fe7a1 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:24:44.180381 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-e7271d33-e872-4fb7-99d6-597d8e1fe7a1 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:24:44.335225 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.policy [None req-e7271d33-e872-4fb7-99d6-597d8e1fe7a1 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbf1799461f6485ea88d25d89559906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfc6e299d69345a3be46c0052d914742', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120798) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:24:44.343962 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [None req-e7271d33-e872-4fb7-99d6-597d8e1fe7a1 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] 10.222.0.17 "GET /compute/v2.1/servers/409e70de-71fb-4ecd-ad90-41217f78bd4d" status: 200 len: 1679 microversion: 2.1 time: 0.179059 Aug 23 07:24:44.344610 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 455/934] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:24:44 2022] GET /compute/v2.1/servers/409e70de-71fb-4ecd-ad90-41217f78bd4d => generated 1679 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:24:45.372254 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-229a96bd-062c-4136-98d8-36a61d3ef97e tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Calling method '>' {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:24:45.372943 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.compute.api [None req-229a96bd-062c-4136-98d8-36a61d3ef97e tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] [instance: 409e70de-71fb-4ecd-ad90-41217f78bd4d] Fetching instance by UUID {{(pid=120799) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:24:45.379781 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-229a96bd-062c-4136-98d8-36a61d3ef97e tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:24:45.380266 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-229a96bd-062c-4136-98d8-36a61d3ef97e tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:24:45.380779 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-229a96bd-062c-4136-98d8-36a61d3ef97e tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:24:45.381464 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-229a96bd-062c-4136-98d8-36a61d3ef97e tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:24:45.381917 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-229a96bd-062c-4136-98d8-36a61d3ef97e tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:24:45.382337 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-229a96bd-062c-4136-98d8-36a61d3ef97e tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:24:45.535094 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.policy [None req-229a96bd-062c-4136-98d8-36a61d3ef97e tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbf1799461f6485ea88d25d89559906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfc6e299d69345a3be46c0052d914742', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120799) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:24:45.545704 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-229a96bd-062c-4136-98d8-36a61d3ef97e tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] 10.222.0.17 "GET /compute/v2.1/servers/409e70de-71fb-4ecd-ad90-41217f78bd4d" status: 200 len: 1679 microversion: 2.1 time: 0.179963 Aug 23 07:24:45.546330 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 480/935] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:24:45 2022] GET /compute/v2.1/servers/409e70de-71fb-4ecd-ad90-41217f78bd4d => generated 1679 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:24:46.571880 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-942cc647-c09e-4bbe-a7bf-87327dff264d tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Calling method '>' {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:24:46.572447 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.compute.api [None req-942cc647-c09e-4bbe-a7bf-87327dff264d tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] [instance: 409e70de-71fb-4ecd-ad90-41217f78bd4d] Fetching instance by UUID {{(pid=120798) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:24:46.579440 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-942cc647-c09e-4bbe-a7bf-87327dff264d tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:24:46.580004 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-942cc647-c09e-4bbe-a7bf-87327dff264d tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:24:46.580467 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-942cc647-c09e-4bbe-a7bf-87327dff264d tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:24:46.581166 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-942cc647-c09e-4bbe-a7bf-87327dff264d tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:24:46.581621 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-942cc647-c09e-4bbe-a7bf-87327dff264d tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:24:46.582029 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-942cc647-c09e-4bbe-a7bf-87327dff264d tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:24:46.714511 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.policy [None req-942cc647-c09e-4bbe-a7bf-87327dff264d tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbf1799461f6485ea88d25d89559906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfc6e299d69345a3be46c0052d914742', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120798) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:24:46.723131 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [None req-942cc647-c09e-4bbe-a7bf-87327dff264d tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] 10.222.0.17 "GET /compute/v2.1/servers/409e70de-71fb-4ecd-ad90-41217f78bd4d" status: 200 len: 1679 microversion: 2.1 time: 0.158592 Aug 23 07:24:46.723729 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 456/936] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:24:46 2022] GET /compute/v2.1/servers/409e70de-71fb-4ecd-ad90-41217f78bd4d => generated 1679 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:24:47.746093 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-93642be3-87b1-4d88-9416-a358fedf0f6f tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Calling method '>' {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:24:47.746723 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.compute.api [None req-93642be3-87b1-4d88-9416-a358fedf0f6f tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] [instance: 409e70de-71fb-4ecd-ad90-41217f78bd4d] Fetching instance by UUID {{(pid=120799) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:24:47.753623 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-93642be3-87b1-4d88-9416-a358fedf0f6f tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:24:47.754097 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-93642be3-87b1-4d88-9416-a358fedf0f6f tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:24:47.754519 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-93642be3-87b1-4d88-9416-a358fedf0f6f tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:24:47.755206 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-93642be3-87b1-4d88-9416-a358fedf0f6f tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:24:47.755672 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-93642be3-87b1-4d88-9416-a358fedf0f6f tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:24:47.756087 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-93642be3-87b1-4d88-9416-a358fedf0f6f tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:24:47.895804 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.policy [None req-93642be3-87b1-4d88-9416-a358fedf0f6f tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbf1799461f6485ea88d25d89559906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfc6e299d69345a3be46c0052d914742', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120799) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:24:47.903798 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-93642be3-87b1-4d88-9416-a358fedf0f6f tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] 10.222.0.17 "GET /compute/v2.1/servers/409e70de-71fb-4ecd-ad90-41217f78bd4d" status: 200 len: 1679 microversion: 2.1 time: 0.162384 Aug 23 07:24:47.904367 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 481/937] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:24:47 2022] GET /compute/v2.1/servers/409e70de-71fb-4ecd-ad90-41217f78bd4d => generated 1679 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:24:48.929457 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-c59acef2-aeae-4ce2-8475-2f8ee1ae6ba4 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Calling method '>' {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:24:48.930453 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.compute.api [None req-c59acef2-aeae-4ce2-8475-2f8ee1ae6ba4 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] [instance: 409e70de-71fb-4ecd-ad90-41217f78bd4d] Fetching instance by UUID {{(pid=120798) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:24:48.937458 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-c59acef2-aeae-4ce2-8475-2f8ee1ae6ba4 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:24:48.937882 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-c59acef2-aeae-4ce2-8475-2f8ee1ae6ba4 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:24:48.938306 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-c59acef2-aeae-4ce2-8475-2f8ee1ae6ba4 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:24:48.938987 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-c59acef2-aeae-4ce2-8475-2f8ee1ae6ba4 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:24:48.939445 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-c59acef2-aeae-4ce2-8475-2f8ee1ae6ba4 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:24:48.939887 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-c59acef2-aeae-4ce2-8475-2f8ee1ae6ba4 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:24:49.086431 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.policy [None req-c59acef2-aeae-4ce2-8475-2f8ee1ae6ba4 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbf1799461f6485ea88d25d89559906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfc6e299d69345a3be46c0052d914742', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120798) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:24:49.094516 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [None req-c59acef2-aeae-4ce2-8475-2f8ee1ae6ba4 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] 10.222.0.17 "GET /compute/v2.1/servers/409e70de-71fb-4ecd-ad90-41217f78bd4d" status: 200 len: 1679 microversion: 2.1 time: 0.171722 Aug 23 07:24:49.095078 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 457/938] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:24:48 2022] GET /compute/v2.1/servers/409e70de-71fb-4ecd-ad90-41217f78bd4d => generated 1679 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:24:50.116396 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-48ed64f7-8e83-4dd5-bcb2-7943d77b8a97 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Calling method '>' {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:24:50.116942 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.compute.api [None req-48ed64f7-8e83-4dd5-bcb2-7943d77b8a97 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] [instance: 409e70de-71fb-4ecd-ad90-41217f78bd4d] Fetching instance by UUID {{(pid=120799) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:24:50.123892 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-48ed64f7-8e83-4dd5-bcb2-7943d77b8a97 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:24:50.124368 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-48ed64f7-8e83-4dd5-bcb2-7943d77b8a97 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:24:50.124797 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-48ed64f7-8e83-4dd5-bcb2-7943d77b8a97 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:24:50.125489 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-48ed64f7-8e83-4dd5-bcb2-7943d77b8a97 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:24:50.125933 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-48ed64f7-8e83-4dd5-bcb2-7943d77b8a97 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:24:50.126356 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-48ed64f7-8e83-4dd5-bcb2-7943d77b8a97 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:24:50.259355 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.policy [None req-48ed64f7-8e83-4dd5-bcb2-7943d77b8a97 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbf1799461f6485ea88d25d89559906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfc6e299d69345a3be46c0052d914742', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120799) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:24:50.267566 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-48ed64f7-8e83-4dd5-bcb2-7943d77b8a97 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] 10.222.0.17 "GET /compute/v2.1/servers/409e70de-71fb-4ecd-ad90-41217f78bd4d" status: 200 len: 1679 microversion: 2.1 time: 0.155116 Aug 23 07:24:50.268131 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 482/939] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:24:50 2022] GET /compute/v2.1/servers/409e70de-71fb-4ecd-ad90-41217f78bd4d => generated 1679 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:24:51.293562 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-f71ba5a4-16f7-49e6-8830-08e14051ad7d tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Calling method '>' {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:24:51.294482 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.compute.api [None req-f71ba5a4-16f7-49e6-8830-08e14051ad7d tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] [instance: 409e70de-71fb-4ecd-ad90-41217f78bd4d] Fetching instance by UUID {{(pid=120798) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:24:51.305672 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-f71ba5a4-16f7-49e6-8830-08e14051ad7d tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:24:51.306197 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-f71ba5a4-16f7-49e6-8830-08e14051ad7d tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:24:51.306640 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-f71ba5a4-16f7-49e6-8830-08e14051ad7d tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:24:51.307325 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-f71ba5a4-16f7-49e6-8830-08e14051ad7d tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:24:51.307799 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-f71ba5a4-16f7-49e6-8830-08e14051ad7d tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:24:51.308218 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-f71ba5a4-16f7-49e6-8830-08e14051ad7d tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:24:51.442060 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.policy [None req-f71ba5a4-16f7-49e6-8830-08e14051ad7d tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbf1799461f6485ea88d25d89559906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfc6e299d69345a3be46c0052d914742', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120798) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:24:51.453919 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [None req-f71ba5a4-16f7-49e6-8830-08e14051ad7d tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] 10.222.0.17 "GET /compute/v2.1/servers/409e70de-71fb-4ecd-ad90-41217f78bd4d" status: 200 len: 1679 microversion: 2.1 time: 0.166923 Aug 23 07:24:51.454563 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 458/940] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:24:51 2022] GET /compute/v2.1/servers/409e70de-71fb-4ecd-ad90-41217f78bd4d => generated 1679 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:24:52.475403 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-fe2af07d-4413-46a1-82f9-568833c05479 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Calling method '>' {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:24:52.476017 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.compute.api [None req-fe2af07d-4413-46a1-82f9-568833c05479 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] [instance: 409e70de-71fb-4ecd-ad90-41217f78bd4d] Fetching instance by UUID {{(pid=120799) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:24:52.482826 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-fe2af07d-4413-46a1-82f9-568833c05479 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:24:52.483309 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-fe2af07d-4413-46a1-82f9-568833c05479 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:24:52.483776 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-fe2af07d-4413-46a1-82f9-568833c05479 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:24:52.484458 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-fe2af07d-4413-46a1-82f9-568833c05479 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:24:52.484910 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-fe2af07d-4413-46a1-82f9-568833c05479 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:24:52.485334 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-fe2af07d-4413-46a1-82f9-568833c05479 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:24:52.630865 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.policy [None req-fe2af07d-4413-46a1-82f9-568833c05479 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbf1799461f6485ea88d25d89559906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfc6e299d69345a3be46c0052d914742', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120799) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:24:52.639682 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-fe2af07d-4413-46a1-82f9-568833c05479 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] 10.222.0.17 "GET /compute/v2.1/servers/409e70de-71fb-4ecd-ad90-41217f78bd4d" status: 200 len: 1679 microversion: 2.1 time: 0.168197 Aug 23 07:24:52.640256 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 483/941] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:24:52 2022] GET /compute/v2.1/servers/409e70de-71fb-4ecd-ad90-41217f78bd4d => generated 1679 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:24:53.661674 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-f559c1f7-1a6a-4a7b-af12-cba0ccdb0a77 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Calling method '>' {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:24:53.662275 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.compute.api [None req-f559c1f7-1a6a-4a7b-af12-cba0ccdb0a77 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] [instance: 409e70de-71fb-4ecd-ad90-41217f78bd4d] Fetching instance by UUID {{(pid=120798) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:24:53.668833 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-f559c1f7-1a6a-4a7b-af12-cba0ccdb0a77 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:24:53.669310 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-f559c1f7-1a6a-4a7b-af12-cba0ccdb0a77 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:24:53.669735 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-f559c1f7-1a6a-4a7b-af12-cba0ccdb0a77 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:24:53.670425 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-f559c1f7-1a6a-4a7b-af12-cba0ccdb0a77 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:24:53.670869 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-f559c1f7-1a6a-4a7b-af12-cba0ccdb0a77 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:24:53.671285 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-f559c1f7-1a6a-4a7b-af12-cba0ccdb0a77 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:24:53.809257 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.policy [None req-f559c1f7-1a6a-4a7b-af12-cba0ccdb0a77 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbf1799461f6485ea88d25d89559906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfc6e299d69345a3be46c0052d914742', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120798) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:24:53.821560 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [None req-f559c1f7-1a6a-4a7b-af12-cba0ccdb0a77 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] 10.222.0.17 "GET /compute/v2.1/servers/409e70de-71fb-4ecd-ad90-41217f78bd4d" status: 200 len: 1679 microversion: 2.1 time: 0.163735 Aug 23 07:24:53.822217 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 459/942] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:24:53 2022] GET /compute/v2.1/servers/409e70de-71fb-4ecd-ad90-41217f78bd4d => generated 1679 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:24:54.847205 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-877c7617-dced-4eee-9dee-6153dc5484ac tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Calling method '>' {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:24:54.848220 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.compute.api [None req-877c7617-dced-4eee-9dee-6153dc5484ac tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] [instance: 409e70de-71fb-4ecd-ad90-41217f78bd4d] Fetching instance by UUID {{(pid=120799) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:24:54.856883 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-877c7617-dced-4eee-9dee-6153dc5484ac tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:24:54.857344 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-877c7617-dced-4eee-9dee-6153dc5484ac tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:24:54.857769 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-877c7617-dced-4eee-9dee-6153dc5484ac tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:24:54.858444 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-877c7617-dced-4eee-9dee-6153dc5484ac tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:24:54.858889 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-877c7617-dced-4eee-9dee-6153dc5484ac tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:24:54.859321 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-877c7617-dced-4eee-9dee-6153dc5484ac tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:24:54.998746 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.policy [None req-877c7617-dced-4eee-9dee-6153dc5484ac tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbf1799461f6485ea88d25d89559906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfc6e299d69345a3be46c0052d914742', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120799) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:24:55.011329 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-877c7617-dced-4eee-9dee-6153dc5484ac tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] 10.222.0.17 "GET /compute/v2.1/servers/409e70de-71fb-4ecd-ad90-41217f78bd4d" status: 200 len: 1656 microversion: 2.1 time: 0.170622 Aug 23 07:24:55.012237 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 484/943] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:24:54 2022] GET /compute/v2.1/servers/409e70de-71fb-4ecd-ad90-41217f78bd4d => generated 1656 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:24:55.036917 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-0fefd4ee-7ff0-4288-a187-11235746b04d tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 07:24:55.044338 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-0fefd4ee-7ff0-4288-a187-11235746b04d tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:24:55.044822 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-0fefd4ee-7ff0-4288-a187-11235746b04d tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:24:55.045254 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-0fefd4ee-7ff0-4288-a187-11235746b04d tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:24:55.106980 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.compute.api [None req-0fefd4ee-7ff0-4288-a187-11235746b04d tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] [instance: 409e70de-71fb-4ecd-ad90-41217f78bd4d] Going to try to start instance {{(pid=120798) start /opt/stack/nova/nova/compute/api.py:2772}} Aug 23 07:24:55.153240 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [None req-0fefd4ee-7ff0-4288-a187-11235746b04d tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] 10.222.0.17 "POST /compute/v2.1/servers/409e70de-71fb-4ecd-ad90-41217f78bd4d/action" status: 202 len: 0 microversion: 2.1 time: 0.120166 Aug 23 07:24:55.154001 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 460/944] 10.222.0.17 () {60 vars in 1278 bytes} [Tue Aug 23 07:24:55 2022] POST /compute/v2.1/servers/409e70de-71fb-4ecd-ad90-41217f78bd4d/action => generated 0 bytes in 122 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 07:24:55.162726 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-59519020-ce6c-4415-a534-9430100024bc tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Calling method '>' {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:24:55.163354 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.compute.api [None req-59519020-ce6c-4415-a534-9430100024bc tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] [instance: 409e70de-71fb-4ecd-ad90-41217f78bd4d] Fetching instance by UUID {{(pid=120799) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:24:55.169699 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-59519020-ce6c-4415-a534-9430100024bc tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:24:55.170195 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-59519020-ce6c-4415-a534-9430100024bc tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:24:55.170604 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-59519020-ce6c-4415-a534-9430100024bc tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:24:55.171370 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-59519020-ce6c-4415-a534-9430100024bc tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:24:55.171873 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-59519020-ce6c-4415-a534-9430100024bc tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:24:55.172260 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-59519020-ce6c-4415-a534-9430100024bc tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:24:55.311209 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.policy [None req-59519020-ce6c-4415-a534-9430100024bc tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbf1799461f6485ea88d25d89559906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfc6e299d69345a3be46c0052d914742', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120799) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:24:55.319205 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-59519020-ce6c-4415-a534-9430100024bc tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] 10.222.0.17 "GET /compute/v2.1/servers/409e70de-71fb-4ecd-ad90-41217f78bd4d" status: 200 len: 1665 microversion: 2.1 time: 0.160584 Aug 23 07:24:55.319866 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 485/945] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:24:55 2022] GET /compute/v2.1/servers/409e70de-71fb-4ecd-ad90-41217f78bd4d => generated 1665 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:24:56.346776 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-99966a56-8387-45cb-b05b-4983aa581582 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Calling method '>' {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:24:56.347944 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.compute.api [None req-99966a56-8387-45cb-b05b-4983aa581582 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] [instance: 409e70de-71fb-4ecd-ad90-41217f78bd4d] Fetching instance by UUID {{(pid=120798) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:24:56.357071 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-99966a56-8387-45cb-b05b-4983aa581582 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:24:56.357605 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-99966a56-8387-45cb-b05b-4983aa581582 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:24:56.358031 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-99966a56-8387-45cb-b05b-4983aa581582 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:24:56.358720 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-99966a56-8387-45cb-b05b-4983aa581582 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:24:56.359171 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-99966a56-8387-45cb-b05b-4983aa581582 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:24:56.359597 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-99966a56-8387-45cb-b05b-4983aa581582 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:24:56.502788 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.policy [None req-99966a56-8387-45cb-b05b-4983aa581582 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbf1799461f6485ea88d25d89559906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfc6e299d69345a3be46c0052d914742', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120798) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:24:56.511033 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [None req-99966a56-8387-45cb-b05b-4983aa581582 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] 10.222.0.17 "GET /compute/v2.1/servers/409e70de-71fb-4ecd-ad90-41217f78bd4d" status: 200 len: 1669 microversion: 2.1 time: 0.171745 Aug 23 07:24:56.511618 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 461/946] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:24:56 2022] GET /compute/v2.1/servers/409e70de-71fb-4ecd-ad90-41217f78bd4d => generated 1669 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:25:28.717564 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-075eddf0-d1c2-4150-a762-9015b55ba10f tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Calling method '>' {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:25:28.719975 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.compute.api [None req-075eddf0-d1c2-4150-a762-9015b55ba10f tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] [instance: 409e70de-71fb-4ecd-ad90-41217f78bd4d] Fetching instance by UUID {{(pid=120799) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:25:28.723929 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG dbcounter [-] [120799] Writing DB stats nova_api:SELECT=14 {{(pid=120799) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:25:28.724616 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG dbcounter [-] [120799] Writing DB stats nova_cell1:SELECT=46,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120799) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:25:28.729861 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-075eddf0-d1c2-4150-a762-9015b55ba10f tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:25:28.730518 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-075eddf0-d1c2-4150-a762-9015b55ba10f tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:25:28.731156 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-075eddf0-d1c2-4150-a762-9015b55ba10f tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:25:28.732211 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-075eddf0-d1c2-4150-a762-9015b55ba10f tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:25:28.732910 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-075eddf0-d1c2-4150-a762-9015b55ba10f tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:25:28.733531 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-075eddf0-d1c2-4150-a762-9015b55ba10f tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:25:28.767321 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-075eddf0-d1c2-4150-a762-9015b55ba10f tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] 10.222.0.17 "GET /compute/v2.1/servers/409e70de-71fb-4ecd-ad90-41217f78bd4d/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.055456 Aug 23 07:25:28.767941 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 486/947] 10.222.0.17 () {58 vars in 1302 bytes} [Tue Aug 23 07:25:28 2022] GET /compute/v2.1/servers/409e70de-71fb-4ecd-ad90-41217f78bd4d/os-volume_attachments => generated 25 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 23 07:25:28.832830 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-6c0b5f09-9e01-46e5-9695-54c3f25a81f7 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Calling method '>' {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:25:28.833407 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.compute.api [None req-6c0b5f09-9e01-46e5-9695-54c3f25a81f7 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] [instance: 409e70de-71fb-4ecd-ad90-41217f78bd4d] Fetching instance by UUID {{(pid=120798) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:25:28.835865 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG dbcounter [-] [120798] Writing DB stats nova_api:SELECT=16 {{(pid=120798) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:25:28.836529 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG dbcounter [-] [120798] Writing DB stats nova_cell1:SELECT=55,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120798) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:25:28.842711 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-6c0b5f09-9e01-46e5-9695-54c3f25a81f7 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:25:28.843193 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-6c0b5f09-9e01-46e5-9695-54c3f25a81f7 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:25:28.843666 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-6c0b5f09-9e01-46e5-9695-54c3f25a81f7 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:25:28.844357 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-6c0b5f09-9e01-46e5-9695-54c3f25a81f7 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:25:28.844811 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-6c0b5f09-9e01-46e5-9695-54c3f25a81f7 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:25:28.845234 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-6c0b5f09-9e01-46e5-9695-54c3f25a81f7 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:25:28.872352 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.compute.api [None req-6c0b5f09-9e01-46e5-9695-54c3f25a81f7 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] [instance: 409e70de-71fb-4ecd-ad90-41217f78bd4d] Going to try to terminate instance {{(pid=120798) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 07:25:28.954659 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [None req-6c0b5f09-9e01-46e5-9695-54c3f25a81f7 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] 10.222.0.17 "DELETE /compute/v2.1/servers/409e70de-71fb-4ecd-ad90-41217f78bd4d" status: 204 len: 0 microversion: 2.1 time: 0.125349 Aug 23 07:25:28.955320 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 462/948] 10.222.0.17 () {58 vars in 1239 bytes} [Tue Aug 23 07:25:28 2022] DELETE /compute/v2.1/servers/409e70de-71fb-4ecd-ad90-41217f78bd4d => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 23 07:25:28.964176 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-b0fbb265-50d0-45aa-be63-aea33f18b301 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Calling method '>' {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:25:28.964776 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.compute.api [None req-b0fbb265-50d0-45aa-be63-aea33f18b301 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] [instance: 409e70de-71fb-4ecd-ad90-41217f78bd4d] Fetching instance by UUID {{(pid=120799) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:25:28.972868 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-b0fbb265-50d0-45aa-be63-aea33f18b301 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:25:28.973326 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-b0fbb265-50d0-45aa-be63-aea33f18b301 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:25:28.973758 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-b0fbb265-50d0-45aa-be63-aea33f18b301 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:25:28.974442 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-b0fbb265-50d0-45aa-be63-aea33f18b301 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:25:28.975362 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-b0fbb265-50d0-45aa-be63-aea33f18b301 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:25:28.975821 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-b0fbb265-50d0-45aa-be63-aea33f18b301 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:25:29.126541 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.policy [None req-b0fbb265-50d0-45aa-be63-aea33f18b301 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbf1799461f6485ea88d25d89559906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfc6e299d69345a3be46c0052d914742', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120799) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:25:29.134789 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-b0fbb265-50d0-45aa-be63-aea33f18b301 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] 10.222.0.17 "GET /compute/v2.1/servers/409e70de-71fb-4ecd-ad90-41217f78bd4d" status: 200 len: 1675 microversion: 2.1 time: 0.174514 Aug 23 07:25:29.135349 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 487/949] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:25:28 2022] GET /compute/v2.1/servers/409e70de-71fb-4ecd-ad90-41217f78bd4d => generated 1675 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:25:30.160678 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-f7927ae0-2e87-4b8d-a239-292c35cec1c4 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Calling method '>' {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:25:30.161841 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.compute.api [None req-f7927ae0-2e87-4b8d-a239-292c35cec1c4 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] [instance: 409e70de-71fb-4ecd-ad90-41217f78bd4d] Fetching instance by UUID {{(pid=120798) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:25:30.169011 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-f7927ae0-2e87-4b8d-a239-292c35cec1c4 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:25:30.169492 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-f7927ae0-2e87-4b8d-a239-292c35cec1c4 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:25:30.169924 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-f7927ae0-2e87-4b8d-a239-292c35cec1c4 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:25:30.170607 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-f7927ae0-2e87-4b8d-a239-292c35cec1c4 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:25:30.171050 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-f7927ae0-2e87-4b8d-a239-292c35cec1c4 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:25:30.171473 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-f7927ae0-2e87-4b8d-a239-292c35cec1c4 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:25:30.316820 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.policy [None req-f7927ae0-2e87-4b8d-a239-292c35cec1c4 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbf1799461f6485ea88d25d89559906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfc6e299d69345a3be46c0052d914742', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120798) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:25:30.330751 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [None req-f7927ae0-2e87-4b8d-a239-292c35cec1c4 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] 10.222.0.17 "GET /compute/v2.1/servers/409e70de-71fb-4ecd-ad90-41217f78bd4d" status: 200 len: 1675 microversion: 2.1 time: 0.176490 Aug 23 07:25:30.331852 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 463/950] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:25:30 2022] GET /compute/v2.1/servers/409e70de-71fb-4ecd-ad90-41217f78bd4d => generated 1675 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:25:31.354207 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-a2956634-e2fe-4dca-ab9e-11789c774e83 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Calling method '>' {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:25:31.354817 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.compute.api [None req-a2956634-e2fe-4dca-ab9e-11789c774e83 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] [instance: 409e70de-71fb-4ecd-ad90-41217f78bd4d] Fetching instance by UUID {{(pid=120799) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:25:31.361629 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-a2956634-e2fe-4dca-ab9e-11789c774e83 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:25:31.362111 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-a2956634-e2fe-4dca-ab9e-11789c774e83 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:25:31.362535 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-a2956634-e2fe-4dca-ab9e-11789c774e83 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:25:31.363223 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-a2956634-e2fe-4dca-ab9e-11789c774e83 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:25:31.363693 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-a2956634-e2fe-4dca-ab9e-11789c774e83 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:25:31.364107 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-a2956634-e2fe-4dca-ab9e-11789c774e83 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:25:31.503443 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.policy [None req-a2956634-e2fe-4dca-ab9e-11789c774e83 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbf1799461f6485ea88d25d89559906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfc6e299d69345a3be46c0052d914742', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120799) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:25:31.511385 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-a2956634-e2fe-4dca-ab9e-11789c774e83 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] 10.222.0.17 "GET /compute/v2.1/servers/409e70de-71fb-4ecd-ad90-41217f78bd4d" status: 200 len: 1675 microversion: 2.1 time: 0.161308 Aug 23 07:25:31.512179 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 488/951] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:25:31 2022] GET /compute/v2.1/servers/409e70de-71fb-4ecd-ad90-41217f78bd4d => generated 1675 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:25:31.916944 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [req-9e4de3a3-2691-49b2-8d89-facd23a2defc req-dbb7b40b-2dc9-4af1-8ca1-f7741cb523dc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "409e70de-71fb-4ecd-ad90-41217f78bd4d", "name": "network-vif-deleted", "tag": "31769f6b-7f3f-474d-8c5c-af6f1e507baa"}]} {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 07:25:31.928852 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [req-9e4de3a3-2691-49b2-8d89-facd23a2defc req-dbb7b40b-2dc9-4af1-8ca1-f7741cb523dc service nova] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:25:31.929331 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [req-9e4de3a3-2691-49b2-8d89-facd23a2defc req-dbb7b40b-2dc9-4af1-8ca1-f7741cb523dc service nova] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:25:31.929756 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [req-9e4de3a3-2691-49b2-8d89-facd23a2defc req-dbb7b40b-2dc9-4af1-8ca1-f7741cb523dc service nova] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:25:31.942307 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.compute.server_external_events [req-9e4de3a3-2691-49b2-8d89-facd23a2defc req-dbb7b40b-2dc9-4af1-8ca1-f7741cb523dc service nova] Creating event network-vif-deleted:31769f6b-7f3f-474d-8c5c-af6f1e507baa for instance 409e70de-71fb-4ecd-ad90-41217f78bd4d on hv-cinder-85409 Aug 23 07:25:31.949486 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [req-9e4de3a3-2691-49b2-8d89-facd23a2defc req-dbb7b40b-2dc9-4af1-8ca1-f7741cb523dc service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036619 Aug 23 07:25:31.950420 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 464/952] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Aug 23 07:25:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 07:25:32.533699 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-6357cd9f-a95b-4981-ade0-1cdcb54dc8b3 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Calling method '>' {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:25:32.534281 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.compute.api [None req-6357cd9f-a95b-4981-ade0-1cdcb54dc8b3 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] [instance: 409e70de-71fb-4ecd-ad90-41217f78bd4d] Fetching instance by UUID {{(pid=120799) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:25:32.543213 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-6357cd9f-a95b-4981-ade0-1cdcb54dc8b3 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:25:32.543756 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-6357cd9f-a95b-4981-ade0-1cdcb54dc8b3 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:25:32.544189 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-6357cd9f-a95b-4981-ade0-1cdcb54dc8b3 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:25:32.545050 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-6357cd9f-a95b-4981-ade0-1cdcb54dc8b3 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:25:32.545500 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-6357cd9f-a95b-4981-ade0-1cdcb54dc8b3 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:25:32.545941 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-6357cd9f-a95b-4981-ade0-1cdcb54dc8b3 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:25:32.560095 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.wsgi [None req-6357cd9f-a95b-4981-ade0-1cdcb54dc8b3 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] HTTP exception thrown: Instance 409e70de-71fb-4ecd-ad90-41217f78bd4d could not be found. Aug 23 07:25:32.561755 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-6357cd9f-a95b-4981-ade0-1cdcb54dc8b3 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Request method failure captured: Aug 23 07:25:32.561755 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: request: GET /compute/v2.1/servers/409e70de-71fb-4ecd-ad90-41217f78bd4d HTTP/1.1 Aug 23 07:25:32.561755 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: Accept: application/json Aug 23 07:25:32.561755 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: Accept-Encoding: identity Aug 23 07:25:32.561755 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: Connection: close Aug 23 07:25:32.561755 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: Content-Length: 0 Aug 23 07:25:32.561755 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: Content-Type: application/json Aug 23 07:25:32.561755 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: Host: 10.222.0.17 Aug 23 07:25:32.561755 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: Openstack-System-Scope: None Aug 23 07:25:32.561755 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: User-Agent: python-urllib3/1.26.11 Aug 23 07:25:32.561755 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-Auth-Token: gAAAAABjBIBJmq6DHW-A2gYFbcOZnE0AbMbwzDvaDD00PoMw7P9dN4LNRmvj31Vqy4o7YIhRD5t_muNOh8YX2_IHQlyNuK7pHas57TNyACofXlXg5G7HfNTpHT5F1ckX4B86E5GktCH3onnZ8M4iMtghVxi_FCvM6cE9FD3nJWtekgjTCPFyeMQ Aug 23 07:25:32.561755 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-Domain-Id: None Aug 23 07:25:32.561755 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-Domain-Name: None Aug 23 07:25:32.561755 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-Identity-Status: Confirmed Aug 23 07:25:32.561755 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-Is-Admin-Project: True Aug 23 07:25:32.561755 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-Project-Domain-Id: default Aug 23 07:25:32.561755 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-Project-Domain-Name: Default Aug 23 07:25:32.561755 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-Project-Id: cfc6e299d69345a3be46c0052d914742 Aug 23 07:25:32.561755 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-Project-Name: tempest-AttachVolumeTestJSON-1864346838 Aug 23 07:25:32.561755 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-Role: reader,member Aug 23 07:25:32.561755 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-Roles: reader,member Aug 23 07:25:32.563242 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/cfc6e299d69345a3be46c0052d914742"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/cfc6e299d69345a3be46c0052d914742"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_cfc6e299d69345a3be46c0052d914742"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/cfc6e299d69345a3be46c0052d914742"}]}] Aug 23 07:25:32.563242 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-Tenant: tempest-AttachVolumeTestJSON-1864346838 Aug 23 07:25:32.563242 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-Tenant-Id: cfc6e299d69345a3be46c0052d914742 Aug 23 07:25:32.563242 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1864346838 Aug 23 07:25:32.563242 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-User: tempest-AttachVolumeTestJSON-1864346838-project Aug 23 07:25:32.563242 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-User-Domain-Id: default Aug 23 07:25:32.563242 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-User-Domain-Name: Default Aug 23 07:25:32.563242 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-User-Id: dbf1799461f6485ea88d25d89559906e Aug 23 07:25:32.563242 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-User-Name: tempest-AttachVolumeTestJSON-1864346838-project Aug 23 07:25:32.563242 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: method: > Aug 23 07:25:32.563242 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: exception: Instance 409e70de-71fb-4ecd-ad90-41217f78bd4d could not be found. Aug 23 07:25:32.563242 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: action_args: {'id': '409e70de-71fb-4ecd-ad90-41217f78bd4d'} Aug 23 07:25:32.564593 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 07:25:32.564593 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 07:25:32.564593 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 07:25:32.564593 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 07:25:32.564593 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 07:25:32.564593 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 07:25:32.564593 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 07:25:32.564593 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 07:25:32.564593 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 07:25:32.564593 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 07:25:32.564593 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 409e70de-71fb-4ecd-ad90-41217f78bd4d could not be found. Aug 23 07:25:32.564593 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi Aug 23 07:25:32.564593 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 07:25:32.564593 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi Aug 23 07:25:32.564593 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 07:25:32.564593 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 07:25:32.564593 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 07:25:32.564593 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 07:25:32.564593 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 07:25:32.564593 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 07:25:32.565916 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 07:25:32.565916 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 07:25:32.565916 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 07:25:32.565916 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 07:25:32.565916 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 07:25:32.565916 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 07:25:32.565916 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 07:25:32.565916 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 409e70de-71fb-4ecd-ad90-41217f78bd4d could not be found. Aug 23 07:25:32.565916 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi Aug 23 07:25:32.565916 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 07:25:32.565916 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi Aug 23 07:25:32.565916 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 07:25:32.565916 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 07:25:32.565916 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 07:25:32.565916 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 07:25:32.565916 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 07:25:32.565916 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 409e70de-71fb-4ecd-ad90-41217f78bd4d could not be found. Aug 23 07:25:32.565916 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi Aug 23 07:25:32.567500 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-6357cd9f-a95b-4981-ade0-1cdcb54dc8b3 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Returning 404 to user: Instance 409e70de-71fb-4ecd-ad90-41217f78bd4d could not be found. {{(pid=120799) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 07:25:32.567500 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-6357cd9f-a95b-4981-ade0-1cdcb54dc8b3 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] 10.222.0.17 "GET /compute/v2.1/servers/409e70de-71fb-4ecd-ad90-41217f78bd4d" status: 404 len: 111 microversion: 2.1 time: 0.034132 Aug 23 07:25:32.567500 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 489/953] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:25:32 2022] GET /compute/v2.1/servers/409e70de-71fb-4ecd-ad90-41217f78bd4d => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 07:25:32.572779 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-3e4949ff-85de-464c-a091-b94d1772cfb8 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Calling method '.version_select at 0x7fe3c55abb80>' {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:25:32.592674 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [None req-3e4949ff-85de-464c-a091-b94d1772cfb8 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1690136964" status: 202 len: 0 microversion: 2.1 time: 0.024021 Aug 23 07:25:32.593277 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 465/954] 10.222.0.17 () {58 vars in 1221 bytes} [Tue Aug 23 07:25:32 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1690136964 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 07:25:33.229303 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-64e83b45-56dd-4d92-b5a4-7c47fbfebedf tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Action: 'create', calling method: .version_select at 0x7fe3c57b5310>, body: {"keypair": {"name": "tempest-keypair-1745845198", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEQmHMUS9wmV2vZ6V670VvR3pq68xHzYEhzqioN+9ptS9PpvNo8rDkqfjmTNBaLIARH1MRnLn9W6boYeFSafiMW07Buv3e2se6cyoYzrYEyTEyWdzH6OtdI0WScf1M2Ybw=="}} {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 07:25:33.245200 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.quota [None req-64e83b45-56dd-4d92-b5a4-7c47fbfebedf tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Getting quotas for project cfc6e299d69345a3be46c0052d914742. Resources: {'key_pairs'} {{(pid=120799) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 07:25:33.248995 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.quota [None req-64e83b45-56dd-4d92-b5a4-7c47fbfebedf tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Getting quotas for user dbf1799461f6485ea88d25d89559906e and project cfc6e299d69345a3be46c0052d914742. Resources: {'key_pairs'} {{(pid=120799) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 07:25:33.261118 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR oslo.messaging._drivers.impl_rabbit [None req-64e83b45-56dd-4d92-b5a4-7c47fbfebedf tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] [71f14fad-44fa-493d-a20d-fb7d59baa9d1] AMQP server on 10.222.0.17:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 23 07:25:34.272568 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO oslo.messaging._drivers.impl_rabbit [None req-64e83b45-56dd-4d92-b5a4-7c47fbfebedf tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] [71f14fad-44fa-493d-a20d-fb7d59baa9d1] Reconnected to AMQP server on 10.222.0.17:5672 via [amqp] client with port 56714. Aug 23 07:25:34.290003 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-64e83b45-56dd-4d92-b5a4-7c47fbfebedf tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 1.064738 Aug 23 07:25:34.290597 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 490/955] 10.222.0.17 () {60 vars in 1159 bytes} [Tue Aug 23 07:25:33 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 1066 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 07:25:35.600646 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-4ae8969a-2e9e-430b-a036-70be6adafd09 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-2020320656", "imageRef": "b899fd65-02ae-4b43-bac7-86f38fc3f224", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "224a8638-16a9-4af0-b7bb-fc84a3d1973a"}], "security_groups": [{"name": "tempest-securitygroup--1117075166"}], "key_name": "tempest-keypair-1745845198", "user_data": "}} {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 07:25:35.710838 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.network.neutron [None req-4ae8969a-2e9e-430b-a036-70be6adafd09 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] validate_networks() for [('224a8638-16a9-4af0-b7bb-fc84a3d1973a', None, None, None, None, None)] {{(pid=120798) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 23 07:25:36.207751 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.virt.hardware [None req-4ae8969a-2e9e-430b-a036-70be6adafd09 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Flavor limits 0:0:0 {{(pid=120798) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 07:25:36.208429 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.virt.hardware [None req-4ae8969a-2e9e-430b-a036-70be6adafd09 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Image limits 0:0:0 {{(pid=120798) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 07:25:36.209280 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.virt.hardware [None req-4ae8969a-2e9e-430b-a036-70be6adafd09 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Flavor pref 0:0:0 {{(pid=120798) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 07:25:36.209707 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.virt.hardware [None req-4ae8969a-2e9e-430b-a036-70be6adafd09 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Image pref 0:0:0 {{(pid=120798) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 07:25:36.210134 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.virt.hardware [None req-4ae8969a-2e9e-430b-a036-70be6adafd09 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120798) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 07:25:36.220271 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-4ae8969a-2e9e-430b-a036-70be6adafd09 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:25:36.220747 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-4ae8969a-2e9e-430b-a036-70be6adafd09 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:25:36.221191 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-4ae8969a-2e9e-430b-a036-70be6adafd09 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:25:36.222283 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-4ae8969a-2e9e-430b-a036-70be6adafd09 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:25:36.222737 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-4ae8969a-2e9e-430b-a036-70be6adafd09 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:25:36.223177 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-4ae8969a-2e9e-430b-a036-70be6adafd09 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:25:36.240595 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.quota [None req-4ae8969a-2e9e-430b-a036-70be6adafd09 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Getting quotas for project cfc6e299d69345a3be46c0052d914742. Resources: {'ram', 'instances', 'cores'} {{(pid=120798) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 07:25:36.244943 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.quota [None req-4ae8969a-2e9e-430b-a036-70be6adafd09 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Getting quotas for user dbf1799461f6485ea88d25d89559906e and project cfc6e299d69345a3be46c0052d914742. Resources: {'ram', 'instances', 'cores'} {{(pid=120798) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 07:25:36.259099 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.compute.api [None req-4ae8969a-2e9e-430b-a036-70be6adafd09 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Going to run 1 instances... {{(pid=120798) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 23 07:25:36.261607 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.compute.api [None req-4ae8969a-2e9e-430b-a036-70be6adafd09 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] [instance: 71485b4e-f619-49d8-87b8-4bdad738d459] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b899fd65-02ae-4b43-bac7-86f38fc3f224',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120798) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 07:25:36.309803 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR oslo.messaging._drivers.impl_rabbit [None req-4ae8969a-2e9e-430b-a036-70be6adafd09 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] [a72ab4a0-f2c8-453f-b3ce-bdb155f32e8d] AMQP server on 10.222.0.17:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 23 07:25:37.322370 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO oslo.messaging._drivers.impl_rabbit [None req-4ae8969a-2e9e-430b-a036-70be6adafd09 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] [a72ab4a0-f2c8-453f-b3ce-bdb155f32e8d] Reconnected to AMQP server on 10.222.0.17:5672 via [amqp] client with port 56742. Aug 23 07:25:37.329526 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [None req-4ae8969a-2e9e-430b-a036-70be6adafd09 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.733953 Aug 23 07:25:37.330698 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 466/956] 10.222.0.17 () {60 vars in 1147 bytes} [Tue Aug 23 07:25:35 2022] POST /compute/v2.1/servers => generated 402 bytes in 1736 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 23 07:25:37.343609 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-f36e1d1f-1720-4d21-a332-45f9d58b96ba tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Calling method '>' {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:25:37.344178 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.compute.api [None req-f36e1d1f-1720-4d21-a332-45f9d58b96ba tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] [instance: 71485b4e-f619-49d8-87b8-4bdad738d459] Fetching instance by UUID {{(pid=120799) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:25:37.398411 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.policy [None req-f36e1d1f-1720-4d21-a332-45f9d58b96ba tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbf1799461f6485ea88d25d89559906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfc6e299d69345a3be46c0052d914742', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120799) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:25:37.405479 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-f36e1d1f-1720-4d21-a332-45f9d58b96ba tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] 10.222.0.17 "GET /compute/v2.1/servers/71485b4e-f619-49d8-87b8-4bdad738d459" status: 200 len: 1238 microversion: 2.1 time: 0.066353 Aug 23 07:25:37.406088 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 491/957] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:25:37 2022] GET /compute/v2.1/servers/71485b4e-f619-49d8-87b8-4bdad738d459 => generated 1238 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:25:38.430296 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-530a415c-c6ee-4261-b38b-a855a412e3f0 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Calling method '>' {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:25:38.430928 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.compute.api [None req-530a415c-c6ee-4261-b38b-a855a412e3f0 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] [instance: 71485b4e-f619-49d8-87b8-4bdad738d459] Fetching instance by UUID {{(pid=120798) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:25:38.438729 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-530a415c-c6ee-4261-b38b-a855a412e3f0 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:25:38.439211 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-530a415c-c6ee-4261-b38b-a855a412e3f0 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:25:38.439763 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-530a415c-c6ee-4261-b38b-a855a412e3f0 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:25:38.440494 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-530a415c-c6ee-4261-b38b-a855a412e3f0 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:25:38.440946 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-530a415c-c6ee-4261-b38b-a855a412e3f0 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:25:38.441370 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-530a415c-c6ee-4261-b38b-a855a412e3f0 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:25:38.521943 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.policy [None req-530a415c-c6ee-4261-b38b-a855a412e3f0 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbf1799461f6485ea88d25d89559906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfc6e299d69345a3be46c0052d914742', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120798) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:25:38.530424 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [None req-530a415c-c6ee-4261-b38b-a855a412e3f0 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] 10.222.0.17 "GET /compute/v2.1/servers/71485b4e-f619-49d8-87b8-4bdad738d459" status: 200 len: 1296 microversion: 2.1 time: 0.107890 Aug 23 07:25:38.531009 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 467/958] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:25:38 2022] GET /compute/v2.1/servers/71485b4e-f619-49d8-87b8-4bdad738d459 => generated 1296 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:25:39.551540 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-b5c22f23-197d-409e-8895-a240ac247312 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Calling method '>' {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:25:39.552162 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.compute.api [None req-b5c22f23-197d-409e-8895-a240ac247312 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] [instance: 71485b4e-f619-49d8-87b8-4bdad738d459] Fetching instance by UUID {{(pid=120799) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:25:39.558967 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-b5c22f23-197d-409e-8895-a240ac247312 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:25:39.559475 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-b5c22f23-197d-409e-8895-a240ac247312 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:25:39.559896 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-b5c22f23-197d-409e-8895-a240ac247312 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:25:39.560585 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-b5c22f23-197d-409e-8895-a240ac247312 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:25:39.561050 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-b5c22f23-197d-409e-8895-a240ac247312 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:25:39.561457 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-b5c22f23-197d-409e-8895-a240ac247312 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:25:39.693948 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [req-c8a73fbb-9460-4645-88d8-8b97678b0380 req-0ba013e9-1727-41e6-ac7b-88b9fe4437c9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "71485b4e-f619-49d8-87b8-4bdad738d459", "tag": "e4dfca50-c07f-425d-91fa-13a85271eafb"}]} {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 07:25:39.697579 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.policy [None req-b5c22f23-197d-409e-8895-a240ac247312 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbf1799461f6485ea88d25d89559906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfc6e299d69345a3be46c0052d914742', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120799) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:25:39.706492 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [req-c8a73fbb-9460-4645-88d8-8b97678b0380 req-0ba013e9-1727-41e6-ac7b-88b9fe4437c9 service nova] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:25:39.707165 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [req-c8a73fbb-9460-4645-88d8-8b97678b0380 req-0ba013e9-1727-41e6-ac7b-88b9fe4437c9 service nova] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:25:39.708133 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [req-c8a73fbb-9460-4645-88d8-8b97678b0380 req-0ba013e9-1727-41e6-ac7b-88b9fe4437c9 service nova] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:25:39.708588 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-b5c22f23-197d-409e-8895-a240ac247312 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] 10.222.0.17 "GET /compute/v2.1/servers/71485b4e-f619-49d8-87b8-4bdad738d459" status: 200 len: 1364 microversion: 2.1 time: 0.160804 Aug 23 07:25:39.721129 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 492/959] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:25:39 2022] GET /compute/v2.1/servers/71485b4e-f619-49d8-87b8-4bdad738d459 => generated 1364 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:25:39.722017 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.compute.server_external_events [req-c8a73fbb-9460-4645-88d8-8b97678b0380 req-0ba013e9-1727-41e6-ac7b-88b9fe4437c9 service nova] Creating event network-changed:e4dfca50-c07f-425d-91fa-13a85271eafb for instance 71485b4e-f619-49d8-87b8-4bdad738d459 on hv-cinder-85409 Aug 23 07:25:39.729112 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [req-c8a73fbb-9460-4645-88d8-8b97678b0380 req-0ba013e9-1727-41e6-ac7b-88b9fe4437c9 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041945 Aug 23 07:25:39.729700 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 468/960] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Aug 23 07:25:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 07:25:40.707013 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 23 07:25:40.707528 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: Tue Aug 23 07:25:40 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 23 07:25:40.734205 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-8978f9d9-9123-496f-af5b-ee2889ccd62f tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Calling method '>' {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:25:40.734807 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.compute.api [None req-8978f9d9-9123-496f-af5b-ee2889ccd62f tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] [instance: 71485b4e-f619-49d8-87b8-4bdad738d459] Fetching instance by UUID {{(pid=120799) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:25:40.741930 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-8978f9d9-9123-496f-af5b-ee2889ccd62f tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:25:40.742404 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-8978f9d9-9123-496f-af5b-ee2889ccd62f tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:25:40.742828 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-8978f9d9-9123-496f-af5b-ee2889ccd62f tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:25:40.744326 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-8978f9d9-9123-496f-af5b-ee2889ccd62f tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:25:40.744818 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-8978f9d9-9123-496f-af5b-ee2889ccd62f tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:25:40.745244 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-8978f9d9-9123-496f-af5b-ee2889ccd62f tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:25:40.889960 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.policy [None req-8978f9d9-9123-496f-af5b-ee2889ccd62f tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbf1799461f6485ea88d25d89559906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfc6e299d69345a3be46c0052d914742', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120799) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:25:40.897840 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-8978f9d9-9123-496f-af5b-ee2889ccd62f tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] 10.222.0.17 "GET /compute/v2.1/servers/71485b4e-f619-49d8-87b8-4bdad738d459" status: 200 len: 1364 microversion: 2.1 time: 0.167444 Aug 23 07:25:40.898414 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 493/961] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:25:40 2022] GET /compute/v2.1/servers/71485b4e-f619-49d8-87b8-4bdad738d459 => generated 1364 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:25:41.921830 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-38448f07-0a71-4d23-967d-9a6d04a05c24 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Calling method '>' {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:25:41.922378 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.compute.api [None req-38448f07-0a71-4d23-967d-9a6d04a05c24 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] [instance: 71485b4e-f619-49d8-87b8-4bdad738d459] Fetching instance by UUID {{(pid=120798) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:25:41.929211 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-38448f07-0a71-4d23-967d-9a6d04a05c24 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:25:41.929685 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-38448f07-0a71-4d23-967d-9a6d04a05c24 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:25:41.930120 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-38448f07-0a71-4d23-967d-9a6d04a05c24 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:25:41.930797 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-38448f07-0a71-4d23-967d-9a6d04a05c24 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:25:41.931235 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-38448f07-0a71-4d23-967d-9a6d04a05c24 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:25:41.931733 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-38448f07-0a71-4d23-967d-9a6d04a05c24 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:25:42.067445 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.policy [None req-38448f07-0a71-4d23-967d-9a6d04a05c24 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbf1799461f6485ea88d25d89559906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfc6e299d69345a3be46c0052d914742', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120798) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:25:42.076137 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [None req-38448f07-0a71-4d23-967d-9a6d04a05c24 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] 10.222.0.17 "GET /compute/v2.1/servers/71485b4e-f619-49d8-87b8-4bdad738d459" status: 200 len: 1364 microversion: 2.1 time: 0.159412 Aug 23 07:25:42.076699 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 469/962] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:25:41 2022] GET /compute/v2.1/servers/71485b4e-f619-49d8-87b8-4bdad738d459 => generated 1364 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:25:43.107690 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-f783e7e3-9f79-48b5-8f8b-d7e3802b92cb tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Calling method '>' {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:25:43.108258 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.compute.api [None req-f783e7e3-9f79-48b5-8f8b-d7e3802b92cb tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] [instance: 71485b4e-f619-49d8-87b8-4bdad738d459] Fetching instance by UUID {{(pid=120799) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:25:43.117650 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-f783e7e3-9f79-48b5-8f8b-d7e3802b92cb tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:25:43.118217 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-f783e7e3-9f79-48b5-8f8b-d7e3802b92cb tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:25:43.118819 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-f783e7e3-9f79-48b5-8f8b-d7e3802b92cb tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:25:43.119878 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-f783e7e3-9f79-48b5-8f8b-d7e3802b92cb tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:25:43.120483 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-f783e7e3-9f79-48b5-8f8b-d7e3802b92cb tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:25:43.121049 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-f783e7e3-9f79-48b5-8f8b-d7e3802b92cb tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:25:43.256079 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.policy [None req-f783e7e3-9f79-48b5-8f8b-d7e3802b92cb tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbf1799461f6485ea88d25d89559906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfc6e299d69345a3be46c0052d914742', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120799) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:25:43.264345 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-f783e7e3-9f79-48b5-8f8b-d7e3802b92cb tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] 10.222.0.17 "GET /compute/v2.1/servers/71485b4e-f619-49d8-87b8-4bdad738d459" status: 200 len: 1364 microversion: 2.1 time: 0.163801 Aug 23 07:25:43.264913 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 494/963] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:25:43 2022] GET /compute/v2.1/servers/71485b4e-f619-49d8-87b8-4bdad738d459 => generated 1364 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:25:44.291626 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-48fffdcc-3cb0-47d4-b984-cbd9ca197c5e tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Calling method '>' {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:25:44.292755 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.compute.api [None req-48fffdcc-3cb0-47d4-b984-cbd9ca197c5e tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] [instance: 71485b4e-f619-49d8-87b8-4bdad738d459] Fetching instance by UUID {{(pid=120798) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:25:44.302851 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-48fffdcc-3cb0-47d4-b984-cbd9ca197c5e tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:25:44.303723 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-48fffdcc-3cb0-47d4-b984-cbd9ca197c5e tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:25:44.304162 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-48fffdcc-3cb0-47d4-b984-cbd9ca197c5e tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:25:44.304886 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-48fffdcc-3cb0-47d4-b984-cbd9ca197c5e tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:25:44.305327 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-48fffdcc-3cb0-47d4-b984-cbd9ca197c5e tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:25:44.305751 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-48fffdcc-3cb0-47d4-b984-cbd9ca197c5e tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:25:44.447707 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.policy [None req-48fffdcc-3cb0-47d4-b984-cbd9ca197c5e tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbf1799461f6485ea88d25d89559906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfc6e299d69345a3be46c0052d914742', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120798) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:25:44.455781 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [None req-48fffdcc-3cb0-47d4-b984-cbd9ca197c5e tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] 10.222.0.17 "GET /compute/v2.1/servers/71485b4e-f619-49d8-87b8-4bdad738d459" status: 200 len: 1364 microversion: 2.1 time: 0.172949 Aug 23 07:25:44.456344 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 470/964] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:25:44 2022] GET /compute/v2.1/servers/71485b4e-f619-49d8-87b8-4bdad738d459 => generated 1364 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:25:45.034846 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [req-1b6cdac9-512b-4e0f-a3b3-fc573ff859c9 req-f2ad00c8-9e1f-4a98-a96a-aecb363e4776 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "71485b4e-f619-49d8-87b8-4bdad738d459", "name": "network-vif-plugged", "status": "completed", "tag": "e4dfca50-c07f-425d-91fa-13a85271eafb"}]} {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 07:25:45.045146 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [req-1b6cdac9-512b-4e0f-a3b3-fc573ff859c9 req-f2ad00c8-9e1f-4a98-a96a-aecb363e4776 service nova] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:25:45.045611 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [req-1b6cdac9-512b-4e0f-a3b3-fc573ff859c9 req-f2ad00c8-9e1f-4a98-a96a-aecb363e4776 service nova] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:25:45.046033 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [req-1b6cdac9-512b-4e0f-a3b3-fc573ff859c9 req-f2ad00c8-9e1f-4a98-a96a-aecb363e4776 service nova] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:25:45.059292 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.compute.server_external_events [req-1b6cdac9-512b-4e0f-a3b3-fc573ff859c9 req-f2ad00c8-9e1f-4a98-a96a-aecb363e4776 service nova] Creating event network-vif-plugged:e4dfca50-c07f-425d-91fa-13a85271eafb for instance 71485b4e-f619-49d8-87b8-4bdad738d459 on hv-cinder-85409 Aug 23 07:25:45.064800 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [req-1b6cdac9-512b-4e0f-a3b3-fc573ff859c9 req-f2ad00c8-9e1f-4a98-a96a-aecb363e4776 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.190666 Aug 23 07:25:45.065557 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 495/965] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Aug 23 07:25:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 07:25:45.478501 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-f512f9bd-ed93-4b66-9426-6d706a699f1e tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Calling method '>' {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:25:45.479254 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.compute.api [None req-f512f9bd-ed93-4b66-9426-6d706a699f1e tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] [instance: 71485b4e-f619-49d8-87b8-4bdad738d459] Fetching instance by UUID {{(pid=120798) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:25:45.487440 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-f512f9bd-ed93-4b66-9426-6d706a699f1e tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:25:45.487938 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-f512f9bd-ed93-4b66-9426-6d706a699f1e tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:25:45.488371 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-f512f9bd-ed93-4b66-9426-6d706a699f1e tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:25:45.489059 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-f512f9bd-ed93-4b66-9426-6d706a699f1e tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:25:45.489507 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-f512f9bd-ed93-4b66-9426-6d706a699f1e tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:25:45.489919 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-f512f9bd-ed93-4b66-9426-6d706a699f1e tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:25:45.648895 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.policy [None req-f512f9bd-ed93-4b66-9426-6d706a699f1e tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbf1799461f6485ea88d25d89559906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfc6e299d69345a3be46c0052d914742', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120798) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:25:45.661786 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [None req-f512f9bd-ed93-4b66-9426-6d706a699f1e tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] 10.222.0.17 "GET /compute/v2.1/servers/71485b4e-f619-49d8-87b8-4bdad738d459" status: 200 len: 1364 microversion: 2.1 time: 0.188490 Aug 23 07:25:45.662367 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 471/966] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:25:45 2022] GET /compute/v2.1/servers/71485b4e-f619-49d8-87b8-4bdad738d459 => generated 1364 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:25:46.688180 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-29123449-697a-4b8d-850a-ac3f92d9b710 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Calling method '>' {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:25:46.688846 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.compute.api [None req-29123449-697a-4b8d-850a-ac3f92d9b710 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] [instance: 71485b4e-f619-49d8-87b8-4bdad738d459] Fetching instance by UUID {{(pid=120799) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:25:46.696075 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-29123449-697a-4b8d-850a-ac3f92d9b710 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:25:46.696561 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-29123449-697a-4b8d-850a-ac3f92d9b710 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:25:46.697000 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-29123449-697a-4b8d-850a-ac3f92d9b710 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:25:46.697692 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-29123449-697a-4b8d-850a-ac3f92d9b710 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:25:46.698143 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-29123449-697a-4b8d-850a-ac3f92d9b710 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:25:46.698569 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-29123449-697a-4b8d-850a-ac3f92d9b710 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:25:46.834932 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.policy [None req-29123449-697a-4b8d-850a-ac3f92d9b710 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbf1799461f6485ea88d25d89559906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfc6e299d69345a3be46c0052d914742', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120799) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:25:46.843788 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-29123449-697a-4b8d-850a-ac3f92d9b710 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] 10.222.0.17 "GET /compute/v2.1/servers/71485b4e-f619-49d8-87b8-4bdad738d459" status: 200 len: 1550 microversion: 2.1 time: 0.161264 Aug 23 07:25:46.844366 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 496/967] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:25:46 2022] GET /compute/v2.1/servers/71485b4e-f619-49d8-87b8-4bdad738d459 => generated 1550 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:25:46.868022 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-71988348-ee12-43a3-a89a-9c7e0d9ef786 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Calling method '>' {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:25:46.868573 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.compute.api [None req-71988348-ee12-43a3-a89a-9c7e0d9ef786 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] [instance: 71485b4e-f619-49d8-87b8-4bdad738d459] Fetching instance by UUID {{(pid=120798) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:25:46.871379 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG dbcounter [-] [120798] Writing DB stats nova_cell0:SELECT=2 {{(pid=120798) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:25:46.872142 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG dbcounter [-] [120798] Writing DB stats nova_cell0:SELECT=6 {{(pid=120798) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:25:46.879113 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-71988348-ee12-43a3-a89a-9c7e0d9ef786 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:25:46.879636 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-71988348-ee12-43a3-a89a-9c7e0d9ef786 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:25:46.880063 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-71988348-ee12-43a3-a89a-9c7e0d9ef786 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:25:46.880740 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-71988348-ee12-43a3-a89a-9c7e0d9ef786 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:25:46.881215 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-71988348-ee12-43a3-a89a-9c7e0d9ef786 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:25:46.881594 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-71988348-ee12-43a3-a89a-9c7e0d9ef786 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:25:46.963446 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [None req-71988348-ee12-43a3-a89a-9c7e0d9ef786 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] 10.222.0.17 "GET /compute/v2.1/servers/71485b4e-f619-49d8-87b8-4bdad738d459/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.102128 Aug 23 07:25:46.964065 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 472/968] 10.222.0.17 () {58 vars in 1275 bytes} [Tue Aug 23 07:25:46 2022] GET /compute/v2.1/servers/71485b4e-f619-49d8-87b8-4bdad738d459/os-interface => generated 285 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 07:25:47.950380 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [req-af04dc41-3e87-4b63-bc6d-f0a1fc8a7dad req-91cde0a9-0f8a-4676-a162-1e9e6698bf78 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "71485b4e-f619-49d8-87b8-4bdad738d459", "tag": "e4dfca50-c07f-425d-91fa-13a85271eafb"}]} {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 07:25:47.955667 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG dbcounter [-] [120799] Writing DB stats nova_cell0:SELECT=6 {{(pid=120799) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:25:47.962520 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [req-af04dc41-3e87-4b63-bc6d-f0a1fc8a7dad req-91cde0a9-0f8a-4676-a162-1e9e6698bf78 service nova] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:25:47.962985 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [req-af04dc41-3e87-4b63-bc6d-f0a1fc8a7dad req-91cde0a9-0f8a-4676-a162-1e9e6698bf78 service nova] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:25:47.963405 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [req-af04dc41-3e87-4b63-bc6d-f0a1fc8a7dad req-91cde0a9-0f8a-4676-a162-1e9e6698bf78 service nova] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:25:47.975387 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.compute.server_external_events [req-af04dc41-3e87-4b63-bc6d-f0a1fc8a7dad req-91cde0a9-0f8a-4676-a162-1e9e6698bf78 service nova] Creating event network-changed:e4dfca50-c07f-425d-91fa-13a85271eafb for instance 71485b4e-f619-49d8-87b8-4bdad738d459 on hv-cinder-85409 Aug 23 07:25:47.980537 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [req-af04dc41-3e87-4b63-bc6d-f0a1fc8a7dad req-91cde0a9-0f8a-4676-a162-1e9e6698bf78 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034094 Aug 23 07:25:47.981124 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 497/969] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Aug 23 07:25:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 07:26:24.044864 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG dbcounter [-] [120798] Writing DB stats nova_api:SELECT=41,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=120798) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:26:24.046136 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG dbcounter [-] [120798] Writing DB stats nova_cell1:SELECT=54,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120798) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:26:24.053964 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-6868c97f-874a-410a-9ec7-bc2b04873c6e tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Calling method '>' {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:26:24.054460 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.compute.api [None req-6868c97f-874a-410a-9ec7-bc2b04873c6e tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] [instance: 71485b4e-f619-49d8-87b8-4bdad738d459] Fetching instance by UUID {{(pid=120798) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:26:24.063330 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-6868c97f-874a-410a-9ec7-bc2b04873c6e tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:26:24.064004 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-6868c97f-874a-410a-9ec7-bc2b04873c6e tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:26:24.064505 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-6868c97f-874a-410a-9ec7-bc2b04873c6e tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:26:24.065490 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-6868c97f-874a-410a-9ec7-bc2b04873c6e tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:26:24.065939 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-6868c97f-874a-410a-9ec7-bc2b04873c6e tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:26:24.066360 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-6868c97f-874a-410a-9ec7-bc2b04873c6e tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:26:24.093358 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [None req-6868c97f-874a-410a-9ec7-bc2b04873c6e tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] 10.222.0.17 "GET /compute/v2.1/servers/71485b4e-f619-49d8-87b8-4bdad738d459/ips" status: 200 len: 145 microversion: 2.1 time: 0.051096 Aug 23 07:26:24.093917 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 473/970] 10.222.0.17 () {58 vars in 1248 bytes} [Tue Aug 23 07:26:24 2022] GET /compute/v2.1/servers/71485b4e-f619-49d8-87b8-4bdad738d459/ips => generated 145 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 07:26:25.439585 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG dbcounter [-] [120799] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=1 {{(pid=120799) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:26:25.440375 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG dbcounter [-] [120799] Writing DB stats nova_cell1:SELECT=48 {{(pid=120799) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:26:25.444959 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-44fc57ac-be75-4ae5-b6f0-1163a7841f26 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "061b2362-ee85-4e03-b7ce-485b0cb740ab"}} {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 07:26:25.447319 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.compute.api [None req-44fc57ac-be75-4ae5-b6f0-1163a7841f26 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] [instance: 71485b4e-f619-49d8-87b8-4bdad738d459] Fetching instance by UUID {{(pid=120799) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:26:25.454480 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-44fc57ac-be75-4ae5-b6f0-1163a7841f26 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:26:25.454996 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-44fc57ac-be75-4ae5-b6f0-1163a7841f26 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:26:25.455436 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-44fc57ac-be75-4ae5-b6f0-1163a7841f26 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:26:25.456196 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-44fc57ac-be75-4ae5-b6f0-1163a7841f26 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:26:25.456617 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-44fc57ac-be75-4ae5-b6f0-1163a7841f26 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:26:25.457028 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-44fc57ac-be75-4ae5-b6f0-1163a7841f26 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:26:25.724569 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-44fc57ac-be75-4ae5-b6f0-1163a7841f26 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] 10.222.0.17 "POST /compute/v2.1/servers/71485b4e-f619-49d8-87b8-4bdad738d459/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.286519 Aug 23 07:26:25.725179 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 498/971] 10.222.0.17 () {60 vars in 1323 bytes} [Tue Aug 23 07:26:25 2022] POST /compute/v2.1/servers/71485b4e-f619-49d8-87b8-4bdad738d459/os-volume_attachments => generated 194 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 07:26:32.270675 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-2c1b870b-6c6d-465a-a678-26880fcb262a tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Calling method '>' {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:26:32.273143 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.compute.api [None req-2c1b870b-6c6d-465a-a678-26880fcb262a tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] [instance: 71485b4e-f619-49d8-87b8-4bdad738d459] Fetching instance by UUID {{(pid=120798) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:26:32.280230 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-2c1b870b-6c6d-465a-a678-26880fcb262a tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:26:32.280717 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-2c1b870b-6c6d-465a-a678-26880fcb262a tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:26:32.281145 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-2c1b870b-6c6d-465a-a678-26880fcb262a tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:26:32.281835 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-2c1b870b-6c6d-465a-a678-26880fcb262a tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:26:32.282293 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-2c1b870b-6c6d-465a-a678-26880fcb262a tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:26:32.282700 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-2c1b870b-6c6d-465a-a678-26880fcb262a tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:26:32.314011 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [None req-2c1b870b-6c6d-465a-a678-26880fcb262a tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] 10.222.0.17 "GET /compute/v2.1/servers/71485b4e-f619-49d8-87b8-4bdad738d459/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047461 Aug 23 07:26:32.314566 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 474/972] 10.222.0.17 () {58 vars in 1302 bytes} [Tue Aug 23 07:26:32 2022] GET /compute/v2.1/servers/71485b4e-f619-49d8-87b8-4bdad738d459/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 07:26:32.326487 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-d639ac8a-4849-4319-882e-d37b7fc21973 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Calling method '>' {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:26:32.327053 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.compute.api [None req-d639ac8a-4849-4319-882e-d37b7fc21973 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] [instance: 71485b4e-f619-49d8-87b8-4bdad738d459] Fetching instance by UUID {{(pid=120799) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:26:32.335771 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-d639ac8a-4849-4319-882e-d37b7fc21973 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:26:32.336274 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-d639ac8a-4849-4319-882e-d37b7fc21973 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:26:32.336704 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-d639ac8a-4849-4319-882e-d37b7fc21973 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:26:32.337407 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-d639ac8a-4849-4319-882e-d37b7fc21973 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:26:32.337854 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-d639ac8a-4849-4319-882e-d37b7fc21973 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:26:32.338310 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-d639ac8a-4849-4319-882e-d37b7fc21973 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:26:32.369714 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-d639ac8a-4849-4319-882e-d37b7fc21973 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] 10.222.0.17 "GET /compute/v2.1/servers/71485b4e-f619-49d8-87b8-4bdad738d459/os-volume_attachments/061b2362-ee85-4e03-b7ce-485b0cb740ab" status: 200 len: 194 microversion: 2.1 time: 0.048090 Aug 23 07:26:32.370331 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 499/973] 10.222.0.17 () {58 vars in 1413 bytes} [Tue Aug 23 07:26:32 2022] GET /compute/v2.1/servers/71485b4e-f619-49d8-87b8-4bdad738d459/os-volume_attachments/061b2362-ee85-4e03-b7ce-485b0cb740ab => generated 194 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 07:26:33.719985 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-8eb74d5c-d999-4332-9e9d-b46b953730e2 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8200131e-08a4-4711-b088-d717a40ce689"}} {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 07:26:33.722303 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.compute.api [None req-8eb74d5c-d999-4332-9e9d-b46b953730e2 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] [instance: 71485b4e-f619-49d8-87b8-4bdad738d459] Fetching instance by UUID {{(pid=120798) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:26:33.729415 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-8eb74d5c-d999-4332-9e9d-b46b953730e2 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:26:33.729898 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-8eb74d5c-d999-4332-9e9d-b46b953730e2 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:26:33.730329 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-8eb74d5c-d999-4332-9e9d-b46b953730e2 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:26:33.731018 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-8eb74d5c-d999-4332-9e9d-b46b953730e2 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:26:33.731493 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-8eb74d5c-d999-4332-9e9d-b46b953730e2 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:26:33.731917 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-8eb74d5c-d999-4332-9e9d-b46b953730e2 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:26:33.986502 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [None req-8eb74d5c-d999-4332-9e9d-b46b953730e2 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] 10.222.0.17 "POST /compute/v2.1/servers/71485b4e-f619-49d8-87b8-4bdad738d459/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.270404 Aug 23 07:26:33.987127 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 475/974] 10.222.0.17 () {60 vars in 1323 bytes} [Tue Aug 23 07:26:33 2022] POST /compute/v2.1/servers/71485b4e-f619-49d8-87b8-4bdad738d459/os-volume_attachments => generated 194 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 07:26:40.522868 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-06288210-a68c-49b8-950b-f75e0cdc0873 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Calling method '>' {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:26:40.525510 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.compute.api [None req-06288210-a68c-49b8-950b-f75e0cdc0873 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] [instance: 71485b4e-f619-49d8-87b8-4bdad738d459] Fetching instance by UUID {{(pid=120799) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:26:40.532261 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-06288210-a68c-49b8-950b-f75e0cdc0873 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:26:40.532734 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-06288210-a68c-49b8-950b-f75e0cdc0873 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:26:40.533164 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-06288210-a68c-49b8-950b-f75e0cdc0873 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:26:40.533835 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-06288210-a68c-49b8-950b-f75e0cdc0873 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:26:40.534277 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-06288210-a68c-49b8-950b-f75e0cdc0873 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:26:40.534692 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-06288210-a68c-49b8-950b-f75e0cdc0873 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:26:40.565686 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-06288210-a68c-49b8-950b-f75e0cdc0873 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] 10.222.0.17 "GET /compute/v2.1/servers/71485b4e-f619-49d8-87b8-4bdad738d459/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.046690 Aug 23 07:26:40.566141 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 500/975] 10.222.0.17 () {58 vars in 1302 bytes} [Tue Aug 23 07:26:40 2022] GET /compute/v2.1/servers/71485b4e-f619-49d8-87b8-4bdad738d459/os-volume_attachments => generated 371 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 07:26:40.722971 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-395529a2-7e69-4203-8921-306cc54b3ffe tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Calling method '>' {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:26:40.723904 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.compute.api [None req-395529a2-7e69-4203-8921-306cc54b3ffe tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] [instance: 71485b4e-f619-49d8-87b8-4bdad738d459] Fetching instance by UUID {{(pid=120798) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:26:40.731267 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-395529a2-7e69-4203-8921-306cc54b3ffe tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:26:40.731773 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-395529a2-7e69-4203-8921-306cc54b3ffe tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:26:40.732202 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-395529a2-7e69-4203-8921-306cc54b3ffe tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:26:40.732877 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-395529a2-7e69-4203-8921-306cc54b3ffe tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:26:40.733322 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-395529a2-7e69-4203-8921-306cc54b3ffe tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:26:40.733766 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-395529a2-7e69-4203-8921-306cc54b3ffe tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:26:40.762784 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [None req-395529a2-7e69-4203-8921-306cc54b3ffe tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] 10.222.0.17 "GET /compute/v2.1/servers/71485b4e-f619-49d8-87b8-4bdad738d459/os-volume_attachments/061b2362-ee85-4e03-b7ce-485b0cb740ab" status: 200 len: 194 microversion: 2.1 time: 0.047668 Aug 23 07:26:40.763344 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 476/976] 10.222.0.17 () {58 vars in 1413 bytes} [Tue Aug 23 07:26:40 2022] GET /compute/v2.1/servers/71485b4e-f619-49d8-87b8-4bdad738d459/os-volume_attachments/061b2362-ee85-4e03-b7ce-485b0cb740ab => generated 194 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 07:26:40.774078 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-5c8b868c-a559-42da-9cb4-e44801478bad tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Calling method '>' {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:26:40.774566 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.compute.api [None req-5c8b868c-a559-42da-9cb4-e44801478bad tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] [instance: 71485b4e-f619-49d8-87b8-4bdad738d459] Fetching instance by UUID {{(pid=120799) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:26:40.781047 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-5c8b868c-a559-42da-9cb4-e44801478bad tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:26:40.781518 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-5c8b868c-a559-42da-9cb4-e44801478bad tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:26:40.781940 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-5c8b868c-a559-42da-9cb4-e44801478bad tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:26:40.782604 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-5c8b868c-a559-42da-9cb4-e44801478bad tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:26:40.783041 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-5c8b868c-a559-42da-9cb4-e44801478bad tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:26:40.783466 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-5c8b868c-a559-42da-9cb4-e44801478bad tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:26:40.874714 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.objects.instance [None req-5c8b868c-a559-42da-9cb4-e44801478bad tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Lazy-loading 'services' on Instance uuid 71485b4e-f619-49d8-87b8-4bdad738d459 {{(pid=120799) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 07:26:40.957222 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-5c8b868c-a559-42da-9cb4-e44801478bad tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] 10.222.0.17 "DELETE /compute/v2.1/servers/71485b4e-f619-49d8-87b8-4bdad738d459/os-volume_attachments/061b2362-ee85-4e03-b7ce-485b0cb740ab" status: 202 len: 0 microversion: 2.1 time: 0.186516 Aug 23 07:26:40.958094 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 501/977] 10.222.0.17 () {58 vars in 1416 bytes} [Tue Aug 23 07:26:40 2022] DELETE /compute/v2.1/servers/71485b4e-f619-49d8-87b8-4bdad738d459/os-volume_attachments/061b2362-ee85-4e03-b7ce-485b0cb740ab => generated 0 bytes in 189 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 07:26:42.094535 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-83654d1c-5451-45d5-a180-28f3cbda462d tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Calling method '>' {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:26:42.095097 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.compute.api [None req-83654d1c-5451-45d5-a180-28f3cbda462d tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] [instance: 71485b4e-f619-49d8-87b8-4bdad738d459] Fetching instance by UUID {{(pid=120798) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:26:42.102266 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-83654d1c-5451-45d5-a180-28f3cbda462d tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:26:42.102816 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-83654d1c-5451-45d5-a180-28f3cbda462d tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:26:42.103246 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-83654d1c-5451-45d5-a180-28f3cbda462d tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:26:42.103999 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-83654d1c-5451-45d5-a180-28f3cbda462d tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:26:42.104452 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-83654d1c-5451-45d5-a180-28f3cbda462d tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:26:42.104887 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-83654d1c-5451-45d5-a180-28f3cbda462d tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:26:42.137769 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [None req-83654d1c-5451-45d5-a180-28f3cbda462d tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] 10.222.0.17 "GET /compute/v2.1/servers/71485b4e-f619-49d8-87b8-4bdad738d459/os-volume_attachments/8200131e-08a4-4711-b088-d717a40ce689" status: 200 len: 194 microversion: 2.1 time: 0.044588 Aug 23 07:26:42.137769 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 477/978] 10.222.0.17 () {58 vars in 1413 bytes} [Tue Aug 23 07:26:42 2022] GET /compute/v2.1/servers/71485b4e-f619-49d8-87b8-4bdad738d459/os-volume_attachments/8200131e-08a4-4711-b088-d717a40ce689 => generated 194 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 07:26:42.147462 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-5832ec27-825f-4b92-9ab8-c0247d9a177f tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Calling method '>' {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:26:42.148069 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.compute.api [None req-5832ec27-825f-4b92-9ab8-c0247d9a177f tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] [instance: 71485b4e-f619-49d8-87b8-4bdad738d459] Fetching instance by UUID {{(pid=120799) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:26:42.154516 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-5832ec27-825f-4b92-9ab8-c0247d9a177f tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:26:42.154996 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-5832ec27-825f-4b92-9ab8-c0247d9a177f tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:26:42.155438 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-5832ec27-825f-4b92-9ab8-c0247d9a177f tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:26:42.156148 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-5832ec27-825f-4b92-9ab8-c0247d9a177f tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:26:42.158623 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-5832ec27-825f-4b92-9ab8-c0247d9a177f tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:26:42.158623 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-5832ec27-825f-4b92-9ab8-c0247d9a177f tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:26:42.245566 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.objects.instance [None req-5832ec27-825f-4b92-9ab8-c0247d9a177f tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Lazy-loading 'services' on Instance uuid 71485b4e-f619-49d8-87b8-4bdad738d459 {{(pid=120799) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 07:26:42.324092 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-5832ec27-825f-4b92-9ab8-c0247d9a177f tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] 10.222.0.17 "DELETE /compute/v2.1/servers/71485b4e-f619-49d8-87b8-4bdad738d459/os-volume_attachments/8200131e-08a4-4711-b088-d717a40ce689" status: 202 len: 0 microversion: 2.1 time: 0.181269 Aug 23 07:26:42.324681 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 502/979] 10.222.0.17 () {58 vars in 1416 bytes} [Tue Aug 23 07:26:42 2022] DELETE /compute/v2.1/servers/71485b4e-f619-49d8-87b8-4bdad738d459/os-volume_attachments/8200131e-08a4-4711-b088-d717a40ce689 => generated 0 bytes in 183 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 07:26:43.501921 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-b2979e33-cfb4-4cf1-b012-d43874bcda08 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Calling method '>' {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:26:43.504225 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.compute.api [None req-b2979e33-cfb4-4cf1-b012-d43874bcda08 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] [instance: 71485b4e-f619-49d8-87b8-4bdad738d459] Fetching instance by UUID {{(pid=120798) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:26:43.512406 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-b2979e33-cfb4-4cf1-b012-d43874bcda08 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:26:43.512905 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-b2979e33-cfb4-4cf1-b012-d43874bcda08 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:26:43.513348 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-b2979e33-cfb4-4cf1-b012-d43874bcda08 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:26:43.514319 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-b2979e33-cfb4-4cf1-b012-d43874bcda08 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:26:43.514494 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-b2979e33-cfb4-4cf1-b012-d43874bcda08 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:26:43.514909 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-b2979e33-cfb4-4cf1-b012-d43874bcda08 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:26:43.544975 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [None req-b2979e33-cfb4-4cf1-b012-d43874bcda08 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] 10.222.0.17 "GET /compute/v2.1/servers/71485b4e-f619-49d8-87b8-4bdad738d459/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047031 Aug 23 07:26:43.545527 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 478/980] 10.222.0.17 () {58 vars in 1302 bytes} [Tue Aug 23 07:26:43 2022] GET /compute/v2.1/servers/71485b4e-f619-49d8-87b8-4bdad738d459/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 23 07:26:43.663512 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-f58b9ce2-9914-4626-a8d5-b5260b5aff73 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Calling method '>' {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:26:43.666278 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.compute.api [None req-f58b9ce2-9914-4626-a8d5-b5260b5aff73 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] [instance: 71485b4e-f619-49d8-87b8-4bdad738d459] Fetching instance by UUID {{(pid=120799) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:26:43.673743 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-f58b9ce2-9914-4626-a8d5-b5260b5aff73 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:26:43.674450 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-f58b9ce2-9914-4626-a8d5-b5260b5aff73 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:26:43.675064 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-f58b9ce2-9914-4626-a8d5-b5260b5aff73 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:26:43.676162 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-f58b9ce2-9914-4626-a8d5-b5260b5aff73 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:26:43.676838 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-f58b9ce2-9914-4626-a8d5-b5260b5aff73 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:26:43.677440 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-f58b9ce2-9914-4626-a8d5-b5260b5aff73 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:26:43.709020 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-f58b9ce2-9914-4626-a8d5-b5260b5aff73 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] 10.222.0.17 "GET /compute/v2.1/servers/71485b4e-f619-49d8-87b8-4bdad738d459/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.050288 Aug 23 07:26:43.709573 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 503/981] 10.222.0.17 () {58 vars in 1302 bytes} [Tue Aug 23 07:26:43 2022] GET /compute/v2.1/servers/71485b4e-f619-49d8-87b8-4bdad738d459/os-volume_attachments => generated 25 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 23 07:26:43.772715 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-9dd083a7-71ba-4eb5-b019-527049ab3ce4 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Calling method '>' {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:26:43.773235 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.compute.api [None req-9dd083a7-71ba-4eb5-b019-527049ab3ce4 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] [instance: 71485b4e-f619-49d8-87b8-4bdad738d459] Fetching instance by UUID {{(pid=120798) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:26:43.780008 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-9dd083a7-71ba-4eb5-b019-527049ab3ce4 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:26:43.780493 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-9dd083a7-71ba-4eb5-b019-527049ab3ce4 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:26:43.780917 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-9dd083a7-71ba-4eb5-b019-527049ab3ce4 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:26:43.781603 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-9dd083a7-71ba-4eb5-b019-527049ab3ce4 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:26:43.782045 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-9dd083a7-71ba-4eb5-b019-527049ab3ce4 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:26:43.782453 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-9dd083a7-71ba-4eb5-b019-527049ab3ce4 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:26:43.808252 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.compute.api [None req-9dd083a7-71ba-4eb5-b019-527049ab3ce4 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] [instance: 71485b4e-f619-49d8-87b8-4bdad738d459] Going to try to terminate instance {{(pid=120798) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 07:26:43.904861 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [None req-9dd083a7-71ba-4eb5-b019-527049ab3ce4 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] 10.222.0.17 "DELETE /compute/v2.1/servers/71485b4e-f619-49d8-87b8-4bdad738d459" status: 204 len: 0 microversion: 2.1 time: 0.135655 Aug 23 07:26:43.905373 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 479/982] 10.222.0.17 () {58 vars in 1239 bytes} [Tue Aug 23 07:26:43 2022] DELETE /compute/v2.1/servers/71485b4e-f619-49d8-87b8-4bdad738d459 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 23 07:26:43.913618 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-19d2a8ee-4276-45fd-b3ec-69f68206ca59 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Calling method '>' {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:26:43.914239 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.compute.api [None req-19d2a8ee-4276-45fd-b3ec-69f68206ca59 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] [instance: 71485b4e-f619-49d8-87b8-4bdad738d459] Fetching instance by UUID {{(pid=120799) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:26:43.920676 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-19d2a8ee-4276-45fd-b3ec-69f68206ca59 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:26:43.921157 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-19d2a8ee-4276-45fd-b3ec-69f68206ca59 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:26:43.921586 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-19d2a8ee-4276-45fd-b3ec-69f68206ca59 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:26:43.922309 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-19d2a8ee-4276-45fd-b3ec-69f68206ca59 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:26:43.922755 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-19d2a8ee-4276-45fd-b3ec-69f68206ca59 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:26:43.923155 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-19d2a8ee-4276-45fd-b3ec-69f68206ca59 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:26:44.067260 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.policy [None req-19d2a8ee-4276-45fd-b3ec-69f68206ca59 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbf1799461f6485ea88d25d89559906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfc6e299d69345a3be46c0052d914742', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120799) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:26:44.077196 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-19d2a8ee-4276-45fd-b3ec-69f68206ca59 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] 10.222.0.17 "GET /compute/v2.1/servers/71485b4e-f619-49d8-87b8-4bdad738d459" status: 200 len: 1674 microversion: 2.1 time: 0.167472 Aug 23 07:26:44.077763 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 504/983] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:26:43 2022] GET /compute/v2.1/servers/71485b4e-f619-49d8-87b8-4bdad738d459 => generated 1674 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:26:45.107321 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-cd34ee59-df2d-4bae-b0f7-f964e65944ee tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Calling method '>' {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:26:45.108391 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.compute.api [None req-cd34ee59-df2d-4bae-b0f7-f964e65944ee tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] [instance: 71485b4e-f619-49d8-87b8-4bdad738d459] Fetching instance by UUID {{(pid=120798) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:26:45.119029 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-cd34ee59-df2d-4bae-b0f7-f964e65944ee tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:26:45.119541 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-cd34ee59-df2d-4bae-b0f7-f964e65944ee tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:26:45.119970 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-cd34ee59-df2d-4bae-b0f7-f964e65944ee tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:26:45.120649 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-cd34ee59-df2d-4bae-b0f7-f964e65944ee tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:26:45.121090 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-cd34ee59-df2d-4bae-b0f7-f964e65944ee tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:26:45.121507 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-cd34ee59-df2d-4bae-b0f7-f964e65944ee tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:26:45.256622 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.policy [None req-cd34ee59-df2d-4bae-b0f7-f964e65944ee tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbf1799461f6485ea88d25d89559906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfc6e299d69345a3be46c0052d914742', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120798) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:26:45.264927 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [None req-cd34ee59-df2d-4bae-b0f7-f964e65944ee tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] 10.222.0.17 "GET /compute/v2.1/servers/71485b4e-f619-49d8-87b8-4bdad738d459" status: 200 len: 1674 microversion: 2.1 time: 0.164932 Aug 23 07:26:45.265467 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 480/984] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:26:45 2022] GET /compute/v2.1/servers/71485b4e-f619-49d8-87b8-4bdad738d459 => generated 1674 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:26:46.288006 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-d32cb4f0-7e29-45c8-99e7-0bd13d0e2bbb tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Calling method '>' {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:26:46.288604 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.compute.api [None req-d32cb4f0-7e29-45c8-99e7-0bd13d0e2bbb tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] [instance: 71485b4e-f619-49d8-87b8-4bdad738d459] Fetching instance by UUID {{(pid=120799) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:26:46.295912 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-d32cb4f0-7e29-45c8-99e7-0bd13d0e2bbb tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:26:46.296398 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-d32cb4f0-7e29-45c8-99e7-0bd13d0e2bbb tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:26:46.296832 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-d32cb4f0-7e29-45c8-99e7-0bd13d0e2bbb tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:26:46.297521 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-d32cb4f0-7e29-45c8-99e7-0bd13d0e2bbb tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:26:46.297975 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-d32cb4f0-7e29-45c8-99e7-0bd13d0e2bbb tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:26:46.298421 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-d32cb4f0-7e29-45c8-99e7-0bd13d0e2bbb tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:26:46.366837 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.policy [None req-d32cb4f0-7e29-45c8-99e7-0bd13d0e2bbb tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbf1799461f6485ea88d25d89559906e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfc6e299d69345a3be46c0052d914742', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120799) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:26:46.374719 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-d32cb4f0-7e29-45c8-99e7-0bd13d0e2bbb tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] 10.222.0.17 "GET /compute/v2.1/servers/71485b4e-f619-49d8-87b8-4bdad738d459" status: 200 len: 1606 microversion: 2.1 time: 0.090904 Aug 23 07:26:46.375507 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 505/985] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:26:46 2022] GET /compute/v2.1/servers/71485b4e-f619-49d8-87b8-4bdad738d459 => generated 1606 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:26:46.413053 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [req-9b306050-692c-4783-ad09-4a7bb1fe149a req-d9c7d052-d381-4a32-aceb-6a103db662b6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "71485b4e-f619-49d8-87b8-4bdad738d459", "name": "network-vif-deleted", "tag": "e4dfca50-c07f-425d-91fa-13a85271eafb"}]} {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 07:26:46.425056 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [req-9b306050-692c-4783-ad09-4a7bb1fe149a req-d9c7d052-d381-4a32-aceb-6a103db662b6 service nova] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:26:46.425533 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [req-9b306050-692c-4783-ad09-4a7bb1fe149a req-d9c7d052-d381-4a32-aceb-6a103db662b6 service nova] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:26:46.425966 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [req-9b306050-692c-4783-ad09-4a7bb1fe149a req-d9c7d052-d381-4a32-aceb-6a103db662b6 service nova] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:26:46.438228 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.compute.server_external_events [req-9b306050-692c-4783-ad09-4a7bb1fe149a req-d9c7d052-d381-4a32-aceb-6a103db662b6 service nova] Creating event network-vif-deleted:e4dfca50-c07f-425d-91fa-13a85271eafb for instance 71485b4e-f619-49d8-87b8-4bdad738d459 on hv-cinder-85409 Aug 23 07:26:46.443066 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [req-9b306050-692c-4783-ad09-4a7bb1fe149a req-d9c7d052-d381-4a32-aceb-6a103db662b6 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033749 Aug 23 07:26:46.443690 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 481/986] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Aug 23 07:26:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 07:26:47.397011 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-917f3740-3bf6-4536-aec8-97d825dd4dcf tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Calling method '>' {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:26:47.397615 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.compute.api [None req-917f3740-3bf6-4536-aec8-97d825dd4dcf tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] [instance: 71485b4e-f619-49d8-87b8-4bdad738d459] Fetching instance by UUID {{(pid=120799) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:26:47.405041 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-917f3740-3bf6-4536-aec8-97d825dd4dcf tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:26:47.405439 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-917f3740-3bf6-4536-aec8-97d825dd4dcf tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:26:47.405868 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-917f3740-3bf6-4536-aec8-97d825dd4dcf tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:26:47.406573 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-917f3740-3bf6-4536-aec8-97d825dd4dcf tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:26:47.407022 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-917f3740-3bf6-4536-aec8-97d825dd4dcf tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:26:47.407441 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-917f3740-3bf6-4536-aec8-97d825dd4dcf tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:26:47.422394 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.wsgi [None req-917f3740-3bf6-4536-aec8-97d825dd4dcf tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] HTTP exception thrown: Instance 71485b4e-f619-49d8-87b8-4bdad738d459 could not be found. Aug 23 07:26:47.424093 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-917f3740-3bf6-4536-aec8-97d825dd4dcf tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Request method failure captured: Aug 23 07:26:47.424093 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: request: GET /compute/v2.1/servers/71485b4e-f619-49d8-87b8-4bdad738d459 HTTP/1.1 Aug 23 07:26:47.424093 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: Accept: application/json Aug 23 07:26:47.424093 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: Accept-Encoding: identity Aug 23 07:26:47.424093 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: Connection: close Aug 23 07:26:47.424093 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: Content-Length: 0 Aug 23 07:26:47.424093 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: Content-Type: application/json Aug 23 07:26:47.424093 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: Host: 10.222.0.17 Aug 23 07:26:47.424093 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: Openstack-System-Scope: None Aug 23 07:26:47.424093 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: User-Agent: python-urllib3/1.26.11 Aug 23 07:26:47.424093 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-Auth-Token: gAAAAABjBIBJmq6DHW-A2gYFbcOZnE0AbMbwzDvaDD00PoMw7P9dN4LNRmvj31Vqy4o7YIhRD5t_muNOh8YX2_IHQlyNuK7pHas57TNyACofXlXg5G7HfNTpHT5F1ckX4B86E5GktCH3onnZ8M4iMtghVxi_FCvM6cE9FD3nJWtekgjTCPFyeMQ Aug 23 07:26:47.424093 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-Domain-Id: None Aug 23 07:26:47.424093 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-Domain-Name: None Aug 23 07:26:47.424093 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-Identity-Status: Confirmed Aug 23 07:26:47.424093 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-Is-Admin-Project: True Aug 23 07:26:47.424093 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-Project-Domain-Id: default Aug 23 07:26:47.424093 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-Project-Domain-Name: Default Aug 23 07:26:47.424093 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-Project-Id: cfc6e299d69345a3be46c0052d914742 Aug 23 07:26:47.424093 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-Project-Name: tempest-AttachVolumeTestJSON-1864346838 Aug 23 07:26:47.424093 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-Role: reader,member Aug 23 07:26:47.424093 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-Roles: reader,member Aug 23 07:26:47.425596 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/cfc6e299d69345a3be46c0052d914742"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/cfc6e299d69345a3be46c0052d914742"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_cfc6e299d69345a3be46c0052d914742"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/cfc6e299d69345a3be46c0052d914742"}]}] Aug 23 07:26:47.425596 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-Tenant: tempest-AttachVolumeTestJSON-1864346838 Aug 23 07:26:47.425596 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-Tenant-Id: cfc6e299d69345a3be46c0052d914742 Aug 23 07:26:47.425596 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1864346838 Aug 23 07:26:47.425596 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-User: tempest-AttachVolumeTestJSON-1864346838-project Aug 23 07:26:47.425596 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-User-Domain-Id: default Aug 23 07:26:47.425596 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-User-Domain-Name: Default Aug 23 07:26:47.425596 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-User-Id: dbf1799461f6485ea88d25d89559906e Aug 23 07:26:47.425596 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-User-Name: tempest-AttachVolumeTestJSON-1864346838-project Aug 23 07:26:47.425596 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: method: > Aug 23 07:26:47.425596 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: exception: Instance 71485b4e-f619-49d8-87b8-4bdad738d459 could not be found. Aug 23 07:26:47.425596 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: action_args: {'id': '71485b4e-f619-49d8-87b8-4bdad738d459'} Aug 23 07:26:47.426378 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 07:26:47.426378 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 07:26:47.426378 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 07:26:47.426378 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 07:26:47.426378 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 07:26:47.426378 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 07:26:47.426378 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 07:26:47.426378 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 07:26:47.426378 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 07:26:47.426378 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 07:26:47.426378 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 71485b4e-f619-49d8-87b8-4bdad738d459 could not be found. Aug 23 07:26:47.426378 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi Aug 23 07:26:47.426378 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 07:26:47.426378 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi Aug 23 07:26:47.426378 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 07:26:47.426378 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 07:26:47.426378 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 07:26:47.426378 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 07:26:47.426378 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 07:26:47.426378 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 07:26:47.427707 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 07:26:47.427707 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 07:26:47.427707 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 07:26:47.427707 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 07:26:47.427707 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 07:26:47.427707 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 07:26:47.427707 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 07:26:47.427707 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 71485b4e-f619-49d8-87b8-4bdad738d459 could not be found. Aug 23 07:26:47.427707 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi Aug 23 07:26:47.427707 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 07:26:47.427707 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi Aug 23 07:26:47.427707 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 07:26:47.427707 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 07:26:47.427707 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 07:26:47.427707 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 07:26:47.427707 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 07:26:47.427707 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 71485b4e-f619-49d8-87b8-4bdad738d459 could not be found. Aug 23 07:26:47.427707 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi Aug 23 07:26:47.428896 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-917f3740-3bf6-4536-aec8-97d825dd4dcf tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Returning 404 to user: Instance 71485b4e-f619-49d8-87b8-4bdad738d459 could not be found. {{(pid=120799) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 07:26:47.428896 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-917f3740-3bf6-4536-aec8-97d825dd4dcf tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] 10.222.0.17 "GET /compute/v2.1/servers/71485b4e-f619-49d8-87b8-4bdad738d459" status: 404 len: 111 microversion: 2.1 time: 0.032562 Aug 23 07:26:47.428896 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 506/987] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:26:47 2022] GET /compute/v2.1/servers/71485b4e-f619-49d8-87b8-4bdad738d459 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 07:26:47.436190 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-9a24ed3c-b3a4-4aa7-b49c-17e519a106a2 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Calling method '.version_select at 0x7fe3c57cef70>' {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:26:47.456685 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [None req-9a24ed3c-b3a4-4aa7-b49c-17e519a106a2 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1745845198" status: 202 len: 0 microversion: 2.1 time: 0.025299 Aug 23 07:26:47.457467 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 482/988] 10.222.0.17 () {58 vars in 1221 bytes} [Tue Aug 23 07:26:47 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1745845198 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 07:26:50.617153 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-a20458e5-f2c0-41ca-955e-2c47b744a4a4 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Calling method '>' {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:26:50.617709 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.compute.api [None req-a20458e5-f2c0-41ca-955e-2c47b744a4a4 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] [instance: 71485b4e-f619-49d8-87b8-4bdad738d459] Fetching instance by UUID {{(pid=120799) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:26:50.625041 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-a20458e5-f2c0-41ca-955e-2c47b744a4a4 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:26:50.625532 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-a20458e5-f2c0-41ca-955e-2c47b744a4a4 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:26:50.625997 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-a20458e5-f2c0-41ca-955e-2c47b744a4a4 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:26:50.626674 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-a20458e5-f2c0-41ca-955e-2c47b744a4a4 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:26:50.627142 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-a20458e5-f2c0-41ca-955e-2c47b744a4a4 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:26:50.627580 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-a20458e5-f2c0-41ca-955e-2c47b744a4a4 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:26:50.641979 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.wsgi [None req-a20458e5-f2c0-41ca-955e-2c47b744a4a4 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] HTTP exception thrown: Instance 71485b4e-f619-49d8-87b8-4bdad738d459 could not be found. Aug 23 07:26:50.643532 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-a20458e5-f2c0-41ca-955e-2c47b744a4a4 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Request method failure captured: Aug 23 07:26:50.643532 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: request: DELETE /compute/v2.1/servers/71485b4e-f619-49d8-87b8-4bdad738d459 HTTP/1.1 Aug 23 07:26:50.643532 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: Accept: application/json Aug 23 07:26:50.643532 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: Accept-Encoding: identity Aug 23 07:26:50.643532 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: Connection: close Aug 23 07:26:50.643532 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: Content-Length: 0 Aug 23 07:26:50.643532 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: Content-Type: application/json Aug 23 07:26:50.643532 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: Host: 10.222.0.17 Aug 23 07:26:50.643532 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: Openstack-System-Scope: None Aug 23 07:26:50.643532 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: User-Agent: python-urllib3/1.26.11 Aug 23 07:26:50.643532 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-Auth-Token: gAAAAABjBIBJmq6DHW-A2gYFbcOZnE0AbMbwzDvaDD00PoMw7P9dN4LNRmvj31Vqy4o7YIhRD5t_muNOh8YX2_IHQlyNuK7pHas57TNyACofXlXg5G7HfNTpHT5F1ckX4B86E5GktCH3onnZ8M4iMtghVxi_FCvM6cE9FD3nJWtekgjTCPFyeMQ Aug 23 07:26:50.643532 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-Domain-Id: None Aug 23 07:26:50.643532 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-Domain-Name: None Aug 23 07:26:50.643532 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-Identity-Status: Confirmed Aug 23 07:26:50.643532 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-Is-Admin-Project: True Aug 23 07:26:50.643532 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-Project-Domain-Id: default Aug 23 07:26:50.643532 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-Project-Domain-Name: Default Aug 23 07:26:50.643532 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-Project-Id: cfc6e299d69345a3be46c0052d914742 Aug 23 07:26:50.643532 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-Project-Name: tempest-AttachVolumeTestJSON-1864346838 Aug 23 07:26:50.643532 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-Role: reader,member Aug 23 07:26:50.643532 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-Roles: reader,member Aug 23 07:26:50.645070 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/cfc6e299d69345a3be46c0052d914742"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/cfc6e299d69345a3be46c0052d914742"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_cfc6e299d69345a3be46c0052d914742"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/cfc6e299d69345a3be46c0052d914742"}]}] Aug 23 07:26:50.645070 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-Tenant: tempest-AttachVolumeTestJSON-1864346838 Aug 23 07:26:50.645070 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-Tenant-Id: cfc6e299d69345a3be46c0052d914742 Aug 23 07:26:50.645070 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1864346838 Aug 23 07:26:50.645070 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-User: tempest-AttachVolumeTestJSON-1864346838-project Aug 23 07:26:50.645070 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-User-Domain-Id: default Aug 23 07:26:50.645070 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-User-Domain-Name: Default Aug 23 07:26:50.645070 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-User-Id: dbf1799461f6485ea88d25d89559906e Aug 23 07:26:50.645070 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-User-Name: tempest-AttachVolumeTestJSON-1864346838-project Aug 23 07:26:50.645070 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: method: > Aug 23 07:26:50.645070 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: exception: Instance 71485b4e-f619-49d8-87b8-4bdad738d459 could not be found. Aug 23 07:26:50.645070 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: action_args: {'id': '71485b4e-f619-49d8-87b8-4bdad738d459'} Aug 23 07:26:50.645870 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 07:26:50.645870 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 07:26:50.645870 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 07:26:50.645870 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 07:26:50.645870 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 07:26:50.645870 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 07:26:50.645870 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 07:26:50.645870 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 07:26:50.645870 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 07:26:50.645870 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 07:26:50.645870 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 71485b4e-f619-49d8-87b8-4bdad738d459 could not be found. Aug 23 07:26:50.645870 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi Aug 23 07:26:50.645870 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 07:26:50.645870 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi Aug 23 07:26:50.645870 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 07:26:50.645870 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 07:26:50.645870 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 07:26:50.645870 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 07:26:50.645870 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 07:26:50.645870 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 07:26:50.647211 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 07:26:50.647211 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 23 07:26:50.647211 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 23 07:26:50.647211 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 23 07:26:50.647211 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 23 07:26:50.647211 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 07:26:50.647211 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 07:26:50.647211 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 07:26:50.647211 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 07:26:50.647211 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 71485b4e-f619-49d8-87b8-4bdad738d459 could not be found. Aug 23 07:26:50.647211 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi Aug 23 07:26:50.647211 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 07:26:50.647211 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi Aug 23 07:26:50.647211 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 07:26:50.647211 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 07:26:50.647211 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 07:26:50.647211 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 07:26:50.647211 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 07:26:50.647211 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 71485b4e-f619-49d8-87b8-4bdad738d459 could not be found. Aug 23 07:26:50.647211 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi Aug 23 07:26:50.648558 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-a20458e5-f2c0-41ca-955e-2c47b744a4a4 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Returning 404 to user: Instance 71485b4e-f619-49d8-87b8-4bdad738d459 could not be found. {{(pid=120799) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 07:26:50.648558 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-a20458e5-f2c0-41ca-955e-2c47b744a4a4 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] 10.222.0.17 "DELETE /compute/v2.1/servers/71485b4e-f619-49d8-87b8-4bdad738d459" status: 404 len: 111 microversion: 2.1 time: 0.031753 Aug 23 07:26:50.648558 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 507/989] 10.222.0.17 () {58 vars in 1239 bytes} [Tue Aug 23 07:26:50 2022] DELETE /compute/v2.1/servers/71485b4e-f619-49d8-87b8-4bdad738d459 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 07:26:50.654654 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-b7227860-6e9d-47e1-8946-fb92946b9489 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Calling method '>' {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:26:50.655389 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.compute.api [None req-b7227860-6e9d-47e1-8946-fb92946b9489 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] [instance: 71485b4e-f619-49d8-87b8-4bdad738d459] Fetching instance by UUID {{(pid=120798) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:26:50.662457 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-b7227860-6e9d-47e1-8946-fb92946b9489 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:26:50.662933 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-b7227860-6e9d-47e1-8946-fb92946b9489 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:26:50.663367 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-b7227860-6e9d-47e1-8946-fb92946b9489 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:26:50.664082 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-b7227860-6e9d-47e1-8946-fb92946b9489 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:26:50.664528 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-b7227860-6e9d-47e1-8946-fb92946b9489 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:26:50.664947 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-b7227860-6e9d-47e1-8946-fb92946b9489 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:26:50.678960 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.wsgi [None req-b7227860-6e9d-47e1-8946-fb92946b9489 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] HTTP exception thrown: Instance 71485b4e-f619-49d8-87b8-4bdad738d459 could not be found. Aug 23 07:26:50.680647 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-b7227860-6e9d-47e1-8946-fb92946b9489 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Request method failure captured: Aug 23 07:26:50.680647 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: request: GET /compute/v2.1/servers/71485b4e-f619-49d8-87b8-4bdad738d459 HTTP/1.1 Aug 23 07:26:50.680647 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: Accept: application/json Aug 23 07:26:50.680647 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: Accept-Encoding: identity Aug 23 07:26:50.680647 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: Connection: close Aug 23 07:26:50.680647 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: Content-Length: 0 Aug 23 07:26:50.680647 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: Content-Type: application/json Aug 23 07:26:50.680647 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: Host: 10.222.0.17 Aug 23 07:26:50.680647 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: Openstack-System-Scope: None Aug 23 07:26:50.680647 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: User-Agent: python-urllib3/1.26.11 Aug 23 07:26:50.680647 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-Auth-Token: gAAAAABjBIBJmq6DHW-A2gYFbcOZnE0AbMbwzDvaDD00PoMw7P9dN4LNRmvj31Vqy4o7YIhRD5t_muNOh8YX2_IHQlyNuK7pHas57TNyACofXlXg5G7HfNTpHT5F1ckX4B86E5GktCH3onnZ8M4iMtghVxi_FCvM6cE9FD3nJWtekgjTCPFyeMQ Aug 23 07:26:50.680647 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-Domain-Id: None Aug 23 07:26:50.680647 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-Domain-Name: None Aug 23 07:26:50.680647 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-Identity-Status: Confirmed Aug 23 07:26:50.680647 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-Is-Admin-Project: True Aug 23 07:26:50.680647 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-Project-Domain-Id: default Aug 23 07:26:50.680647 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-Project-Domain-Name: Default Aug 23 07:26:50.680647 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-Project-Id: cfc6e299d69345a3be46c0052d914742 Aug 23 07:26:50.680647 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-Project-Name: tempest-AttachVolumeTestJSON-1864346838 Aug 23 07:26:50.680647 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-Role: reader,member Aug 23 07:26:50.680647 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-Roles: reader,member Aug 23 07:26:50.682027 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/cfc6e299d69345a3be46c0052d914742"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/cfc6e299d69345a3be46c0052d914742"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_cfc6e299d69345a3be46c0052d914742"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/cfc6e299d69345a3be46c0052d914742"}]}] Aug 23 07:26:50.682027 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-Tenant: tempest-AttachVolumeTestJSON-1864346838 Aug 23 07:26:50.682027 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-Tenant-Id: cfc6e299d69345a3be46c0052d914742 Aug 23 07:26:50.682027 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1864346838 Aug 23 07:26:50.682027 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-User: tempest-AttachVolumeTestJSON-1864346838-project Aug 23 07:26:50.682027 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-User-Domain-Id: default Aug 23 07:26:50.682027 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-User-Domain-Name: Default Aug 23 07:26:50.682027 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-User-Id: dbf1799461f6485ea88d25d89559906e Aug 23 07:26:50.682027 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-User-Name: tempest-AttachVolumeTestJSON-1864346838-project Aug 23 07:26:50.682027 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: method: > Aug 23 07:26:50.682027 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: exception: Instance 71485b4e-f619-49d8-87b8-4bdad738d459 could not be found. Aug 23 07:26:50.682027 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: action_args: {'id': '71485b4e-f619-49d8-87b8-4bdad738d459'} Aug 23 07:26:50.682778 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 07:26:50.682778 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 07:26:50.682778 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 07:26:50.682778 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 07:26:50.682778 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 07:26:50.682778 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 07:26:50.682778 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 07:26:50.682778 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 07:26:50.682778 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 07:26:50.682778 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 07:26:50.682778 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 71485b4e-f619-49d8-87b8-4bdad738d459 could not be found. Aug 23 07:26:50.682778 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi Aug 23 07:26:50.682778 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 07:26:50.682778 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi Aug 23 07:26:50.682778 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 07:26:50.682778 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 07:26:50.682778 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 07:26:50.682778 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 07:26:50.682778 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 07:26:50.682778 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 07:26:50.687476 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 07:26:50.687476 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 07:26:50.687476 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 07:26:50.687476 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 07:26:50.687476 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 07:26:50.687476 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 07:26:50.687476 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 07:26:50.687476 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 71485b4e-f619-49d8-87b8-4bdad738d459 could not be found. Aug 23 07:26:50.687476 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi Aug 23 07:26:50.687476 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 07:26:50.687476 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi Aug 23 07:26:50.687476 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 07:26:50.687476 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 07:26:50.687476 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 07:26:50.687476 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 07:26:50.687476 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 07:26:50.687476 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 71485b4e-f619-49d8-87b8-4bdad738d459 could not be found. Aug 23 07:26:50.687476 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi Aug 23 07:26:50.688824 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-b7227860-6e9d-47e1-8946-fb92946b9489 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Returning 404 to user: Instance 71485b4e-f619-49d8-87b8-4bdad738d459 could not be found. {{(pid=120798) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 07:26:50.688824 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [None req-b7227860-6e9d-47e1-8946-fb92946b9489 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] 10.222.0.17 "GET /compute/v2.1/servers/71485b4e-f619-49d8-87b8-4bdad738d459" status: 404 len: 111 microversion: 2.1 time: 0.032369 Aug 23 07:26:50.688824 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 483/990] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:26:50 2022] GET /compute/v2.1/servers/71485b4e-f619-49d8-87b8-4bdad738d459 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 23 07:26:51.834934 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-7d6474c0-9c40-4727-a246-9d3528537606 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Calling method '>' {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:26:51.835433 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.compute.api [None req-7d6474c0-9c40-4727-a246-9d3528537606 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] [instance: 409e70de-71fb-4ecd-ad90-41217f78bd4d] Fetching instance by UUID {{(pid=120799) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:26:51.842185 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-7d6474c0-9c40-4727-a246-9d3528537606 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:26:51.842662 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-7d6474c0-9c40-4727-a246-9d3528537606 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:26:51.843105 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-7d6474c0-9c40-4727-a246-9d3528537606 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:26:51.843825 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-7d6474c0-9c40-4727-a246-9d3528537606 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:26:51.844298 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-7d6474c0-9c40-4727-a246-9d3528537606 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:26:51.844704 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-7d6474c0-9c40-4727-a246-9d3528537606 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:26:51.858918 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.wsgi [None req-7d6474c0-9c40-4727-a246-9d3528537606 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] HTTP exception thrown: Instance 409e70de-71fb-4ecd-ad90-41217f78bd4d could not be found. Aug 23 07:26:51.860561 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-7d6474c0-9c40-4727-a246-9d3528537606 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Request method failure captured: Aug 23 07:26:51.860561 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: request: DELETE /compute/v2.1/servers/409e70de-71fb-4ecd-ad90-41217f78bd4d HTTP/1.1 Aug 23 07:26:51.860561 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: Accept: application/json Aug 23 07:26:51.860561 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: Accept-Encoding: identity Aug 23 07:26:51.860561 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: Connection: close Aug 23 07:26:51.860561 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: Content-Length: 0 Aug 23 07:26:51.860561 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: Content-Type: application/json Aug 23 07:26:51.860561 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: Host: 10.222.0.17 Aug 23 07:26:51.860561 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: Openstack-System-Scope: None Aug 23 07:26:51.860561 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: User-Agent: python-urllib3/1.26.11 Aug 23 07:26:51.860561 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-Auth-Token: gAAAAABjBIBJmq6DHW-A2gYFbcOZnE0AbMbwzDvaDD00PoMw7P9dN4LNRmvj31Vqy4o7YIhRD5t_muNOh8YX2_IHQlyNuK7pHas57TNyACofXlXg5G7HfNTpHT5F1ckX4B86E5GktCH3onnZ8M4iMtghVxi_FCvM6cE9FD3nJWtekgjTCPFyeMQ Aug 23 07:26:51.860561 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-Domain-Id: None Aug 23 07:26:51.860561 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-Domain-Name: None Aug 23 07:26:51.860561 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-Identity-Status: Confirmed Aug 23 07:26:51.860561 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-Is-Admin-Project: True Aug 23 07:26:51.860561 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-Project-Domain-Id: default Aug 23 07:26:51.860561 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-Project-Domain-Name: Default Aug 23 07:26:51.860561 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-Project-Id: cfc6e299d69345a3be46c0052d914742 Aug 23 07:26:51.860561 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-Project-Name: tempest-AttachVolumeTestJSON-1864346838 Aug 23 07:26:51.860561 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-Role: reader,member Aug 23 07:26:51.860561 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-Roles: reader,member Aug 23 07:26:51.862128 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/cfc6e299d69345a3be46c0052d914742"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/cfc6e299d69345a3be46c0052d914742"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_cfc6e299d69345a3be46c0052d914742"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/cfc6e299d69345a3be46c0052d914742"}]}] Aug 23 07:26:51.862128 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-Tenant: tempest-AttachVolumeTestJSON-1864346838 Aug 23 07:26:51.862128 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-Tenant-Id: cfc6e299d69345a3be46c0052d914742 Aug 23 07:26:51.862128 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1864346838 Aug 23 07:26:51.862128 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-User: tempest-AttachVolumeTestJSON-1864346838-project Aug 23 07:26:51.862128 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-User-Domain-Id: default Aug 23 07:26:51.862128 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-User-Domain-Name: Default Aug 23 07:26:51.862128 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-User-Id: dbf1799461f6485ea88d25d89559906e Aug 23 07:26:51.862128 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-User-Name: tempest-AttachVolumeTestJSON-1864346838-project Aug 23 07:26:51.862128 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: method: > Aug 23 07:26:51.862128 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: exception: Instance 409e70de-71fb-4ecd-ad90-41217f78bd4d could not be found. Aug 23 07:26:51.862128 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: action_args: {'id': '409e70de-71fb-4ecd-ad90-41217f78bd4d'} Aug 23 07:26:51.862932 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 07:26:51.862932 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 07:26:51.862932 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 07:26:51.862932 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 07:26:51.862932 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 07:26:51.862932 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 07:26:51.862932 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 07:26:51.862932 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 07:26:51.862932 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 07:26:51.862932 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 07:26:51.862932 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 409e70de-71fb-4ecd-ad90-41217f78bd4d could not be found. Aug 23 07:26:51.862932 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi Aug 23 07:26:51.862932 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 07:26:51.862932 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi Aug 23 07:26:51.862932 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 07:26:51.862932 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 07:26:51.862932 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 07:26:51.862932 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 07:26:51.862932 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 07:26:51.862932 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 07:26:51.864247 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 07:26:51.864247 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 23 07:26:51.864247 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 23 07:26:51.864247 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 23 07:26:51.864247 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 23 07:26:51.864247 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 07:26:51.864247 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 07:26:51.864247 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 07:26:51.864247 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 07:26:51.864247 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 409e70de-71fb-4ecd-ad90-41217f78bd4d could not be found. Aug 23 07:26:51.864247 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi Aug 23 07:26:51.864247 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 07:26:51.864247 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi Aug 23 07:26:51.864247 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 07:26:51.864247 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 07:26:51.864247 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 07:26:51.864247 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 07:26:51.864247 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 07:26:51.864247 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 409e70de-71fb-4ecd-ad90-41217f78bd4d could not be found. Aug 23 07:26:51.864247 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi Aug 23 07:26:51.865609 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-7d6474c0-9c40-4727-a246-9d3528537606 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Returning 404 to user: Instance 409e70de-71fb-4ecd-ad90-41217f78bd4d could not be found. {{(pid=120799) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 07:26:51.865609 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-7d6474c0-9c40-4727-a246-9d3528537606 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] 10.222.0.17 "DELETE /compute/v2.1/servers/409e70de-71fb-4ecd-ad90-41217f78bd4d" status: 404 len: 111 microversion: 2.1 time: 0.030955 Aug 23 07:26:51.865609 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 508/991] 10.222.0.17 () {58 vars in 1239 bytes} [Tue Aug 23 07:26:51 2022] DELETE /compute/v2.1/servers/409e70de-71fb-4ecd-ad90-41217f78bd4d => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 07:26:51.871059 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-7db850f9-69e2-49e5-9510-e9e23c19e8c7 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Calling method '>' {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:26:51.871706 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.compute.api [None req-7db850f9-69e2-49e5-9510-e9e23c19e8c7 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] [instance: 409e70de-71fb-4ecd-ad90-41217f78bd4d] Fetching instance by UUID {{(pid=120798) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:26:51.879095 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-7db850f9-69e2-49e5-9510-e9e23c19e8c7 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:26:51.879612 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-7db850f9-69e2-49e5-9510-e9e23c19e8c7 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:26:51.880052 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-7db850f9-69e2-49e5-9510-e9e23c19e8c7 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:26:51.880743 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-7db850f9-69e2-49e5-9510-e9e23c19e8c7 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:26:51.881204 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-7db850f9-69e2-49e5-9510-e9e23c19e8c7 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:26:51.881630 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-7db850f9-69e2-49e5-9510-e9e23c19e8c7 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:26:51.895447 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.wsgi [None req-7db850f9-69e2-49e5-9510-e9e23c19e8c7 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] HTTP exception thrown: Instance 409e70de-71fb-4ecd-ad90-41217f78bd4d could not be found. Aug 23 07:26:51.896986 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-7db850f9-69e2-49e5-9510-e9e23c19e8c7 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Request method failure captured: Aug 23 07:26:51.896986 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: request: GET /compute/v2.1/servers/409e70de-71fb-4ecd-ad90-41217f78bd4d HTTP/1.1 Aug 23 07:26:51.896986 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: Accept: application/json Aug 23 07:26:51.896986 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: Accept-Encoding: identity Aug 23 07:26:51.896986 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: Connection: close Aug 23 07:26:51.896986 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: Content-Length: 0 Aug 23 07:26:51.896986 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: Content-Type: application/json Aug 23 07:26:51.896986 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: Host: 10.222.0.17 Aug 23 07:26:51.896986 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: Openstack-System-Scope: None Aug 23 07:26:51.896986 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: User-Agent: python-urllib3/1.26.11 Aug 23 07:26:51.896986 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-Auth-Token: gAAAAABjBIBJmq6DHW-A2gYFbcOZnE0AbMbwzDvaDD00PoMw7P9dN4LNRmvj31Vqy4o7YIhRD5t_muNOh8YX2_IHQlyNuK7pHas57TNyACofXlXg5G7HfNTpHT5F1ckX4B86E5GktCH3onnZ8M4iMtghVxi_FCvM6cE9FD3nJWtekgjTCPFyeMQ Aug 23 07:26:51.896986 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-Domain-Id: None Aug 23 07:26:51.896986 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-Domain-Name: None Aug 23 07:26:51.896986 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-Identity-Status: Confirmed Aug 23 07:26:51.896986 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-Is-Admin-Project: True Aug 23 07:26:51.896986 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-Project-Domain-Id: default Aug 23 07:26:51.896986 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-Project-Domain-Name: Default Aug 23 07:26:51.896986 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-Project-Id: cfc6e299d69345a3be46c0052d914742 Aug 23 07:26:51.896986 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-Project-Name: tempest-AttachVolumeTestJSON-1864346838 Aug 23 07:26:51.896986 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-Role: reader,member Aug 23 07:26:51.896986 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-Roles: reader,member Aug 23 07:26:51.898541 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/cfc6e299d69345a3be46c0052d914742"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/cfc6e299d69345a3be46c0052d914742"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_cfc6e299d69345a3be46c0052d914742"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/cfc6e299d69345a3be46c0052d914742"}]}] Aug 23 07:26:51.898541 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-Tenant: tempest-AttachVolumeTestJSON-1864346838 Aug 23 07:26:51.898541 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-Tenant-Id: cfc6e299d69345a3be46c0052d914742 Aug 23 07:26:51.898541 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1864346838 Aug 23 07:26:51.898541 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-User: tempest-AttachVolumeTestJSON-1864346838-project Aug 23 07:26:51.898541 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-User-Domain-Id: default Aug 23 07:26:51.898541 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-User-Domain-Name: Default Aug 23 07:26:51.898541 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-User-Id: dbf1799461f6485ea88d25d89559906e Aug 23 07:26:51.898541 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-User-Name: tempest-AttachVolumeTestJSON-1864346838-project Aug 23 07:26:51.898541 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: method: > Aug 23 07:26:51.898541 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: exception: Instance 409e70de-71fb-4ecd-ad90-41217f78bd4d could not be found. Aug 23 07:26:51.898541 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: action_args: {'id': '409e70de-71fb-4ecd-ad90-41217f78bd4d'} Aug 23 07:26:51.899387 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 07:26:51.899387 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 07:26:51.899387 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 07:26:51.899387 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 07:26:51.899387 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 07:26:51.899387 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 07:26:51.899387 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 07:26:51.899387 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 07:26:51.899387 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 07:26:51.899387 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 07:26:51.899387 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 409e70de-71fb-4ecd-ad90-41217f78bd4d could not be found. Aug 23 07:26:51.899387 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi Aug 23 07:26:51.899387 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 07:26:51.899387 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi Aug 23 07:26:51.899387 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 07:26:51.899387 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 07:26:51.899387 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 07:26:51.899387 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 07:26:51.899387 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 07:26:51.899387 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 07:26:51.900648 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 07:26:51.900648 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 07:26:51.900648 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 07:26:51.900648 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 07:26:51.900648 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 07:26:51.900648 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 07:26:51.900648 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 07:26:51.900648 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 409e70de-71fb-4ecd-ad90-41217f78bd4d could not be found. Aug 23 07:26:51.900648 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi Aug 23 07:26:51.900648 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 07:26:51.900648 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi Aug 23 07:26:51.900648 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 07:26:51.900648 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 07:26:51.900648 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 07:26:51.900648 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 07:26:51.900648 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 07:26:51.900648 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 409e70de-71fb-4ecd-ad90-41217f78bd4d could not be found. Aug 23 07:26:51.900648 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi Aug 23 07:26:51.901741 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-7db850f9-69e2-49e5-9510-e9e23c19e8c7 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] Returning 404 to user: Instance 409e70de-71fb-4ecd-ad90-41217f78bd4d could not be found. {{(pid=120798) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 07:26:51.901741 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [None req-7db850f9-69e2-49e5-9510-e9e23c19e8c7 tempest-AttachVolumeTestJSON-1864346838 tempest-AttachVolumeTestJSON-1864346838-project] 10.222.0.17 "GET /compute/v2.1/servers/409e70de-71fb-4ecd-ad90-41217f78bd4d" status: 404 len: 111 microversion: 2.1 time: 0.031379 Aug 23 07:26:51.901741 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 484/992] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:26:51 2022] GET /compute/v2.1/servers/409e70de-71fb-4ecd-ad90-41217f78bd4d => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 07:27:27.136763 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-9512d2ad-35ae-4530-ad48-b9b5e0065500 tempest-VolumesSnapshotTestJSON-1785130454 tempest-VolumesSnapshotTestJSON-1785130454-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-559152532", "imageRef": "b899fd65-02ae-4b43-bac7-86f38fc3f224", "flavorRef": "452", "networks": [{"uuid": "f3e7e28f-0965-4ed7-9dee-2d6c6f18aa47"}]}} {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 07:27:27.145604 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG dbcounter [-] [120799] Writing DB stats nova_api:SELECT=22 {{(pid=120799) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:27:27.146259 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG dbcounter [-] [120799] Writing DB stats nova_cell1:SELECT=65,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=120799) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:27:27.196518 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.network.neutron [None req-9512d2ad-35ae-4530-ad48-b9b5e0065500 tempest-VolumesSnapshotTestJSON-1785130454 tempest-VolumesSnapshotTestJSON-1785130454-project] validate_networks() for [('f3e7e28f-0965-4ed7-9dee-2d6c6f18aa47', None, None, None, None, None)] {{(pid=120799) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 23 07:27:27.636514 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.virt.hardware [None req-9512d2ad-35ae-4530-ad48-b9b5e0065500 tempest-VolumesSnapshotTestJSON-1785130454 tempest-VolumesSnapshotTestJSON-1785130454-project] Flavor limits 0:0:0 {{(pid=120799) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 07:27:27.637184 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.virt.hardware [None req-9512d2ad-35ae-4530-ad48-b9b5e0065500 tempest-VolumesSnapshotTestJSON-1785130454 tempest-VolumesSnapshotTestJSON-1785130454-project] Image limits 0:0:0 {{(pid=120799) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 07:27:27.637982 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.virt.hardware [None req-9512d2ad-35ae-4530-ad48-b9b5e0065500 tempest-VolumesSnapshotTestJSON-1785130454 tempest-VolumesSnapshotTestJSON-1785130454-project] Flavor pref 0:0:0 {{(pid=120799) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 07:27:27.638643 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.virt.hardware [None req-9512d2ad-35ae-4530-ad48-b9b5e0065500 tempest-VolumesSnapshotTestJSON-1785130454 tempest-VolumesSnapshotTestJSON-1785130454-project] Image pref 0:0:0 {{(pid=120799) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 07:27:27.639278 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.virt.hardware [None req-9512d2ad-35ae-4530-ad48-b9b5e0065500 tempest-VolumesSnapshotTestJSON-1785130454 tempest-VolumesSnapshotTestJSON-1785130454-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120799) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 07:27:27.650078 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-9512d2ad-35ae-4530-ad48-b9b5e0065500 tempest-VolumesSnapshotTestJSON-1785130454 tempest-VolumesSnapshotTestJSON-1785130454-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:27:27.650558 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-9512d2ad-35ae-4530-ad48-b9b5e0065500 tempest-VolumesSnapshotTestJSON-1785130454 tempest-VolumesSnapshotTestJSON-1785130454-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:27:27.650998 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-9512d2ad-35ae-4530-ad48-b9b5e0065500 tempest-VolumesSnapshotTestJSON-1785130454 tempest-VolumesSnapshotTestJSON-1785130454-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:27:27.651756 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-9512d2ad-35ae-4530-ad48-b9b5e0065500 tempest-VolumesSnapshotTestJSON-1785130454 tempest-VolumesSnapshotTestJSON-1785130454-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:27:27.652208 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-9512d2ad-35ae-4530-ad48-b9b5e0065500 tempest-VolumesSnapshotTestJSON-1785130454 tempest-VolumesSnapshotTestJSON-1785130454-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:27:27.652639 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-9512d2ad-35ae-4530-ad48-b9b5e0065500 tempest-VolumesSnapshotTestJSON-1785130454 tempest-VolumesSnapshotTestJSON-1785130454-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:27:27.670308 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.quota [None req-9512d2ad-35ae-4530-ad48-b9b5e0065500 tempest-VolumesSnapshotTestJSON-1785130454 tempest-VolumesSnapshotTestJSON-1785130454-project] Getting quotas for project 5b02989040ab4080855af2e66c942060. Resources: {'ram', 'instances', 'cores'} {{(pid=120799) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 07:27:27.674820 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.quota [None req-9512d2ad-35ae-4530-ad48-b9b5e0065500 tempest-VolumesSnapshotTestJSON-1785130454 tempest-VolumesSnapshotTestJSON-1785130454-project] Getting quotas for user ac00970326df432bb130e44ed04db3b5 and project 5b02989040ab4080855af2e66c942060. Resources: {'ram', 'instances', 'cores'} {{(pid=120799) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 07:27:27.687079 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.compute.api [None req-9512d2ad-35ae-4530-ad48-b9b5e0065500 tempest-VolumesSnapshotTestJSON-1785130454 tempest-VolumesSnapshotTestJSON-1785130454-project] Going to run 1 instances... {{(pid=120799) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 23 07:27:27.689455 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.compute.api [None req-9512d2ad-35ae-4530-ad48-b9b5e0065500 tempest-VolumesSnapshotTestJSON-1785130454 tempest-VolumesSnapshotTestJSON-1785130454-project] [instance: 27a3025a-f125-4e49-81cf-d1b3804a04ef] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b899fd65-02ae-4b43-bac7-86f38fc3f224',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120799) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 07:27:27.738161 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-9512d2ad-35ae-4530-ad48-b9b5e0065500 tempest-VolumesSnapshotTestJSON-1785130454 tempest-VolumesSnapshotTestJSON-1785130454-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.605309 Aug 23 07:27:27.738801 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 509/993] 10.222.0.17 () {60 vars in 1147 bytes} [Tue Aug 23 07:27:27 2022] POST /compute/v2.1/servers => generated 380 bytes in 607 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 23 07:27:27.750086 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-5189ddca-b4da-4c74-ad89-dd4e81f706af tempest-VolumesSnapshotTestJSON-1785130454 tempest-VolumesSnapshotTestJSON-1785130454-project] Calling method '>' {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:27:27.750804 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.compute.api [None req-5189ddca-b4da-4c74-ad89-dd4e81f706af tempest-VolumesSnapshotTestJSON-1785130454 tempest-VolumesSnapshotTestJSON-1785130454-project] [instance: 27a3025a-f125-4e49-81cf-d1b3804a04ef] Fetching instance by UUID {{(pid=120798) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:27:27.753387 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG dbcounter [-] [120798] Writing DB stats nova_api:SELECT=30,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120798) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:27:27.754504 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG dbcounter [-] [120798] Writing DB stats nova_cell1:SELECT=65,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120798) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:27:27.811042 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.policy [None req-5189ddca-b4da-4c74-ad89-dd4e81f706af tempest-VolumesSnapshotTestJSON-1785130454 tempest-VolumesSnapshotTestJSON-1785130454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac00970326df432bb130e44ed04db3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b02989040ab4080855af2e66c942060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120798) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:27:27.818852 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [None req-5189ddca-b4da-4c74-ad89-dd4e81f706af tempest-VolumesSnapshotTestJSON-1785130454 tempest-VolumesSnapshotTestJSON-1785130454-project] 10.222.0.17 "GET /compute/v2.1/servers/27a3025a-f125-4e49-81cf-d1b3804a04ef" status: 200 len: 1218 microversion: 2.1 time: 0.072994 Aug 23 07:27:27.819633 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 485/994] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:27:27 2022] GET /compute/v2.1/servers/27a3025a-f125-4e49-81cf-d1b3804a04ef => generated 1218 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:27:28.843501 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-413ecd42-3e79-4f08-a174-c9e0da0ba143 tempest-VolumesSnapshotTestJSON-1785130454 tempest-VolumesSnapshotTestJSON-1785130454-project] Calling method '>' {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:27:28.844118 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.compute.api [None req-413ecd42-3e79-4f08-a174-c9e0da0ba143 tempest-VolumesSnapshotTestJSON-1785130454 tempest-VolumesSnapshotTestJSON-1785130454-project] [instance: 27a3025a-f125-4e49-81cf-d1b3804a04ef] Fetching instance by UUID {{(pid=120799) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:27:28.853302 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-413ecd42-3e79-4f08-a174-c9e0da0ba143 tempest-VolumesSnapshotTestJSON-1785130454 tempest-VolumesSnapshotTestJSON-1785130454-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:27:28.853870 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-413ecd42-3e79-4f08-a174-c9e0da0ba143 tempest-VolumesSnapshotTestJSON-1785130454 tempest-VolumesSnapshotTestJSON-1785130454-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:27:28.854416 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-413ecd42-3e79-4f08-a174-c9e0da0ba143 tempest-VolumesSnapshotTestJSON-1785130454 tempest-VolumesSnapshotTestJSON-1785130454-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:27:28.855859 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-413ecd42-3e79-4f08-a174-c9e0da0ba143 tempest-VolumesSnapshotTestJSON-1785130454 tempest-VolumesSnapshotTestJSON-1785130454-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:27:28.856468 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-413ecd42-3e79-4f08-a174-c9e0da0ba143 tempest-VolumesSnapshotTestJSON-1785130454 tempest-VolumesSnapshotTestJSON-1785130454-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:27:28.856885 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-413ecd42-3e79-4f08-a174-c9e0da0ba143 tempest-VolumesSnapshotTestJSON-1785130454 tempest-VolumesSnapshotTestJSON-1785130454-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:27:28.919466 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.policy [None req-413ecd42-3e79-4f08-a174-c9e0da0ba143 tempest-VolumesSnapshotTestJSON-1785130454 tempest-VolumesSnapshotTestJSON-1785130454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac00970326df432bb130e44ed04db3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b02989040ab4080855af2e66c942060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120799) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:27:28.927884 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-413ecd42-3e79-4f08-a174-c9e0da0ba143 tempest-VolumesSnapshotTestJSON-1785130454 tempest-VolumesSnapshotTestJSON-1785130454-project] 10.222.0.17 "GET /compute/v2.1/servers/27a3025a-f125-4e49-81cf-d1b3804a04ef" status: 200 len: 1276 microversion: 2.1 time: 0.088339 Aug 23 07:27:28.928456 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 510/995] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:27:28 2022] GET /compute/v2.1/servers/27a3025a-f125-4e49-81cf-d1b3804a04ef => generated 1276 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:27:29.948964 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-bf04a041-c0c5-4dba-83ed-36cc996b9fd0 tempest-VolumesSnapshotTestJSON-1785130454 tempest-VolumesSnapshotTestJSON-1785130454-project] Calling method '>' {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:27:29.949849 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.compute.api [None req-bf04a041-c0c5-4dba-83ed-36cc996b9fd0 tempest-VolumesSnapshotTestJSON-1785130454 tempest-VolumesSnapshotTestJSON-1785130454-project] [instance: 27a3025a-f125-4e49-81cf-d1b3804a04ef] Fetching instance by UUID {{(pid=120798) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:27:29.956783 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-bf04a041-c0c5-4dba-83ed-36cc996b9fd0 tempest-VolumesSnapshotTestJSON-1785130454 tempest-VolumesSnapshotTestJSON-1785130454-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:27:29.957392 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-bf04a041-c0c5-4dba-83ed-36cc996b9fd0 tempest-VolumesSnapshotTestJSON-1785130454 tempest-VolumesSnapshotTestJSON-1785130454-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:27:29.957824 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-bf04a041-c0c5-4dba-83ed-36cc996b9fd0 tempest-VolumesSnapshotTestJSON-1785130454 tempest-VolumesSnapshotTestJSON-1785130454-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:27:29.958524 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-bf04a041-c0c5-4dba-83ed-36cc996b9fd0 tempest-VolumesSnapshotTestJSON-1785130454 tempest-VolumesSnapshotTestJSON-1785130454-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:27:29.958970 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-bf04a041-c0c5-4dba-83ed-36cc996b9fd0 tempest-VolumesSnapshotTestJSON-1785130454 tempest-VolumesSnapshotTestJSON-1785130454-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:27:29.959390 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-bf04a041-c0c5-4dba-83ed-36cc996b9fd0 tempest-VolumesSnapshotTestJSON-1785130454 tempest-VolumesSnapshotTestJSON-1785130454-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:27:30.002367 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [req-f2f46626-018a-40c5-8b08-c8ebed68783b req-1457260a-1ede-462d-845b-8710ddbb54f4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "27a3025a-f125-4e49-81cf-d1b3804a04ef", "tag": "a3cb574e-d715-47d3-a4a9-10cf401aed24"}]} {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 07:27:30.041545 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [req-f2f46626-018a-40c5-8b08-c8ebed68783b req-1457260a-1ede-462d-845b-8710ddbb54f4 service nova] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:27:30.042908 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [req-f2f46626-018a-40c5-8b08-c8ebed68783b req-1457260a-1ede-462d-845b-8710ddbb54f4 service nova] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:27:30.044016 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [req-f2f46626-018a-40c5-8b08-c8ebed68783b req-1457260a-1ede-462d-845b-8710ddbb54f4 service nova] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:27:30.058345 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.compute.server_external_events [req-f2f46626-018a-40c5-8b08-c8ebed68783b req-1457260a-1ede-462d-845b-8710ddbb54f4 service nova] Creating event network-changed:a3cb574e-d715-47d3-a4a9-10cf401aed24 for instance 27a3025a-f125-4e49-81cf-d1b3804a04ef on hv-cinder-85409 Aug 23 07:27:30.064232 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [req-f2f46626-018a-40c5-8b08-c8ebed68783b req-1457260a-1ede-462d-845b-8710ddbb54f4 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066491 Aug 23 07:27:30.065212 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 511/996] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Aug 23 07:27:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 07:27:30.125858 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.policy [None req-bf04a041-c0c5-4dba-83ed-36cc996b9fd0 tempest-VolumesSnapshotTestJSON-1785130454 tempest-VolumesSnapshotTestJSON-1785130454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac00970326df432bb130e44ed04db3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b02989040ab4080855af2e66c942060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120798) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:27:30.134634 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [None req-bf04a041-c0c5-4dba-83ed-36cc996b9fd0 tempest-VolumesSnapshotTestJSON-1785130454 tempest-VolumesSnapshotTestJSON-1785130454-project] 10.222.0.17 "GET /compute/v2.1/servers/27a3025a-f125-4e49-81cf-d1b3804a04ef" status: 200 len: 1318 microversion: 2.1 time: 0.189556 Aug 23 07:27:30.135212 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 486/997] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:27:29 2022] GET /compute/v2.1/servers/27a3025a-f125-4e49-81cf-d1b3804a04ef => generated 1318 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:27:31.158138 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-ca36b53b-c4ff-43a4-a8f4-26a489136b52 tempest-VolumesSnapshotTestJSON-1785130454 tempest-VolumesSnapshotTestJSON-1785130454-project] Calling method '>' {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:27:31.159379 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.compute.api [None req-ca36b53b-c4ff-43a4-a8f4-26a489136b52 tempest-VolumesSnapshotTestJSON-1785130454 tempest-VolumesSnapshotTestJSON-1785130454-project] [instance: 27a3025a-f125-4e49-81cf-d1b3804a04ef] Fetching instance by UUID {{(pid=120799) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:27:31.166892 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-ca36b53b-c4ff-43a4-a8f4-26a489136b52 tempest-VolumesSnapshotTestJSON-1785130454 tempest-VolumesSnapshotTestJSON-1785130454-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:27:31.167405 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-ca36b53b-c4ff-43a4-a8f4-26a489136b52 tempest-VolumesSnapshotTestJSON-1785130454 tempest-VolumesSnapshotTestJSON-1785130454-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:27:31.167919 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-ca36b53b-c4ff-43a4-a8f4-26a489136b52 tempest-VolumesSnapshotTestJSON-1785130454 tempest-VolumesSnapshotTestJSON-1785130454-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:27:31.168668 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-ca36b53b-c4ff-43a4-a8f4-26a489136b52 tempest-VolumesSnapshotTestJSON-1785130454 tempest-VolumesSnapshotTestJSON-1785130454-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:27:31.169161 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-ca36b53b-c4ff-43a4-a8f4-26a489136b52 tempest-VolumesSnapshotTestJSON-1785130454 tempest-VolumesSnapshotTestJSON-1785130454-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:27:31.169624 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-ca36b53b-c4ff-43a4-a8f4-26a489136b52 tempest-VolumesSnapshotTestJSON-1785130454 tempest-VolumesSnapshotTestJSON-1785130454-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:27:31.310159 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.policy [None req-ca36b53b-c4ff-43a4-a8f4-26a489136b52 tempest-VolumesSnapshotTestJSON-1785130454 tempest-VolumesSnapshotTestJSON-1785130454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac00970326df432bb130e44ed04db3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b02989040ab4080855af2e66c942060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120799) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:27:31.322580 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-ca36b53b-c4ff-43a4-a8f4-26a489136b52 tempest-VolumesSnapshotTestJSON-1785130454 tempest-VolumesSnapshotTestJSON-1785130454-project] 10.222.0.17 "GET /compute/v2.1/servers/27a3025a-f125-4e49-81cf-d1b3804a04ef" status: 200 len: 1318 microversion: 2.1 time: 0.169673 Aug 23 07:27:31.323343 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 512/998] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:27:31 2022] GET /compute/v2.1/servers/27a3025a-f125-4e49-81cf-d1b3804a04ef => generated 1318 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:27:32.349803 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-167c042f-4616-49fd-87f2-0191d55018d3 tempest-VolumesSnapshotTestJSON-1785130454 tempest-VolumesSnapshotTestJSON-1785130454-project] Calling method '>' {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:27:32.350422 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.compute.api [None req-167c042f-4616-49fd-87f2-0191d55018d3 tempest-VolumesSnapshotTestJSON-1785130454 tempest-VolumesSnapshotTestJSON-1785130454-project] [instance: 27a3025a-f125-4e49-81cf-d1b3804a04ef] Fetching instance by UUID {{(pid=120798) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:27:32.357970 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-167c042f-4616-49fd-87f2-0191d55018d3 tempest-VolumesSnapshotTestJSON-1785130454 tempest-VolumesSnapshotTestJSON-1785130454-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:27:32.358501 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-167c042f-4616-49fd-87f2-0191d55018d3 tempest-VolumesSnapshotTestJSON-1785130454 tempest-VolumesSnapshotTestJSON-1785130454-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:27:32.358968 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-167c042f-4616-49fd-87f2-0191d55018d3 tempest-VolumesSnapshotTestJSON-1785130454 tempest-VolumesSnapshotTestJSON-1785130454-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:27:32.359757 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-167c042f-4616-49fd-87f2-0191d55018d3 tempest-VolumesSnapshotTestJSON-1785130454 tempest-VolumesSnapshotTestJSON-1785130454-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:27:32.360247 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-167c042f-4616-49fd-87f2-0191d55018d3 tempest-VolumesSnapshotTestJSON-1785130454 tempest-VolumesSnapshotTestJSON-1785130454-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:27:32.360707 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-167c042f-4616-49fd-87f2-0191d55018d3 tempest-VolumesSnapshotTestJSON-1785130454 tempest-VolumesSnapshotTestJSON-1785130454-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:27:32.493279 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.policy [None req-167c042f-4616-49fd-87f2-0191d55018d3 tempest-VolumesSnapshotTestJSON-1785130454 tempest-VolumesSnapshotTestJSON-1785130454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac00970326df432bb130e44ed04db3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b02989040ab4080855af2e66c942060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120798) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:27:32.501441 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [None req-167c042f-4616-49fd-87f2-0191d55018d3 tempest-VolumesSnapshotTestJSON-1785130454 tempest-VolumesSnapshotTestJSON-1785130454-project] 10.222.0.17 "GET /compute/v2.1/servers/27a3025a-f125-4e49-81cf-d1b3804a04ef" status: 200 len: 1318 microversion: 2.1 time: 0.158116 Aug 23 07:27:32.501978 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 487/999] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:27:32 2022] GET /compute/v2.1/servers/27a3025a-f125-4e49-81cf-d1b3804a04ef => generated 1318 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:27:33.523211 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-b7630f47-3e32-4e2c-a783-9510325b5aa2 tempest-VolumesSnapshotTestJSON-1785130454 tempest-VolumesSnapshotTestJSON-1785130454-project] Calling method '>' {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:27:33.523845 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.compute.api [None req-b7630f47-3e32-4e2c-a783-9510325b5aa2 tempest-VolumesSnapshotTestJSON-1785130454 tempest-VolumesSnapshotTestJSON-1785130454-project] [instance: 27a3025a-f125-4e49-81cf-d1b3804a04ef] Fetching instance by UUID {{(pid=120799) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:27:33.531694 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-b7630f47-3e32-4e2c-a783-9510325b5aa2 tempest-VolumesSnapshotTestJSON-1785130454 tempest-VolumesSnapshotTestJSON-1785130454-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:27:33.532180 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-b7630f47-3e32-4e2c-a783-9510325b5aa2 tempest-VolumesSnapshotTestJSON-1785130454 tempest-VolumesSnapshotTestJSON-1785130454-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:27:33.532784 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-b7630f47-3e32-4e2c-a783-9510325b5aa2 tempest-VolumesSnapshotTestJSON-1785130454 tempest-VolumesSnapshotTestJSON-1785130454-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:27:33.533486 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-b7630f47-3e32-4e2c-a783-9510325b5aa2 tempest-VolumesSnapshotTestJSON-1785130454 tempest-VolumesSnapshotTestJSON-1785130454-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:27:33.534344 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-b7630f47-3e32-4e2c-a783-9510325b5aa2 tempest-VolumesSnapshotTestJSON-1785130454 tempest-VolumesSnapshotTestJSON-1785130454-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:27:33.534344 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-b7630f47-3e32-4e2c-a783-9510325b5aa2 tempest-VolumesSnapshotTestJSON-1785130454 tempest-VolumesSnapshotTestJSON-1785130454-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:27:33.789660 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.policy [None req-b7630f47-3e32-4e2c-a783-9510325b5aa2 tempest-VolumesSnapshotTestJSON-1785130454 tempest-VolumesSnapshotTestJSON-1785130454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac00970326df432bb130e44ed04db3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b02989040ab4080855af2e66c942060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120799) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:27:33.803326 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-b7630f47-3e32-4e2c-a783-9510325b5aa2 tempest-VolumesSnapshotTestJSON-1785130454 tempest-VolumesSnapshotTestJSON-1785130454-project] 10.222.0.17 "GET /compute/v2.1/servers/27a3025a-f125-4e49-81cf-d1b3804a04ef" status: 200 len: 1318 microversion: 2.1 time: 0.284832 Aug 23 07:27:33.803990 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 513/1000] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:27:33 2022] GET /compute/v2.1/servers/27a3025a-f125-4e49-81cf-d1b3804a04ef => generated 1318 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:27:34.828488 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-f14a94b7-a2ce-4142-b922-9c42bfdcd62d tempest-VolumesSnapshotTestJSON-1785130454 tempest-VolumesSnapshotTestJSON-1785130454-project] Calling method '>' {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:27:34.829489 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.compute.api [None req-f14a94b7-a2ce-4142-b922-9c42bfdcd62d tempest-VolumesSnapshotTestJSON-1785130454 tempest-VolumesSnapshotTestJSON-1785130454-project] [instance: 27a3025a-f125-4e49-81cf-d1b3804a04ef] Fetching instance by UUID {{(pid=120798) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:27:34.838240 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-f14a94b7-a2ce-4142-b922-9c42bfdcd62d tempest-VolumesSnapshotTestJSON-1785130454 tempest-VolumesSnapshotTestJSON-1785130454-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:27:34.838709 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-f14a94b7-a2ce-4142-b922-9c42bfdcd62d tempest-VolumesSnapshotTestJSON-1785130454 tempest-VolumesSnapshotTestJSON-1785130454-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:27:34.839144 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-f14a94b7-a2ce-4142-b922-9c42bfdcd62d tempest-VolumesSnapshotTestJSON-1785130454 tempest-VolumesSnapshotTestJSON-1785130454-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:27:34.839894 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-f14a94b7-a2ce-4142-b922-9c42bfdcd62d tempest-VolumesSnapshotTestJSON-1785130454 tempest-VolumesSnapshotTestJSON-1785130454-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:27:34.840368 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-f14a94b7-a2ce-4142-b922-9c42bfdcd62d tempest-VolumesSnapshotTestJSON-1785130454 tempest-VolumesSnapshotTestJSON-1785130454-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:27:34.840792 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-f14a94b7-a2ce-4142-b922-9c42bfdcd62d tempest-VolumesSnapshotTestJSON-1785130454 tempest-VolumesSnapshotTestJSON-1785130454-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:27:35.037640 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.policy [None req-f14a94b7-a2ce-4142-b922-9c42bfdcd62d tempest-VolumesSnapshotTestJSON-1785130454 tempest-VolumesSnapshotTestJSON-1785130454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac00970326df432bb130e44ed04db3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b02989040ab4080855af2e66c942060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120798) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:27:35.049344 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [None req-f14a94b7-a2ce-4142-b922-9c42bfdcd62d tempest-VolumesSnapshotTestJSON-1785130454 tempest-VolumesSnapshotTestJSON-1785130454-project] 10.222.0.17 "GET /compute/v2.1/servers/27a3025a-f125-4e49-81cf-d1b3804a04ef" status: 200 len: 1318 microversion: 2.1 time: 0.227497 Aug 23 07:27:35.049929 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 488/1001] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:27:34 2022] GET /compute/v2.1/servers/27a3025a-f125-4e49-81cf-d1b3804a04ef => generated 1318 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:27:35.481187 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [req-8f934a7a-3e42-4885-9064-c7c09e767ed3 req-8da1806f-8540-4450-bb5c-f23ba87e398c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "27a3025a-f125-4e49-81cf-d1b3804a04ef", "name": "network-vif-plugged", "status": "completed", "tag": "a3cb574e-d715-47d3-a4a9-10cf401aed24"}]} {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 07:27:35.493252 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [req-8f934a7a-3e42-4885-9064-c7c09e767ed3 req-8da1806f-8540-4450-bb5c-f23ba87e398c service nova] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:27:35.495683 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [req-8f934a7a-3e42-4885-9064-c7c09e767ed3 req-8da1806f-8540-4450-bb5c-f23ba87e398c service nova] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:27:35.496784 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [req-8f934a7a-3e42-4885-9064-c7c09e767ed3 req-8da1806f-8540-4450-bb5c-f23ba87e398c service nova] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:27:35.512865 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.compute.server_external_events [req-8f934a7a-3e42-4885-9064-c7c09e767ed3 req-8da1806f-8540-4450-bb5c-f23ba87e398c service nova] Creating event network-vif-plugged:a3cb574e-d715-47d3-a4a9-10cf401aed24 for instance 27a3025a-f125-4e49-81cf-d1b3804a04ef on hv-cinder-85409 Aug 23 07:27:35.517909 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [req-8f934a7a-3e42-4885-9064-c7c09e767ed3 req-8da1806f-8540-4450-bb5c-f23ba87e398c service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040690 Aug 23 07:27:35.518498 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 514/1002] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Aug 23 07:27:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 07:27:36.080109 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-2bb5d7d5-7183-453d-8771-7db1c60c66df tempest-VolumesSnapshotTestJSON-1785130454 tempest-VolumesSnapshotTestJSON-1785130454-project] Calling method '>' {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:27:36.081114 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.compute.api [None req-2bb5d7d5-7183-453d-8771-7db1c60c66df tempest-VolumesSnapshotTestJSON-1785130454 tempest-VolumesSnapshotTestJSON-1785130454-project] [instance: 27a3025a-f125-4e49-81cf-d1b3804a04ef] Fetching instance by UUID {{(pid=120798) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:27:36.092152 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-2bb5d7d5-7183-453d-8771-7db1c60c66df tempest-VolumesSnapshotTestJSON-1785130454 tempest-VolumesSnapshotTestJSON-1785130454-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:27:36.092955 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-2bb5d7d5-7183-453d-8771-7db1c60c66df tempest-VolumesSnapshotTestJSON-1785130454 tempest-VolumesSnapshotTestJSON-1785130454-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:27:36.093666 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-2bb5d7d5-7183-453d-8771-7db1c60c66df tempest-VolumesSnapshotTestJSON-1785130454 tempest-VolumesSnapshotTestJSON-1785130454-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:27:36.094789 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-2bb5d7d5-7183-453d-8771-7db1c60c66df tempest-VolumesSnapshotTestJSON-1785130454 tempest-VolumesSnapshotTestJSON-1785130454-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:27:36.095585 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-2bb5d7d5-7183-453d-8771-7db1c60c66df tempest-VolumesSnapshotTestJSON-1785130454 tempest-VolumesSnapshotTestJSON-1785130454-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:27:36.096653 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-2bb5d7d5-7183-453d-8771-7db1c60c66df tempest-VolumesSnapshotTestJSON-1785130454 tempest-VolumesSnapshotTestJSON-1785130454-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:27:36.245664 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.policy [None req-2bb5d7d5-7183-453d-8771-7db1c60c66df tempest-VolumesSnapshotTestJSON-1785130454 tempest-VolumesSnapshotTestJSON-1785130454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac00970326df432bb130e44ed04db3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b02989040ab4080855af2e66c942060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120798) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:27:36.256405 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [None req-2bb5d7d5-7183-453d-8771-7db1c60c66df tempest-VolumesSnapshotTestJSON-1785130454 tempest-VolumesSnapshotTestJSON-1785130454-project] 10.222.0.17 "GET /compute/v2.1/servers/27a3025a-f125-4e49-81cf-d1b3804a04ef" status: 200 len: 1318 microversion: 2.1 time: 0.182458 Aug 23 07:27:36.257187 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 489/1003] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:27:36 2022] GET /compute/v2.1/servers/27a3025a-f125-4e49-81cf-d1b3804a04ef => generated 1318 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:27:37.283056 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-75cf8ddb-2788-4fed-98be-354066d070c1 tempest-VolumesSnapshotTestJSON-1785130454 tempest-VolumesSnapshotTestJSON-1785130454-project] Calling method '>' {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:27:37.283757 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.compute.api [None req-75cf8ddb-2788-4fed-98be-354066d070c1 tempest-VolumesSnapshotTestJSON-1785130454 tempest-VolumesSnapshotTestJSON-1785130454-project] [instance: 27a3025a-f125-4e49-81cf-d1b3804a04ef] Fetching instance by UUID {{(pid=120799) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:27:37.290859 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-75cf8ddb-2788-4fed-98be-354066d070c1 tempest-VolumesSnapshotTestJSON-1785130454 tempest-VolumesSnapshotTestJSON-1785130454-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:27:37.291335 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-75cf8ddb-2788-4fed-98be-354066d070c1 tempest-VolumesSnapshotTestJSON-1785130454 tempest-VolumesSnapshotTestJSON-1785130454-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:27:37.291800 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-75cf8ddb-2788-4fed-98be-354066d070c1 tempest-VolumesSnapshotTestJSON-1785130454 tempest-VolumesSnapshotTestJSON-1785130454-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:27:37.292491 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-75cf8ddb-2788-4fed-98be-354066d070c1 tempest-VolumesSnapshotTestJSON-1785130454 tempest-VolumesSnapshotTestJSON-1785130454-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:27:37.292939 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-75cf8ddb-2788-4fed-98be-354066d070c1 tempest-VolumesSnapshotTestJSON-1785130454 tempest-VolumesSnapshotTestJSON-1785130454-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:27:37.293361 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-75cf8ddb-2788-4fed-98be-354066d070c1 tempest-VolumesSnapshotTestJSON-1785130454 tempest-VolumesSnapshotTestJSON-1785130454-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:27:37.425648 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.policy [None req-75cf8ddb-2788-4fed-98be-354066d070c1 tempest-VolumesSnapshotTestJSON-1785130454 tempest-VolumesSnapshotTestJSON-1785130454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac00970326df432bb130e44ed04db3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b02989040ab4080855af2e66c942060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120799) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:27:37.433290 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-75cf8ddb-2788-4fed-98be-354066d070c1 tempest-VolumesSnapshotTestJSON-1785130454 tempest-VolumesSnapshotTestJSON-1785130454-project] 10.222.0.17 "GET /compute/v2.1/servers/27a3025a-f125-4e49-81cf-d1b3804a04ef" status: 200 len: 1507 microversion: 2.1 time: 0.154718 Aug 23 07:27:37.433881 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 515/1004] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:27:37 2022] GET /compute/v2.1/servers/27a3025a-f125-4e49-81cf-d1b3804a04ef => generated 1507 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:27:51.655729 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-41702ea7-1f24-4471-960f-22d863cbc886 tempest-VolumesSnapshotTestJSON-1785130454 tempest-VolumesSnapshotTestJSON-1785130454-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d6a37c2e-322d-435b-a4ac-2aeea27a9936", "device": "/dev/sdb"}} {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 07:27:51.658831 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.compute.api [None req-41702ea7-1f24-4471-960f-22d863cbc886 tempest-VolumesSnapshotTestJSON-1785130454 tempest-VolumesSnapshotTestJSON-1785130454-project] [instance: 27a3025a-f125-4e49-81cf-d1b3804a04ef] Fetching instance by UUID {{(pid=120798) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:27:51.661310 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG dbcounter [-] [120798] Writing DB stats nova_cell0:SELECT=2 {{(pid=120798) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:27:51.662040 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG dbcounter [-] [120798] Writing DB stats nova_api:SELECT=12 {{(pid=120798) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:27:51.662875 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG dbcounter [-] [120798] Writing DB stats nova_cell1:SELECT=24 {{(pid=120798) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:27:51.670264 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-41702ea7-1f24-4471-960f-22d863cbc886 tempest-VolumesSnapshotTestJSON-1785130454 tempest-VolumesSnapshotTestJSON-1785130454-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:27:51.670753 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-41702ea7-1f24-4471-960f-22d863cbc886 tempest-VolumesSnapshotTestJSON-1785130454 tempest-VolumesSnapshotTestJSON-1785130454-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:27:51.671188 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-41702ea7-1f24-4471-960f-22d863cbc886 tempest-VolumesSnapshotTestJSON-1785130454 tempest-VolumesSnapshotTestJSON-1785130454-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:27:51.671902 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-41702ea7-1f24-4471-960f-22d863cbc886 tempest-VolumesSnapshotTestJSON-1785130454 tempest-VolumesSnapshotTestJSON-1785130454-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:27:51.672349 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-41702ea7-1f24-4471-960f-22d863cbc886 tempest-VolumesSnapshotTestJSON-1785130454 tempest-VolumesSnapshotTestJSON-1785130454-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:27:51.672768 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-41702ea7-1f24-4471-960f-22d863cbc886 tempest-VolumesSnapshotTestJSON-1785130454 tempest-VolumesSnapshotTestJSON-1785130454-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:27:51.942495 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [None req-41702ea7-1f24-4471-960f-22d863cbc886 tempest-VolumesSnapshotTestJSON-1785130454 tempest-VolumesSnapshotTestJSON-1785130454-project] 10.222.0.17 "POST /compute/v2.1/servers/27a3025a-f125-4e49-81cf-d1b3804a04ef/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.290795 Aug 23 07:27:51.943233 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 490/1005] 10.222.0.17 () {60 vars in 1323 bytes} [Tue Aug 23 07:27:51 2022] POST /compute/v2.1/servers/27a3025a-f125-4e49-81cf-d1b3804a04ef/os-volume_attachments => generated 194 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 07:28:11.710326 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-d8bcae7e-668a-4095-8c42-d02281a4aa48 tempest-VolumesSnapshotTestJSON-1785130454 tempest-VolumesSnapshotTestJSON-1785130454-project] Calling method '>' {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:28:11.710872 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.compute.api [None req-d8bcae7e-668a-4095-8c42-d02281a4aa48 tempest-VolumesSnapshotTestJSON-1785130454 tempest-VolumesSnapshotTestJSON-1785130454-project] [instance: 27a3025a-f125-4e49-81cf-d1b3804a04ef] Fetching instance by UUID {{(pid=120799) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:28:11.712806 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG dbcounter [-] [120799] Writing DB stats nova_cell0:SELECT=2 {{(pid=120799) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:28:11.713462 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG dbcounter [-] [120799] Writing DB stats nova_cell0:SELECT=6 {{(pid=120799) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:28:11.714210 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG dbcounter [-] [120799] Writing DB stats nova_api:SELECT=25,nova_api:INSERT=3 {{(pid=120799) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:28:11.715020 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG dbcounter [-] [120799] Writing DB stats nova_cell1:SELECT=30 {{(pid=120799) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:28:11.721694 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-d8bcae7e-668a-4095-8c42-d02281a4aa48 tempest-VolumesSnapshotTestJSON-1785130454 tempest-VolumesSnapshotTestJSON-1785130454-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:28:11.722175 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-d8bcae7e-668a-4095-8c42-d02281a4aa48 tempest-VolumesSnapshotTestJSON-1785130454 tempest-VolumesSnapshotTestJSON-1785130454-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:28:11.722602 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-d8bcae7e-668a-4095-8c42-d02281a4aa48 tempest-VolumesSnapshotTestJSON-1785130454 tempest-VolumesSnapshotTestJSON-1785130454-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:28:11.723270 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-d8bcae7e-668a-4095-8c42-d02281a4aa48 tempest-VolumesSnapshotTestJSON-1785130454 tempest-VolumesSnapshotTestJSON-1785130454-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:28:11.723738 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-d8bcae7e-668a-4095-8c42-d02281a4aa48 tempest-VolumesSnapshotTestJSON-1785130454 tempest-VolumesSnapshotTestJSON-1785130454-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:28:11.724150 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-d8bcae7e-668a-4095-8c42-d02281a4aa48 tempest-VolumesSnapshotTestJSON-1785130454 tempest-VolumesSnapshotTestJSON-1785130454-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:28:11.808765 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.objects.instance [None req-d8bcae7e-668a-4095-8c42-d02281a4aa48 tempest-VolumesSnapshotTestJSON-1785130454 tempest-VolumesSnapshotTestJSON-1785130454-project] Lazy-loading 'services' on Instance uuid 27a3025a-f125-4e49-81cf-d1b3804a04ef {{(pid=120799) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 07:28:11.886721 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-d8bcae7e-668a-4095-8c42-d02281a4aa48 tempest-VolumesSnapshotTestJSON-1785130454 tempest-VolumesSnapshotTestJSON-1785130454-project] 10.222.0.17 "DELETE /compute/v2.1/servers/27a3025a-f125-4e49-81cf-d1b3804a04ef/os-volume_attachments/d6a37c2e-322d-435b-a4ac-2aeea27a9936" status: 202 len: 0 microversion: 2.1 time: 0.180798 Aug 23 07:28:11.887461 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 516/1006] 10.222.0.17 () {58 vars in 1416 bytes} [Tue Aug 23 07:28:11 2022] DELETE /compute/v2.1/servers/27a3025a-f125-4e49-81cf-d1b3804a04ef/os-volume_attachments/d6a37c2e-322d-435b-a4ac-2aeea27a9936 => generated 0 bytes in 182 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 07:28:13.031233 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-b38fee75-15b7-45c5-8c73-6eb2a78c969d tempest-VolumesSnapshotTestJSON-1785130454 tempest-VolumesSnapshotTestJSON-1785130454-project] Calling method '>' {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:28:13.031814 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.compute.api [None req-b38fee75-15b7-45c5-8c73-6eb2a78c969d tempest-VolumesSnapshotTestJSON-1785130454 tempest-VolumesSnapshotTestJSON-1785130454-project] [instance: 27a3025a-f125-4e49-81cf-d1b3804a04ef] Fetching instance by UUID {{(pid=120798) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:28:13.034595 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG dbcounter [-] [120798] Writing DB stats nova_api:SELECT=2 {{(pid=120798) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:28:13.035253 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG dbcounter [-] [120798] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120798) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:28:13.042614 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-b38fee75-15b7-45c5-8c73-6eb2a78c969d tempest-VolumesSnapshotTestJSON-1785130454 tempest-VolumesSnapshotTestJSON-1785130454-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:28:13.043093 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-b38fee75-15b7-45c5-8c73-6eb2a78c969d tempest-VolumesSnapshotTestJSON-1785130454 tempest-VolumesSnapshotTestJSON-1785130454-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:28:13.043559 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-b38fee75-15b7-45c5-8c73-6eb2a78c969d tempest-VolumesSnapshotTestJSON-1785130454 tempest-VolumesSnapshotTestJSON-1785130454-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:28:13.044247 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-b38fee75-15b7-45c5-8c73-6eb2a78c969d tempest-VolumesSnapshotTestJSON-1785130454 tempest-VolumesSnapshotTestJSON-1785130454-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:28:13.044694 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-b38fee75-15b7-45c5-8c73-6eb2a78c969d tempest-VolumesSnapshotTestJSON-1785130454 tempest-VolumesSnapshotTestJSON-1785130454-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:28:13.045115 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-b38fee75-15b7-45c5-8c73-6eb2a78c969d tempest-VolumesSnapshotTestJSON-1785130454 tempest-VolumesSnapshotTestJSON-1785130454-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:28:13.082021 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.compute.api [None req-b38fee75-15b7-45c5-8c73-6eb2a78c969d tempest-VolumesSnapshotTestJSON-1785130454 tempest-VolumesSnapshotTestJSON-1785130454-project] [instance: 27a3025a-f125-4e49-81cf-d1b3804a04ef] Going to try to terminate instance {{(pid=120798) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 07:28:13.163159 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [None req-b38fee75-15b7-45c5-8c73-6eb2a78c969d tempest-VolumesSnapshotTestJSON-1785130454 tempest-VolumesSnapshotTestJSON-1785130454-project] 10.222.0.17 "DELETE /compute/v2.1/servers/27a3025a-f125-4e49-81cf-d1b3804a04ef" status: 204 len: 0 microversion: 2.1 time: 0.135965 Aug 23 07:28:13.164126 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 491/1007] 10.222.0.17 () {58 vars in 1239 bytes} [Tue Aug 23 07:28:13 2022] DELETE /compute/v2.1/servers/27a3025a-f125-4e49-81cf-d1b3804a04ef => generated 0 bytes in 138 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 23 07:28:13.173145 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-3963576f-9e35-4e2f-a776-7b3c5181d4d2 tempest-VolumesSnapshotTestJSON-1785130454 tempest-VolumesSnapshotTestJSON-1785130454-project] Calling method '>' {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:28:13.173862 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.compute.api [None req-3963576f-9e35-4e2f-a776-7b3c5181d4d2 tempest-VolumesSnapshotTestJSON-1785130454 tempest-VolumesSnapshotTestJSON-1785130454-project] [instance: 27a3025a-f125-4e49-81cf-d1b3804a04ef] Fetching instance by UUID {{(pid=120799) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:28:13.180307 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-3963576f-9e35-4e2f-a776-7b3c5181d4d2 tempest-VolumesSnapshotTestJSON-1785130454 tempest-VolumesSnapshotTestJSON-1785130454-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:28:13.180782 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-3963576f-9e35-4e2f-a776-7b3c5181d4d2 tempest-VolumesSnapshotTestJSON-1785130454 tempest-VolumesSnapshotTestJSON-1785130454-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:28:13.181209 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-3963576f-9e35-4e2f-a776-7b3c5181d4d2 tempest-VolumesSnapshotTestJSON-1785130454 tempest-VolumesSnapshotTestJSON-1785130454-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:28:13.181886 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-3963576f-9e35-4e2f-a776-7b3c5181d4d2 tempest-VolumesSnapshotTestJSON-1785130454 tempest-VolumesSnapshotTestJSON-1785130454-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:28:13.182333 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-3963576f-9e35-4e2f-a776-7b3c5181d4d2 tempest-VolumesSnapshotTestJSON-1785130454 tempest-VolumesSnapshotTestJSON-1785130454-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:28:13.182747 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-3963576f-9e35-4e2f-a776-7b3c5181d4d2 tempest-VolumesSnapshotTestJSON-1785130454 tempest-VolumesSnapshotTestJSON-1785130454-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:28:13.321213 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.policy [None req-3963576f-9e35-4e2f-a776-7b3c5181d4d2 tempest-VolumesSnapshotTestJSON-1785130454 tempest-VolumesSnapshotTestJSON-1785130454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac00970326df432bb130e44ed04db3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b02989040ab4080855af2e66c942060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120799) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:28:13.329299 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-3963576f-9e35-4e2f-a776-7b3c5181d4d2 tempest-VolumesSnapshotTestJSON-1785130454 tempest-VolumesSnapshotTestJSON-1785130454-project] 10.222.0.17 "GET /compute/v2.1/servers/27a3025a-f125-4e49-81cf-d1b3804a04ef" status: 200 len: 1513 microversion: 2.1 time: 0.160960 Aug 23 07:28:13.329876 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 517/1008] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:28:13 2022] GET /compute/v2.1/servers/27a3025a-f125-4e49-81cf-d1b3804a04ef => generated 1513 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:28:14.355497 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-b42d22fe-03fc-405e-954b-1e30a893c497 tempest-VolumesSnapshotTestJSON-1785130454 tempest-VolumesSnapshotTestJSON-1785130454-project] Calling method '>' {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:28:14.356244 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.compute.api [None req-b42d22fe-03fc-405e-954b-1e30a893c497 tempest-VolumesSnapshotTestJSON-1785130454 tempest-VolumesSnapshotTestJSON-1785130454-project] [instance: 27a3025a-f125-4e49-81cf-d1b3804a04ef] Fetching instance by UUID {{(pid=120798) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:28:14.366022 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-b42d22fe-03fc-405e-954b-1e30a893c497 tempest-VolumesSnapshotTestJSON-1785130454 tempest-VolumesSnapshotTestJSON-1785130454-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:28:14.366697 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-b42d22fe-03fc-405e-954b-1e30a893c497 tempest-VolumesSnapshotTestJSON-1785130454 tempest-VolumesSnapshotTestJSON-1785130454-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:28:14.367379 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-b42d22fe-03fc-405e-954b-1e30a893c497 tempest-VolumesSnapshotTestJSON-1785130454 tempest-VolumesSnapshotTestJSON-1785130454-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:28:14.368578 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-b42d22fe-03fc-405e-954b-1e30a893c497 tempest-VolumesSnapshotTestJSON-1785130454 tempest-VolumesSnapshotTestJSON-1785130454-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:28:14.369301 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-b42d22fe-03fc-405e-954b-1e30a893c497 tempest-VolumesSnapshotTestJSON-1785130454 tempest-VolumesSnapshotTestJSON-1785130454-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:28:14.369991 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-b42d22fe-03fc-405e-954b-1e30a893c497 tempest-VolumesSnapshotTestJSON-1785130454 tempest-VolumesSnapshotTestJSON-1785130454-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:28:14.511755 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.policy [None req-b42d22fe-03fc-405e-954b-1e30a893c497 tempest-VolumesSnapshotTestJSON-1785130454 tempest-VolumesSnapshotTestJSON-1785130454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac00970326df432bb130e44ed04db3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b02989040ab4080855af2e66c942060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120798) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:28:14.520269 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [None req-b42d22fe-03fc-405e-954b-1e30a893c497 tempest-VolumesSnapshotTestJSON-1785130454 tempest-VolumesSnapshotTestJSON-1785130454-project] 10.222.0.17 "GET /compute/v2.1/servers/27a3025a-f125-4e49-81cf-d1b3804a04ef" status: 200 len: 1513 microversion: 2.1 time: 0.171602 Aug 23 07:28:14.520843 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 492/1009] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:28:14 2022] GET /compute/v2.1/servers/27a3025a-f125-4e49-81cf-d1b3804a04ef => generated 1513 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 07:28:15.229431 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [req-701d2f88-f5a5-4a9d-b834-710dce65afb6 req-2ac47288-d5ef-4ad3-b226-d185052074cd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "27a3025a-f125-4e49-81cf-d1b3804a04ef", "name": "network-vif-deleted", "tag": "a3cb574e-d715-47d3-a4a9-10cf401aed24"}]} {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 07:28:15.240053 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [req-701d2f88-f5a5-4a9d-b834-710dce65afb6 req-2ac47288-d5ef-4ad3-b226-d185052074cd service nova] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:28:15.240534 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [req-701d2f88-f5a5-4a9d-b834-710dce65afb6 req-2ac47288-d5ef-4ad3-b226-d185052074cd service nova] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:28:15.240951 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [req-701d2f88-f5a5-4a9d-b834-710dce65afb6 req-2ac47288-d5ef-4ad3-b226-d185052074cd service nova] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:28:15.254768 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.compute.server_external_events [req-701d2f88-f5a5-4a9d-b834-710dce65afb6 req-2ac47288-d5ef-4ad3-b226-d185052074cd service nova] Creating event network-vif-deleted:a3cb574e-d715-47d3-a4a9-10cf401aed24 for instance 27a3025a-f125-4e49-81cf-d1b3804a04ef on hv-cinder-85409 Aug 23 07:28:15.259870 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [req-701d2f88-f5a5-4a9d-b834-710dce65afb6 req-2ac47288-d5ef-4ad3-b226-d185052074cd service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097921 Aug 23 07:28:15.260461 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 518/1010] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Aug 23 07:28:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 07:28:15.541735 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-73e18310-1842-4b26-933a-6c51dec89265 tempest-VolumesSnapshotTestJSON-1785130454 tempest-VolumesSnapshotTestJSON-1785130454-project] Calling method '>' {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:28:15.542347 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.compute.api [None req-73e18310-1842-4b26-933a-6c51dec89265 tempest-VolumesSnapshotTestJSON-1785130454 tempest-VolumesSnapshotTestJSON-1785130454-project] [instance: 27a3025a-f125-4e49-81cf-d1b3804a04ef] Fetching instance by UUID {{(pid=120798) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:28:15.549312 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-73e18310-1842-4b26-933a-6c51dec89265 tempest-VolumesSnapshotTestJSON-1785130454 tempest-VolumesSnapshotTestJSON-1785130454-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:28:15.550392 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-73e18310-1842-4b26-933a-6c51dec89265 tempest-VolumesSnapshotTestJSON-1785130454 tempest-VolumesSnapshotTestJSON-1785130454-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:28:15.550826 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-73e18310-1842-4b26-933a-6c51dec89265 tempest-VolumesSnapshotTestJSON-1785130454 tempest-VolumesSnapshotTestJSON-1785130454-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:28:15.551555 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-73e18310-1842-4b26-933a-6c51dec89265 tempest-VolumesSnapshotTestJSON-1785130454 tempest-VolumesSnapshotTestJSON-1785130454-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:28:15.551989 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-73e18310-1842-4b26-933a-6c51dec89265 tempest-VolumesSnapshotTestJSON-1785130454 tempest-VolumesSnapshotTestJSON-1785130454-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:28:15.552413 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-73e18310-1842-4b26-933a-6c51dec89265 tempest-VolumesSnapshotTestJSON-1785130454 tempest-VolumesSnapshotTestJSON-1785130454-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:28:15.584361 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-73e18310-1842-4b26-933a-6c51dec89265 tempest-VolumesSnapshotTestJSON-1785130454 tempest-VolumesSnapshotTestJSON-1785130454-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:28:15.585327 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-73e18310-1842-4b26-933a-6c51dec89265 tempest-VolumesSnapshotTestJSON-1785130454 tempest-VolumesSnapshotTestJSON-1785130454-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:28:15.585828 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-73e18310-1842-4b26-933a-6c51dec89265 tempest-VolumesSnapshotTestJSON-1785130454 tempest-VolumesSnapshotTestJSON-1785130454-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:28:15.586482 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.objects.instance [None req-73e18310-1842-4b26-933a-6c51dec89265 tempest-VolumesSnapshotTestJSON-1785130454 tempest-VolumesSnapshotTestJSON-1785130454-project] Lazy-loading 'fault' on Instance uuid 27a3025a-f125-4e49-81cf-d1b3804a04ef {{(pid=120798) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 07:28:15.628909 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.policy [None req-73e18310-1842-4b26-933a-6c51dec89265 tempest-VolumesSnapshotTestJSON-1785130454 tempest-VolumesSnapshotTestJSON-1785130454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac00970326df432bb130e44ed04db3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b02989040ab4080855af2e66c942060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120798) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:28:15.636319 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [None req-73e18310-1842-4b26-933a-6c51dec89265 tempest-VolumesSnapshotTestJSON-1785130454 tempest-VolumesSnapshotTestJSON-1785130454-project] 10.222.0.17 "GET /compute/v2.1/servers/27a3025a-f125-4e49-81cf-d1b3804a04ef" status: 200 len: 1308 microversion: 2.1 time: 0.099086 Aug 23 07:28:15.636935 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 493/1011] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:28:15 2022] GET /compute/v2.1/servers/27a3025a-f125-4e49-81cf-d1b3804a04ef => generated 1308 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:28:16.661320 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-80176a92-186b-4719-b064-7612c48d0ed8 tempest-VolumesSnapshotTestJSON-1785130454 tempest-VolumesSnapshotTestJSON-1785130454-project] Calling method '>' {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:28:16.662365 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.compute.api [None req-80176a92-186b-4719-b064-7612c48d0ed8 tempest-VolumesSnapshotTestJSON-1785130454 tempest-VolumesSnapshotTestJSON-1785130454-project] [instance: 27a3025a-f125-4e49-81cf-d1b3804a04ef] Fetching instance by UUID {{(pid=120799) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:28:16.670025 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-80176a92-186b-4719-b064-7612c48d0ed8 tempest-VolumesSnapshotTestJSON-1785130454 tempest-VolumesSnapshotTestJSON-1785130454-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:28:16.670586 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-80176a92-186b-4719-b064-7612c48d0ed8 tempest-VolumesSnapshotTestJSON-1785130454 tempest-VolumesSnapshotTestJSON-1785130454-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:28:16.671302 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-80176a92-186b-4719-b064-7612c48d0ed8 tempest-VolumesSnapshotTestJSON-1785130454 tempest-VolumesSnapshotTestJSON-1785130454-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:28:16.672287 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-80176a92-186b-4719-b064-7612c48d0ed8 tempest-VolumesSnapshotTestJSON-1785130454 tempest-VolumesSnapshotTestJSON-1785130454-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:28:16.672831 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-80176a92-186b-4719-b064-7612c48d0ed8 tempest-VolumesSnapshotTestJSON-1785130454 tempest-VolumesSnapshotTestJSON-1785130454-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:28:16.673267 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-80176a92-186b-4719-b064-7612c48d0ed8 tempest-VolumesSnapshotTestJSON-1785130454 tempest-VolumesSnapshotTestJSON-1785130454-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:28:16.694722 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.wsgi [None req-80176a92-186b-4719-b064-7612c48d0ed8 tempest-VolumesSnapshotTestJSON-1785130454 tempest-VolumesSnapshotTestJSON-1785130454-project] HTTP exception thrown: Instance 27a3025a-f125-4e49-81cf-d1b3804a04ef could not be found. Aug 23 07:28:16.696878 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-80176a92-186b-4719-b064-7612c48d0ed8 tempest-VolumesSnapshotTestJSON-1785130454 tempest-VolumesSnapshotTestJSON-1785130454-project] Request method failure captured: Aug 23 07:28:16.696878 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: request: GET /compute/v2.1/servers/27a3025a-f125-4e49-81cf-d1b3804a04ef HTTP/1.1 Aug 23 07:28:16.696878 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: Accept: application/json Aug 23 07:28:16.696878 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: Accept-Encoding: identity Aug 23 07:28:16.696878 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: Connection: close Aug 23 07:28:16.696878 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: Content-Length: 0 Aug 23 07:28:16.696878 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: Content-Type: application/json Aug 23 07:28:16.696878 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: Host: 10.222.0.17 Aug 23 07:28:16.696878 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: Openstack-System-Scope: None Aug 23 07:28:16.696878 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: User-Agent: python-urllib3/1.26.11 Aug 23 07:28:16.696878 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-Auth-Token: gAAAAABjBIFdN0PkXBfBRZTsXbN90pvzkPqEoPf1WAaBD_Q_QmxvlpbUAhkGXdfGxcWgZGaBNgudOUd4R56C9MCFeHRHis93RpXpd4VSGa0QJ2VmUMFV_i55HJnSBmy04Wid4y9vHN9d9Hu-ZIoYDb5VogTCEHzfTQnveKRkU8VIhkXdn2sU5XM Aug 23 07:28:16.696878 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-Domain-Id: None Aug 23 07:28:16.696878 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-Domain-Name: None Aug 23 07:28:16.696878 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-Identity-Status: Confirmed Aug 23 07:28:16.696878 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-Is-Admin-Project: True Aug 23 07:28:16.696878 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-Project-Domain-Id: default Aug 23 07:28:16.696878 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-Project-Domain-Name: Default Aug 23 07:28:16.696878 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-Project-Id: 5b02989040ab4080855af2e66c942060 Aug 23 07:28:16.696878 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1785130454 Aug 23 07:28:16.696878 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-Role: reader,member Aug 23 07:28:16.696878 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-Roles: reader,member Aug 23 07:28:16.698873 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/5b02989040ab4080855af2e66c942060"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/5b02989040ab4080855af2e66c942060"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_5b02989040ab4080855af2e66c942060"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/5b02989040ab4080855af2e66c942060"}]}] Aug 23 07:28:16.698873 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-Tenant: tempest-VolumesSnapshotTestJSON-1785130454 Aug 23 07:28:16.698873 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-Tenant-Id: 5b02989040ab4080855af2e66c942060 Aug 23 07:28:16.698873 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1785130454 Aug 23 07:28:16.698873 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-User: tempest-VolumesSnapshotTestJSON-1785130454-project Aug 23 07:28:16.698873 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-User-Domain-Id: default Aug 23 07:28:16.698873 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-User-Domain-Name: Default Aug 23 07:28:16.698873 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-User-Id: ac00970326df432bb130e44ed04db3b5 Aug 23 07:28:16.698873 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: X-User-Name: tempest-VolumesSnapshotTestJSON-1785130454-project Aug 23 07:28:16.698873 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: method: > Aug 23 07:28:16.698873 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: exception: Instance 27a3025a-f125-4e49-81cf-d1b3804a04ef could not be found. Aug 23 07:28:16.698873 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: action_args: {'id': '27a3025a-f125-4e49-81cf-d1b3804a04ef'} Aug 23 07:28:16.700677 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 07:28:16.700677 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 07:28:16.700677 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 07:28:16.700677 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 07:28:16.700677 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 07:28:16.700677 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 07:28:16.700677 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 07:28:16.700677 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 07:28:16.700677 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 07:28:16.700677 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 07:28:16.700677 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 27a3025a-f125-4e49-81cf-d1b3804a04ef could not be found. Aug 23 07:28:16.700677 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi Aug 23 07:28:16.700677 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 07:28:16.700677 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi Aug 23 07:28:16.700677 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 07:28:16.700677 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 07:28:16.700677 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 07:28:16.700677 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 07:28:16.700677 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 07:28:16.700677 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 07:28:16.703495 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 07:28:16.703495 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 07:28:16.703495 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 07:28:16.703495 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 07:28:16.703495 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 07:28:16.703495 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 07:28:16.703495 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 07:28:16.703495 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 27a3025a-f125-4e49-81cf-d1b3804a04ef could not be found. Aug 23 07:28:16.703495 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi Aug 23 07:28:16.703495 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 07:28:16.703495 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi Aug 23 07:28:16.703495 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 07:28:16.703495 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 07:28:16.703495 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 07:28:16.703495 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 07:28:16.703495 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 07:28:16.703495 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 27a3025a-f125-4e49-81cf-d1b3804a04ef could not be found. Aug 23 07:28:16.703495 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: ERROR nova.api.openstack.wsgi Aug 23 07:28:16.705397 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-80176a92-186b-4719-b064-7612c48d0ed8 tempest-VolumesSnapshotTestJSON-1785130454 tempest-VolumesSnapshotTestJSON-1785130454-project] Returning 404 to user: Instance 27a3025a-f125-4e49-81cf-d1b3804a04ef could not be found. {{(pid=120799) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 07:28:16.705397 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-80176a92-186b-4719-b064-7612c48d0ed8 tempest-VolumesSnapshotTestJSON-1785130454 tempest-VolumesSnapshotTestJSON-1785130454-project] 10.222.0.17 "GET /compute/v2.1/servers/27a3025a-f125-4e49-81cf-d1b3804a04ef" status: 404 len: 111 microversion: 2.1 time: 0.044205 Aug 23 07:28:16.705397 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 519/1012] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:28:16 2022] GET /compute/v2.1/servers/27a3025a-f125-4e49-81cf-d1b3804a04ef => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 07:28:24.608687 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-0269fb40-d06f-4674-aaaf-c06fdc5f182e tempest-VolumesSnapshotTestJSON-1785130454 tempest-VolumesSnapshotTestJSON-1785130454-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1555214266", "imageRef": "b899fd65-02ae-4b43-bac7-86f38fc3f224", "flavorRef": "452", "networks": [{"uuid": "f3e7e28f-0965-4ed7-9dee-2d6c6f18aa47"}]}} {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 07:28:24.664624 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.network.neutron [None req-0269fb40-d06f-4674-aaaf-c06fdc5f182e tempest-VolumesSnapshotTestJSON-1785130454 tempest-VolumesSnapshotTestJSON-1785130454-project] validate_networks() for [('f3e7e28f-0965-4ed7-9dee-2d6c6f18aa47', None, None, None, None, None)] {{(pid=120798) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 23 07:28:25.030590 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.virt.hardware [None req-0269fb40-d06f-4674-aaaf-c06fdc5f182e tempest-VolumesSnapshotTestJSON-1785130454 tempest-VolumesSnapshotTestJSON-1785130454-project] Flavor limits 0:0:0 {{(pid=120798) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 07:28:25.031126 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.virt.hardware [None req-0269fb40-d06f-4674-aaaf-c06fdc5f182e tempest-VolumesSnapshotTestJSON-1785130454 tempest-VolumesSnapshotTestJSON-1785130454-project] Image limits 0:0:0 {{(pid=120798) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 07:28:25.031734 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.virt.hardware [None req-0269fb40-d06f-4674-aaaf-c06fdc5f182e tempest-VolumesSnapshotTestJSON-1785130454 tempest-VolumesSnapshotTestJSON-1785130454-project] Flavor pref 0:0:0 {{(pid=120798) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 07:28:25.032232 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.virt.hardware [None req-0269fb40-d06f-4674-aaaf-c06fdc5f182e tempest-VolumesSnapshotTestJSON-1785130454 tempest-VolumesSnapshotTestJSON-1785130454-project] Image pref 0:0:0 {{(pid=120798) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 07:28:25.032802 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.virt.hardware [None req-0269fb40-d06f-4674-aaaf-c06fdc5f182e tempest-VolumesSnapshotTestJSON-1785130454 tempest-VolumesSnapshotTestJSON-1785130454-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120798) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 07:28:25.042438 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-0269fb40-d06f-4674-aaaf-c06fdc5f182e tempest-VolumesSnapshotTestJSON-1785130454 tempest-VolumesSnapshotTestJSON-1785130454-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:28:25.042912 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-0269fb40-d06f-4674-aaaf-c06fdc5f182e tempest-VolumesSnapshotTestJSON-1785130454 tempest-VolumesSnapshotTestJSON-1785130454-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:28:25.043343 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-0269fb40-d06f-4674-aaaf-c06fdc5f182e tempest-VolumesSnapshotTestJSON-1785130454 tempest-VolumesSnapshotTestJSON-1785130454-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:28:25.044092 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-0269fb40-d06f-4674-aaaf-c06fdc5f182e tempest-VolumesSnapshotTestJSON-1785130454 tempest-VolumesSnapshotTestJSON-1785130454-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:28:25.044539 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-0269fb40-d06f-4674-aaaf-c06fdc5f182e tempest-VolumesSnapshotTestJSON-1785130454 tempest-VolumesSnapshotTestJSON-1785130454-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:28:25.044959 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-0269fb40-d06f-4674-aaaf-c06fdc5f182e tempest-VolumesSnapshotTestJSON-1785130454 tempest-VolumesSnapshotTestJSON-1785130454-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:28:25.062407 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.quota [None req-0269fb40-d06f-4674-aaaf-c06fdc5f182e tempest-VolumesSnapshotTestJSON-1785130454 tempest-VolumesSnapshotTestJSON-1785130454-project] Getting quotas for project 5b02989040ab4080855af2e66c942060. Resources: {'ram', 'instances', 'cores'} {{(pid=120798) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 07:28:25.066847 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.quota [None req-0269fb40-d06f-4674-aaaf-c06fdc5f182e tempest-VolumesSnapshotTestJSON-1785130454 tempest-VolumesSnapshotTestJSON-1785130454-project] Getting quotas for user ac00970326df432bb130e44ed04db3b5 and project 5b02989040ab4080855af2e66c942060. Resources: {'ram', 'instances', 'cores'} {{(pid=120798) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 07:28:25.078284 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.compute.api [None req-0269fb40-d06f-4674-aaaf-c06fdc5f182e tempest-VolumesSnapshotTestJSON-1785130454 tempest-VolumesSnapshotTestJSON-1785130454-project] Going to run 1 instances... {{(pid=120798) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 23 07:28:25.080616 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.compute.api [None req-0269fb40-d06f-4674-aaaf-c06fdc5f182e tempest-VolumesSnapshotTestJSON-1785130454 tempest-VolumesSnapshotTestJSON-1785130454-project] [instance: 0ad2fd7d-b264-4ed6-8c57-24b879740372] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b899fd65-02ae-4b43-bac7-86f38fc3f224',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120798) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 07:28:25.134499 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [None req-0269fb40-d06f-4674-aaaf-c06fdc5f182e tempest-VolumesSnapshotTestJSON-1785130454 tempest-VolumesSnapshotTestJSON-1785130454-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.529547 Aug 23 07:28:25.135262 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 494/1013] 10.222.0.17 () {60 vars in 1147 bytes} [Tue Aug 23 07:28:24 2022] POST /compute/v2.1/servers => generated 380 bytes in 531 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 23 07:28:25.146961 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-30c85381-5733-48b7-b970-bd84693e524a tempest-VolumesSnapshotTestJSON-1785130454 tempest-VolumesSnapshotTestJSON-1785130454-project] Calling method '>' {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:28:25.147767 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.compute.api [None req-30c85381-5733-48b7-b970-bd84693e524a tempest-VolumesSnapshotTestJSON-1785130454 tempest-VolumesSnapshotTestJSON-1785130454-project] [instance: 0ad2fd7d-b264-4ed6-8c57-24b879740372] Fetching instance by UUID {{(pid=120799) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:28:25.202354 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.policy [None req-30c85381-5733-48b7-b970-bd84693e524a tempest-VolumesSnapshotTestJSON-1785130454 tempest-VolumesSnapshotTestJSON-1785130454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac00970326df432bb130e44ed04db3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b02989040ab4080855af2e66c942060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120799) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:28:25.209385 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-30c85381-5733-48b7-b970-bd84693e524a tempest-VolumesSnapshotTestJSON-1785130454 tempest-VolumesSnapshotTestJSON-1785130454-project] 10.222.0.17 "GET /compute/v2.1/servers/0ad2fd7d-b264-4ed6-8c57-24b879740372" status: 200 len: 1219 microversion: 2.1 time: 0.066549 Aug 23 07:28:25.209938 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 520/1014] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:28:25 2022] GET /compute/v2.1/servers/0ad2fd7d-b264-4ed6-8c57-24b879740372 => generated 1219 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:28:26.231901 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-6a036492-7837-4ea6-9463-f5dfd5158b0b tempest-VolumesSnapshotTestJSON-1785130454 tempest-VolumesSnapshotTestJSON-1785130454-project] Calling method '>' {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:28:26.232483 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.compute.api [None req-6a036492-7837-4ea6-9463-f5dfd5158b0b tempest-VolumesSnapshotTestJSON-1785130454 tempest-VolumesSnapshotTestJSON-1785130454-project] [instance: 0ad2fd7d-b264-4ed6-8c57-24b879740372] Fetching instance by UUID {{(pid=120798) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:28:26.240180 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-6a036492-7837-4ea6-9463-f5dfd5158b0b tempest-VolumesSnapshotTestJSON-1785130454 tempest-VolumesSnapshotTestJSON-1785130454-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:28:26.240750 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-6a036492-7837-4ea6-9463-f5dfd5158b0b tempest-VolumesSnapshotTestJSON-1785130454 tempest-VolumesSnapshotTestJSON-1785130454-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:28:26.241435 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-6a036492-7837-4ea6-9463-f5dfd5158b0b tempest-VolumesSnapshotTestJSON-1785130454 tempest-VolumesSnapshotTestJSON-1785130454-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:28:26.242308 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-6a036492-7837-4ea6-9463-f5dfd5158b0b tempest-VolumesSnapshotTestJSON-1785130454 tempest-VolumesSnapshotTestJSON-1785130454-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:28:26.242773 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-6a036492-7837-4ea6-9463-f5dfd5158b0b tempest-VolumesSnapshotTestJSON-1785130454 tempest-VolumesSnapshotTestJSON-1785130454-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:28:26.244014 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-6a036492-7837-4ea6-9463-f5dfd5158b0b tempest-VolumesSnapshotTestJSON-1785130454 tempest-VolumesSnapshotTestJSON-1785130454-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:28:26.316565 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.policy [None req-6a036492-7837-4ea6-9463-f5dfd5158b0b tempest-VolumesSnapshotTestJSON-1785130454 tempest-VolumesSnapshotTestJSON-1785130454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac00970326df432bb130e44ed04db3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b02989040ab4080855af2e66c942060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120798) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:28:26.324833 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [None req-6a036492-7837-4ea6-9463-f5dfd5158b0b tempest-VolumesSnapshotTestJSON-1785130454 tempest-VolumesSnapshotTestJSON-1785130454-project] 10.222.0.17 "GET /compute/v2.1/servers/0ad2fd7d-b264-4ed6-8c57-24b879740372" status: 200 len: 1289 microversion: 2.1 time: 0.097055 Aug 23 07:28:26.325774 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 495/1015] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:28:26 2022] GET /compute/v2.1/servers/0ad2fd7d-b264-4ed6-8c57-24b879740372 => generated 1289 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:28:27.347187 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-a8e5f83c-cc8a-4fcb-bed8-67d11408279c tempest-VolumesSnapshotTestJSON-1785130454 tempest-VolumesSnapshotTestJSON-1785130454-project] Calling method '>' {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:28:27.349204 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.compute.api [None req-a8e5f83c-cc8a-4fcb-bed8-67d11408279c tempest-VolumesSnapshotTestJSON-1785130454 tempest-VolumesSnapshotTestJSON-1785130454-project] [instance: 0ad2fd7d-b264-4ed6-8c57-24b879740372] Fetching instance by UUID {{(pid=120799) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:28:27.355926 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG dbcounter [-] [120799] Writing DB stats nova_cell1:SELECT=19,nova_cell1:INSERT=1 {{(pid=120799) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:28:27.357940 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-a8e5f83c-cc8a-4fcb-bed8-67d11408279c tempest-VolumesSnapshotTestJSON-1785130454 tempest-VolumesSnapshotTestJSON-1785130454-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:28:27.358686 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-a8e5f83c-cc8a-4fcb-bed8-67d11408279c tempest-VolumesSnapshotTestJSON-1785130454 tempest-VolumesSnapshotTestJSON-1785130454-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:28:27.359167 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-a8e5f83c-cc8a-4fcb-bed8-67d11408279c tempest-VolumesSnapshotTestJSON-1785130454 tempest-VolumesSnapshotTestJSON-1785130454-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:28:27.359980 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-a8e5f83c-cc8a-4fcb-bed8-67d11408279c tempest-VolumesSnapshotTestJSON-1785130454 tempest-VolumesSnapshotTestJSON-1785130454-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:28:27.360413 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-a8e5f83c-cc8a-4fcb-bed8-67d11408279c tempest-VolumesSnapshotTestJSON-1785130454 tempest-VolumesSnapshotTestJSON-1785130454-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:28:27.360816 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-a8e5f83c-cc8a-4fcb-bed8-67d11408279c tempest-VolumesSnapshotTestJSON-1785130454 tempest-VolumesSnapshotTestJSON-1785130454-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:28:27.499324 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.policy [None req-a8e5f83c-cc8a-4fcb-bed8-67d11408279c tempest-VolumesSnapshotTestJSON-1785130454 tempest-VolumesSnapshotTestJSON-1785130454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac00970326df432bb130e44ed04db3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b02989040ab4080855af2e66c942060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120799) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:28:27.508472 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-a8e5f83c-cc8a-4fcb-bed8-67d11408279c tempest-VolumesSnapshotTestJSON-1785130454 tempest-VolumesSnapshotTestJSON-1785130454-project] 10.222.0.17 "GET /compute/v2.1/servers/0ad2fd7d-b264-4ed6-8c57-24b879740372" status: 200 len: 1319 microversion: 2.1 time: 0.166232 Aug 23 07:28:27.509129 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 521/1016] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:28:27 2022] GET /compute/v2.1/servers/0ad2fd7d-b264-4ed6-8c57-24b879740372 => generated 1319 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:28:27.552452 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [req-c8302bf1-08d0-4af5-a78d-32e7503656df req-fdd3eb8e-2550-4382-b79b-7b14af1eb567 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0ad2fd7d-b264-4ed6-8c57-24b879740372", "tag": "55575ec9-7584-4f38-85d4-2316c07c2c84"}]} {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 07:28:27.562593 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [req-c8302bf1-08d0-4af5-a78d-32e7503656df req-fdd3eb8e-2550-4382-b79b-7b14af1eb567 service nova] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:28:27.563139 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [req-c8302bf1-08d0-4af5-a78d-32e7503656df req-fdd3eb8e-2550-4382-b79b-7b14af1eb567 service nova] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:28:27.563656 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [req-c8302bf1-08d0-4af5-a78d-32e7503656df req-fdd3eb8e-2550-4382-b79b-7b14af1eb567 service nova] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:28:27.574913 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.compute.server_external_events [req-c8302bf1-08d0-4af5-a78d-32e7503656df req-fdd3eb8e-2550-4382-b79b-7b14af1eb567 service nova] Creating event network-changed:55575ec9-7584-4f38-85d4-2316c07c2c84 for instance 0ad2fd7d-b264-4ed6-8c57-24b879740372 on hv-cinder-85409 Aug 23 07:28:27.579984 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [req-c8302bf1-08d0-4af5-a78d-32e7503656df req-fdd3eb8e-2550-4382-b79b-7b14af1eb567 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031690 Aug 23 07:28:27.580578 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 496/1017] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Aug 23 07:28:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 07:28:28.533845 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-09ea4f53-1472-47bc-8782-cd5a475c9f03 tempest-VolumesSnapshotTestJSON-1785130454 tempest-VolumesSnapshotTestJSON-1785130454-project] Calling method '>' {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:28:28.535836 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.compute.api [None req-09ea4f53-1472-47bc-8782-cd5a475c9f03 tempest-VolumesSnapshotTestJSON-1785130454 tempest-VolumesSnapshotTestJSON-1785130454-project] [instance: 0ad2fd7d-b264-4ed6-8c57-24b879740372] Fetching instance by UUID {{(pid=120799) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:28:28.546028 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-09ea4f53-1472-47bc-8782-cd5a475c9f03 tempest-VolumesSnapshotTestJSON-1785130454 tempest-VolumesSnapshotTestJSON-1785130454-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:28:28.546825 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-09ea4f53-1472-47bc-8782-cd5a475c9f03 tempest-VolumesSnapshotTestJSON-1785130454 tempest-VolumesSnapshotTestJSON-1785130454-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:28:28.547671 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-09ea4f53-1472-47bc-8782-cd5a475c9f03 tempest-VolumesSnapshotTestJSON-1785130454 tempest-VolumesSnapshotTestJSON-1785130454-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:28:28.548863 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-09ea4f53-1472-47bc-8782-cd5a475c9f03 tempest-VolumesSnapshotTestJSON-1785130454 tempest-VolumesSnapshotTestJSON-1785130454-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:28:28.549605 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-09ea4f53-1472-47bc-8782-cd5a475c9f03 tempest-VolumesSnapshotTestJSON-1785130454 tempest-VolumesSnapshotTestJSON-1785130454-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:28:28.550480 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-09ea4f53-1472-47bc-8782-cd5a475c9f03 tempest-VolumesSnapshotTestJSON-1785130454 tempest-VolumesSnapshotTestJSON-1785130454-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:28:28.695375 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.policy [None req-09ea4f53-1472-47bc-8782-cd5a475c9f03 tempest-VolumesSnapshotTestJSON-1785130454 tempest-VolumesSnapshotTestJSON-1785130454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac00970326df432bb130e44ed04db3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b02989040ab4080855af2e66c942060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120799) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:28:28.703403 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-09ea4f53-1472-47bc-8782-cd5a475c9f03 tempest-VolumesSnapshotTestJSON-1785130454 tempest-VolumesSnapshotTestJSON-1785130454-project] 10.222.0.17 "GET /compute/v2.1/servers/0ad2fd7d-b264-4ed6-8c57-24b879740372" status: 200 len: 1319 microversion: 2.1 time: 0.176093 Aug 23 07:28:28.704046 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 522/1018] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:28:28 2022] GET /compute/v2.1/servers/0ad2fd7d-b264-4ed6-8c57-24b879740372 => generated 1319 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:28:29.726824 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-c450166b-cab5-4341-95c6-839818d2c93f tempest-VolumesSnapshotTestJSON-1785130454 tempest-VolumesSnapshotTestJSON-1785130454-project] Calling method '>' {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:28:29.727630 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.compute.api [None req-c450166b-cab5-4341-95c6-839818d2c93f tempest-VolumesSnapshotTestJSON-1785130454 tempest-VolumesSnapshotTestJSON-1785130454-project] [instance: 0ad2fd7d-b264-4ed6-8c57-24b879740372] Fetching instance by UUID {{(pid=120798) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:28:29.734259 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-c450166b-cab5-4341-95c6-839818d2c93f tempest-VolumesSnapshotTestJSON-1785130454 tempest-VolumesSnapshotTestJSON-1785130454-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:28:29.734813 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-c450166b-cab5-4341-95c6-839818d2c93f tempest-VolumesSnapshotTestJSON-1785130454 tempest-VolumesSnapshotTestJSON-1785130454-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:28:29.735309 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-c450166b-cab5-4341-95c6-839818d2c93f tempest-VolumesSnapshotTestJSON-1785130454 tempest-VolumesSnapshotTestJSON-1785130454-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:28:29.736118 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-c450166b-cab5-4341-95c6-839818d2c93f tempest-VolumesSnapshotTestJSON-1785130454 tempest-VolumesSnapshotTestJSON-1785130454-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:28:29.736626 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-c450166b-cab5-4341-95c6-839818d2c93f tempest-VolumesSnapshotTestJSON-1785130454 tempest-VolumesSnapshotTestJSON-1785130454-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:28:29.737111 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-c450166b-cab5-4341-95c6-839818d2c93f tempest-VolumesSnapshotTestJSON-1785130454 tempest-VolumesSnapshotTestJSON-1785130454-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:28:29.879627 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.policy [None req-c450166b-cab5-4341-95c6-839818d2c93f tempest-VolumesSnapshotTestJSON-1785130454 tempest-VolumesSnapshotTestJSON-1785130454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac00970326df432bb130e44ed04db3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b02989040ab4080855af2e66c942060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120798) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:28:29.887723 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [None req-c450166b-cab5-4341-95c6-839818d2c93f tempest-VolumesSnapshotTestJSON-1785130454 tempest-VolumesSnapshotTestJSON-1785130454-project] 10.222.0.17 "GET /compute/v2.1/servers/0ad2fd7d-b264-4ed6-8c57-24b879740372" status: 200 len: 1319 microversion: 2.1 time: 0.165968 Aug 23 07:28:29.888445 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 497/1019] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:28:29 2022] GET /compute/v2.1/servers/0ad2fd7d-b264-4ed6-8c57-24b879740372 => generated 1319 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:28:30.912938 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-0f6fcf65-ffc2-4319-bad3-262a8da68649 tempest-VolumesSnapshotTestJSON-1785130454 tempest-VolumesSnapshotTestJSON-1785130454-project] Calling method '>' {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:28:30.913878 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.compute.api [None req-0f6fcf65-ffc2-4319-bad3-262a8da68649 tempest-VolumesSnapshotTestJSON-1785130454 tempest-VolumesSnapshotTestJSON-1785130454-project] [instance: 0ad2fd7d-b264-4ed6-8c57-24b879740372] Fetching instance by UUID {{(pid=120799) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:28:30.924855 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-0f6fcf65-ffc2-4319-bad3-262a8da68649 tempest-VolumesSnapshotTestJSON-1785130454 tempest-VolumesSnapshotTestJSON-1785130454-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:28:30.925642 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-0f6fcf65-ffc2-4319-bad3-262a8da68649 tempest-VolumesSnapshotTestJSON-1785130454 tempest-VolumesSnapshotTestJSON-1785130454-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:28:30.926306 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-0f6fcf65-ffc2-4319-bad3-262a8da68649 tempest-VolumesSnapshotTestJSON-1785130454 tempest-VolumesSnapshotTestJSON-1785130454-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:28:30.926988 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-0f6fcf65-ffc2-4319-bad3-262a8da68649 tempest-VolumesSnapshotTestJSON-1785130454 tempest-VolumesSnapshotTestJSON-1785130454-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:28:30.927453 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-0f6fcf65-ffc2-4319-bad3-262a8da68649 tempest-VolumesSnapshotTestJSON-1785130454 tempest-VolumesSnapshotTestJSON-1785130454-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:28:30.927875 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-0f6fcf65-ffc2-4319-bad3-262a8da68649 tempest-VolumesSnapshotTestJSON-1785130454 tempest-VolumesSnapshotTestJSON-1785130454-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:28:31.064045 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.policy [None req-0f6fcf65-ffc2-4319-bad3-262a8da68649 tempest-VolumesSnapshotTestJSON-1785130454 tempest-VolumesSnapshotTestJSON-1785130454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac00970326df432bb130e44ed04db3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b02989040ab4080855af2e66c942060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120799) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:28:31.072030 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-0f6fcf65-ffc2-4319-bad3-262a8da68649 tempest-VolumesSnapshotTestJSON-1785130454 tempest-VolumesSnapshotTestJSON-1785130454-project] 10.222.0.17 "GET /compute/v2.1/servers/0ad2fd7d-b264-4ed6-8c57-24b879740372" status: 200 len: 1319 microversion: 2.1 time: 0.165941 Aug 23 07:28:31.072657 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 523/1020] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:28:30 2022] GET /compute/v2.1/servers/0ad2fd7d-b264-4ed6-8c57-24b879740372 => generated 1319 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:28:31.782323 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [req-5fa6d379-9fdf-4939-9036-3314c0865f5a req-45960f57-dc30-475a-94eb-d0d6bebb239f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0ad2fd7d-b264-4ed6-8c57-24b879740372", "name": "network-vif-plugged", "status": "completed", "tag": "55575ec9-7584-4f38-85d4-2316c07c2c84"}]} {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 07:28:31.793163 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [req-5fa6d379-9fdf-4939-9036-3314c0865f5a req-45960f57-dc30-475a-94eb-d0d6bebb239f service nova] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:28:31.793826 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [req-5fa6d379-9fdf-4939-9036-3314c0865f5a req-45960f57-dc30-475a-94eb-d0d6bebb239f service nova] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:28:31.794256 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [req-5fa6d379-9fdf-4939-9036-3314c0865f5a req-45960f57-dc30-475a-94eb-d0d6bebb239f service nova] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:28:31.806956 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.compute.server_external_events [req-5fa6d379-9fdf-4939-9036-3314c0865f5a req-45960f57-dc30-475a-94eb-d0d6bebb239f service nova] Creating event network-vif-plugged:55575ec9-7584-4f38-85d4-2316c07c2c84 for instance 0ad2fd7d-b264-4ed6-8c57-24b879740372 on hv-cinder-85409 Aug 23 07:28:31.811957 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [req-5fa6d379-9fdf-4939-9036-3314c0865f5a req-45960f57-dc30-475a-94eb-d0d6bebb239f service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033362 Aug 23 07:28:31.812906 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 498/1021] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Aug 23 07:28:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 07:28:32.104123 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-42203ee5-2ab6-48d9-9dc5-d9bee6d4e96c tempest-VolumesSnapshotTestJSON-1785130454 tempest-VolumesSnapshotTestJSON-1785130454-project] Calling method '>' {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:28:32.104945 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.compute.api [None req-42203ee5-2ab6-48d9-9dc5-d9bee6d4e96c tempest-VolumesSnapshotTestJSON-1785130454 tempest-VolumesSnapshotTestJSON-1785130454-project] [instance: 0ad2fd7d-b264-4ed6-8c57-24b879740372] Fetching instance by UUID {{(pid=120799) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:28:32.115152 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-42203ee5-2ab6-48d9-9dc5-d9bee6d4e96c tempest-VolumesSnapshotTestJSON-1785130454 tempest-VolumesSnapshotTestJSON-1785130454-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:28:32.115675 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-42203ee5-2ab6-48d9-9dc5-d9bee6d4e96c tempest-VolumesSnapshotTestJSON-1785130454 tempest-VolumesSnapshotTestJSON-1785130454-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:28:32.116115 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-42203ee5-2ab6-48d9-9dc5-d9bee6d4e96c tempest-VolumesSnapshotTestJSON-1785130454 tempest-VolumesSnapshotTestJSON-1785130454-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:28:32.116807 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-42203ee5-2ab6-48d9-9dc5-d9bee6d4e96c tempest-VolumesSnapshotTestJSON-1785130454 tempest-VolumesSnapshotTestJSON-1785130454-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:28:32.117261 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-42203ee5-2ab6-48d9-9dc5-d9bee6d4e96c tempest-VolumesSnapshotTestJSON-1785130454 tempest-VolumesSnapshotTestJSON-1785130454-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:28:32.117686 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-42203ee5-2ab6-48d9-9dc5-d9bee6d4e96c tempest-VolumesSnapshotTestJSON-1785130454 tempest-VolumesSnapshotTestJSON-1785130454-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:28:32.251137 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.policy [None req-42203ee5-2ab6-48d9-9dc5-d9bee6d4e96c tempest-VolumesSnapshotTestJSON-1785130454 tempest-VolumesSnapshotTestJSON-1785130454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac00970326df432bb130e44ed04db3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b02989040ab4080855af2e66c942060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120799) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:28:32.261608 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-42203ee5-2ab6-48d9-9dc5-d9bee6d4e96c tempest-VolumesSnapshotTestJSON-1785130454 tempest-VolumesSnapshotTestJSON-1785130454-project] 10.222.0.17 "GET /compute/v2.1/servers/0ad2fd7d-b264-4ed6-8c57-24b879740372" status: 200 len: 1319 microversion: 2.1 time: 0.164165 Aug 23 07:28:32.262416 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 524/1022] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:28:32 2022] GET /compute/v2.1/servers/0ad2fd7d-b264-4ed6-8c57-24b879740372 => generated 1319 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:28:33.286849 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-f4e8dbd7-0032-4ea2-81d4-9f87868ea3e1 tempest-VolumesSnapshotTestJSON-1785130454 tempest-VolumesSnapshotTestJSON-1785130454-project] Calling method '>' {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:28:33.287546 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.compute.api [None req-f4e8dbd7-0032-4ea2-81d4-9f87868ea3e1 tempest-VolumesSnapshotTestJSON-1785130454 tempest-VolumesSnapshotTestJSON-1785130454-project] [instance: 0ad2fd7d-b264-4ed6-8c57-24b879740372] Fetching instance by UUID {{(pid=120798) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:28:33.295312 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-f4e8dbd7-0032-4ea2-81d4-9f87868ea3e1 tempest-VolumesSnapshotTestJSON-1785130454 tempest-VolumesSnapshotTestJSON-1785130454-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:28:33.296062 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-f4e8dbd7-0032-4ea2-81d4-9f87868ea3e1 tempest-VolumesSnapshotTestJSON-1785130454 tempest-VolumesSnapshotTestJSON-1785130454-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:28:33.296697 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-f4e8dbd7-0032-4ea2-81d4-9f87868ea3e1 tempest-VolumesSnapshotTestJSON-1785130454 tempest-VolumesSnapshotTestJSON-1785130454-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:28:33.297401 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-f4e8dbd7-0032-4ea2-81d4-9f87868ea3e1 tempest-VolumesSnapshotTestJSON-1785130454 tempest-VolumesSnapshotTestJSON-1785130454-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:28:33.297869 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-f4e8dbd7-0032-4ea2-81d4-9f87868ea3e1 tempest-VolumesSnapshotTestJSON-1785130454 tempest-VolumesSnapshotTestJSON-1785130454-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:28:33.298299 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-f4e8dbd7-0032-4ea2-81d4-9f87868ea3e1 tempest-VolumesSnapshotTestJSON-1785130454 tempest-VolumesSnapshotTestJSON-1785130454-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:28:33.436271 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.policy [None req-f4e8dbd7-0032-4ea2-81d4-9f87868ea3e1 tempest-VolumesSnapshotTestJSON-1785130454 tempest-VolumesSnapshotTestJSON-1785130454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac00970326df432bb130e44ed04db3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b02989040ab4080855af2e66c942060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120798) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:28:33.445175 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [None req-f4e8dbd7-0032-4ea2-81d4-9f87868ea3e1 tempest-VolumesSnapshotTestJSON-1785130454 tempest-VolumesSnapshotTestJSON-1785130454-project] 10.222.0.17 "GET /compute/v2.1/servers/0ad2fd7d-b264-4ed6-8c57-24b879740372" status: 200 len: 1508 microversion: 2.1 time: 0.164869 Aug 23 07:28:33.445766 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 499/1023] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:28:33 2022] GET /compute/v2.1/servers/0ad2fd7d-b264-4ed6-8c57-24b879740372 => generated 1508 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:28:33.467638 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-76d08414-5c47-4225-9fc9-3a95a1fdaee8 tempest-VolumesSnapshotTestJSON-1785130454 tempest-VolumesSnapshotTestJSON-1785130454-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "80fdb066-a61b-46eb-8994-b8e0153b3458", "device": "/dev/sdb"}} {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 07:28:33.470914 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.compute.api [None req-76d08414-5c47-4225-9fc9-3a95a1fdaee8 tempest-VolumesSnapshotTestJSON-1785130454 tempest-VolumesSnapshotTestJSON-1785130454-project] [instance: 0ad2fd7d-b264-4ed6-8c57-24b879740372] Fetching instance by UUID {{(pid=120799) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:28:33.478437 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-76d08414-5c47-4225-9fc9-3a95a1fdaee8 tempest-VolumesSnapshotTestJSON-1785130454 tempest-VolumesSnapshotTestJSON-1785130454-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:28:33.478920 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-76d08414-5c47-4225-9fc9-3a95a1fdaee8 tempest-VolumesSnapshotTestJSON-1785130454 tempest-VolumesSnapshotTestJSON-1785130454-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:28:33.479347 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-76d08414-5c47-4225-9fc9-3a95a1fdaee8 tempest-VolumesSnapshotTestJSON-1785130454 tempest-VolumesSnapshotTestJSON-1785130454-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:28:33.480051 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-76d08414-5c47-4225-9fc9-3a95a1fdaee8 tempest-VolumesSnapshotTestJSON-1785130454 tempest-VolumesSnapshotTestJSON-1785130454-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:28:33.480494 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-76d08414-5c47-4225-9fc9-3a95a1fdaee8 tempest-VolumesSnapshotTestJSON-1785130454 tempest-VolumesSnapshotTestJSON-1785130454-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:28:33.480890 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-76d08414-5c47-4225-9fc9-3a95a1fdaee8 tempest-VolumesSnapshotTestJSON-1785130454 tempest-VolumesSnapshotTestJSON-1785130454-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:28:33.742490 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-76d08414-5c47-4225-9fc9-3a95a1fdaee8 tempest-VolumesSnapshotTestJSON-1785130454 tempest-VolumesSnapshotTestJSON-1785130454-project] 10.222.0.17 "POST /compute/v2.1/servers/0ad2fd7d-b264-4ed6-8c57-24b879740372/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.279657 Aug 23 07:28:33.743502 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 525/1024] 10.222.0.17 () {60 vars in 1323 bytes} [Tue Aug 23 07:28:33 2022] POST /compute/v2.1/servers/0ad2fd7d-b264-4ed6-8c57-24b879740372/os-volume_attachments => generated 194 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 07:28:50.126416 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-6f7aca2a-a73c-410d-86e7-97d3362566db tempest-VolumesSnapshotTestJSON-1785130454 tempest-VolumesSnapshotTestJSON-1785130454-project] Calling method '>' {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:28:50.126921 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.compute.api [None req-6f7aca2a-a73c-410d-86e7-97d3362566db tempest-VolumesSnapshotTestJSON-1785130454 tempest-VolumesSnapshotTestJSON-1785130454-project] [instance: 0ad2fd7d-b264-4ed6-8c57-24b879740372] Fetching instance by UUID {{(pid=120798) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:28:50.129455 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG dbcounter [-] [120798] Writing DB stats nova_cell0:SELECT=2 {{(pid=120798) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:28:50.130145 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG dbcounter [-] [120798] Writing DB stats nova_cell0:SELECT=6 {{(pid=120798) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:28:50.130889 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG dbcounter [-] [120798] Writing DB stats nova_api:SELECT=36,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=120798) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:28:50.131948 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG dbcounter [-] [120798] Writing DB stats nova_cell1:SELECT=52,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120798) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:28:50.141397 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-6f7aca2a-a73c-410d-86e7-97d3362566db tempest-VolumesSnapshotTestJSON-1785130454 tempest-VolumesSnapshotTestJSON-1785130454-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:28:50.141884 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-6f7aca2a-a73c-410d-86e7-97d3362566db tempest-VolumesSnapshotTestJSON-1785130454 tempest-VolumesSnapshotTestJSON-1785130454-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:28:50.142317 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-6f7aca2a-a73c-410d-86e7-97d3362566db tempest-VolumesSnapshotTestJSON-1785130454 tempest-VolumesSnapshotTestJSON-1785130454-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:28:50.143007 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-6f7aca2a-a73c-410d-86e7-97d3362566db tempest-VolumesSnapshotTestJSON-1785130454 tempest-VolumesSnapshotTestJSON-1785130454-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:28:50.143482 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-6f7aca2a-a73c-410d-86e7-97d3362566db tempest-VolumesSnapshotTestJSON-1785130454 tempest-VolumesSnapshotTestJSON-1785130454-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:28:50.143903 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-6f7aca2a-a73c-410d-86e7-97d3362566db tempest-VolumesSnapshotTestJSON-1785130454 tempest-VolumesSnapshotTestJSON-1785130454-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:28:50.231123 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.objects.instance [None req-6f7aca2a-a73c-410d-86e7-97d3362566db tempest-VolumesSnapshotTestJSON-1785130454 tempest-VolumesSnapshotTestJSON-1785130454-project] Lazy-loading 'services' on Instance uuid 0ad2fd7d-b264-4ed6-8c57-24b879740372 {{(pid=120798) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 07:28:50.316693 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [None req-6f7aca2a-a73c-410d-86e7-97d3362566db tempest-VolumesSnapshotTestJSON-1785130454 tempest-VolumesSnapshotTestJSON-1785130454-project] 10.222.0.17 "DELETE /compute/v2.1/servers/0ad2fd7d-b264-4ed6-8c57-24b879740372/os-volume_attachments/80fdb066-a61b-46eb-8994-b8e0153b3458" status: 202 len: 0 microversion: 2.1 time: 0.194223 Aug 23 07:28:50.317306 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 500/1025] 10.222.0.17 () {58 vars in 1416 bytes} [Tue Aug 23 07:28:50 2022] DELETE /compute/v2.1/servers/0ad2fd7d-b264-4ed6-8c57-24b879740372/os-volume_attachments/80fdb066-a61b-46eb-8994-b8e0153b3458 => generated 0 bytes in 196 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 07:28:51.458105 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-c0fc207d-66d2-4180-93d4-722eb995059c tempest-VolumesSnapshotTestJSON-1785130454 tempest-VolumesSnapshotTestJSON-1785130454-project] Calling method '>' {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:28:51.458656 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.compute.api [None req-c0fc207d-66d2-4180-93d4-722eb995059c tempest-VolumesSnapshotTestJSON-1785130454 tempest-VolumesSnapshotTestJSON-1785130454-project] [instance: 0ad2fd7d-b264-4ed6-8c57-24b879740372] Fetching instance by UUID {{(pid=120799) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:28:51.461168 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG dbcounter [-] [120799] Writing DB stats nova_cell0:SELECT=2 {{(pid=120799) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:28:51.461929 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG dbcounter [-] [120799] Writing DB stats nova_api:SELECT=22 {{(pid=120799) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:28:51.462671 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG dbcounter [-] [120799] Writing DB stats nova_cell1:SELECT=35,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120799) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:28:51.470659 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-c0fc207d-66d2-4180-93d4-722eb995059c tempest-VolumesSnapshotTestJSON-1785130454 tempest-VolumesSnapshotTestJSON-1785130454-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:28:51.471179 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-c0fc207d-66d2-4180-93d4-722eb995059c tempest-VolumesSnapshotTestJSON-1785130454 tempest-VolumesSnapshotTestJSON-1785130454-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:28:51.471991 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-c0fc207d-66d2-4180-93d4-722eb995059c tempest-VolumesSnapshotTestJSON-1785130454 tempest-VolumesSnapshotTestJSON-1785130454-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:28:51.473123 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-c0fc207d-66d2-4180-93d4-722eb995059c tempest-VolumesSnapshotTestJSON-1785130454 tempest-VolumesSnapshotTestJSON-1785130454-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:28:51.473891 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-c0fc207d-66d2-4180-93d4-722eb995059c tempest-VolumesSnapshotTestJSON-1785130454 tempest-VolumesSnapshotTestJSON-1785130454-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:28:51.474440 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-c0fc207d-66d2-4180-93d4-722eb995059c tempest-VolumesSnapshotTestJSON-1785130454 tempest-VolumesSnapshotTestJSON-1785130454-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:28:51.505931 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.compute.api [None req-c0fc207d-66d2-4180-93d4-722eb995059c tempest-VolumesSnapshotTestJSON-1785130454 tempest-VolumesSnapshotTestJSON-1785130454-project] [instance: 0ad2fd7d-b264-4ed6-8c57-24b879740372] Going to try to terminate instance {{(pid=120799) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 07:28:51.589950 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-c0fc207d-66d2-4180-93d4-722eb995059c tempest-VolumesSnapshotTestJSON-1785130454 tempest-VolumesSnapshotTestJSON-1785130454-project] 10.222.0.17 "DELETE /compute/v2.1/servers/0ad2fd7d-b264-4ed6-8c57-24b879740372" status: 204 len: 0 microversion: 2.1 time: 0.135727 Aug 23 07:28:51.591170 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 526/1026] 10.222.0.17 () {58 vars in 1239 bytes} [Tue Aug 23 07:28:51 2022] DELETE /compute/v2.1/servers/0ad2fd7d-b264-4ed6-8c57-24b879740372 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 23 07:28:51.600916 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-b3468349-cbb1-4c20-a46e-23b4420980b6 tempest-VolumesSnapshotTestJSON-1785130454 tempest-VolumesSnapshotTestJSON-1785130454-project] Calling method '>' {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:28:51.601619 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.compute.api [None req-b3468349-cbb1-4c20-a46e-23b4420980b6 tempest-VolumesSnapshotTestJSON-1785130454 tempest-VolumesSnapshotTestJSON-1785130454-project] [instance: 0ad2fd7d-b264-4ed6-8c57-24b879740372] Fetching instance by UUID {{(pid=120798) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:28:51.608468 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-b3468349-cbb1-4c20-a46e-23b4420980b6 tempest-VolumesSnapshotTestJSON-1785130454 tempest-VolumesSnapshotTestJSON-1785130454-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:28:51.608994 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-b3468349-cbb1-4c20-a46e-23b4420980b6 tempest-VolumesSnapshotTestJSON-1785130454 tempest-VolumesSnapshotTestJSON-1785130454-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:28:51.609431 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-b3468349-cbb1-4c20-a46e-23b4420980b6 tempest-VolumesSnapshotTestJSON-1785130454 tempest-VolumesSnapshotTestJSON-1785130454-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:28:51.610124 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-b3468349-cbb1-4c20-a46e-23b4420980b6 tempest-VolumesSnapshotTestJSON-1785130454 tempest-VolumesSnapshotTestJSON-1785130454-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:28:51.610579 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-b3468349-cbb1-4c20-a46e-23b4420980b6 tempest-VolumesSnapshotTestJSON-1785130454 tempest-VolumesSnapshotTestJSON-1785130454-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:28:51.611006 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-b3468349-cbb1-4c20-a46e-23b4420980b6 tempest-VolumesSnapshotTestJSON-1785130454 tempest-VolumesSnapshotTestJSON-1785130454-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:28:51.751214 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.policy [None req-b3468349-cbb1-4c20-a46e-23b4420980b6 tempest-VolumesSnapshotTestJSON-1785130454 tempest-VolumesSnapshotTestJSON-1785130454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac00970326df432bb130e44ed04db3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b02989040ab4080855af2e66c942060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120798) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:28:51.760125 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [None req-b3468349-cbb1-4c20-a46e-23b4420980b6 tempest-VolumesSnapshotTestJSON-1785130454 tempest-VolumesSnapshotTestJSON-1785130454-project] 10.222.0.17 "GET /compute/v2.1/servers/0ad2fd7d-b264-4ed6-8c57-24b879740372" status: 200 len: 1514 microversion: 2.1 time: 0.163980 Aug 23 07:28:51.760689 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 501/1027] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:28:51 2022] GET /compute/v2.1/servers/0ad2fd7d-b264-4ed6-8c57-24b879740372 => generated 1514 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:28:52.786382 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-a778e515-1a86-4067-8e3a-6323b178131c tempest-VolumesSnapshotTestJSON-1785130454 tempest-VolumesSnapshotTestJSON-1785130454-project] Calling method '>' {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:28:52.787533 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.compute.api [None req-a778e515-1a86-4067-8e3a-6323b178131c tempest-VolumesSnapshotTestJSON-1785130454 tempest-VolumesSnapshotTestJSON-1785130454-project] [instance: 0ad2fd7d-b264-4ed6-8c57-24b879740372] Fetching instance by UUID {{(pid=120799) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:28:52.796284 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-a778e515-1a86-4067-8e3a-6323b178131c tempest-VolumesSnapshotTestJSON-1785130454 tempest-VolumesSnapshotTestJSON-1785130454-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:28:52.796771 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-a778e515-1a86-4067-8e3a-6323b178131c tempest-VolumesSnapshotTestJSON-1785130454 tempest-VolumesSnapshotTestJSON-1785130454-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:28:52.797210 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-a778e515-1a86-4067-8e3a-6323b178131c tempest-VolumesSnapshotTestJSON-1785130454 tempest-VolumesSnapshotTestJSON-1785130454-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:28:52.797929 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-a778e515-1a86-4067-8e3a-6323b178131c tempest-VolumesSnapshotTestJSON-1785130454 tempest-VolumesSnapshotTestJSON-1785130454-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:28:52.798357 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-a778e515-1a86-4067-8e3a-6323b178131c tempest-VolumesSnapshotTestJSON-1785130454 tempest-VolumesSnapshotTestJSON-1785130454-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:28:52.798776 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-a778e515-1a86-4067-8e3a-6323b178131c tempest-VolumesSnapshotTestJSON-1785130454 tempest-VolumesSnapshotTestJSON-1785130454-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:28:52.940585 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.policy [None req-a778e515-1a86-4067-8e3a-6323b178131c tempest-VolumesSnapshotTestJSON-1785130454 tempest-VolumesSnapshotTestJSON-1785130454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac00970326df432bb130e44ed04db3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b02989040ab4080855af2e66c942060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120799) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:28:52.948963 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-a778e515-1a86-4067-8e3a-6323b178131c tempest-VolumesSnapshotTestJSON-1785130454 tempest-VolumesSnapshotTestJSON-1785130454-project] 10.222.0.17 "GET /compute/v2.1/servers/0ad2fd7d-b264-4ed6-8c57-24b879740372" status: 200 len: 1514 microversion: 2.1 time: 0.169962 Aug 23 07:28:52.949510 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 527/1028] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:28:52 2022] GET /compute/v2.1/servers/0ad2fd7d-b264-4ed6-8c57-24b879740372 => generated 1514 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:28:53.608180 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [req-d7539e38-a753-4965-9c76-da3c8883fff4 req-602efd53-9e9c-42d3-9d3c-ce3b84f9b3ae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0ad2fd7d-b264-4ed6-8c57-24b879740372", "name": "network-vif-deleted", "tag": "55575ec9-7584-4f38-85d4-2316c07c2c84"}]} {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 07:28:53.620343 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [req-d7539e38-a753-4965-9c76-da3c8883fff4 req-602efd53-9e9c-42d3-9d3c-ce3b84f9b3ae service nova] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:28:53.620816 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [req-d7539e38-a753-4965-9c76-da3c8883fff4 req-602efd53-9e9c-42d3-9d3c-ce3b84f9b3ae service nova] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:28:53.621237 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [req-d7539e38-a753-4965-9c76-da3c8883fff4 req-602efd53-9e9c-42d3-9d3c-ce3b84f9b3ae service nova] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:28:53.633611 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.compute.server_external_events [req-d7539e38-a753-4965-9c76-da3c8883fff4 req-602efd53-9e9c-42d3-9d3c-ce3b84f9b3ae service nova] Creating event network-vif-deleted:55575ec9-7584-4f38-85d4-2316c07c2c84 for instance 0ad2fd7d-b264-4ed6-8c57-24b879740372 on hv-cinder-85409 Aug 23 07:28:53.639646 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [req-d7539e38-a753-4965-9c76-da3c8883fff4 req-602efd53-9e9c-42d3-9d3c-ce3b84f9b3ae service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035416 Aug 23 07:28:53.640581 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 502/1029] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Aug 23 07:28:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 07:28:53.971407 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.api.openstack.wsgi [None req-aa4a04a2-7b2a-410c-b615-bde5a0038edc tempest-VolumesSnapshotTestJSON-1785130454 tempest-VolumesSnapshotTestJSON-1785130454-project] Calling method '>' {{(pid=120799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:28:53.972168 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.compute.api [None req-aa4a04a2-7b2a-410c-b615-bde5a0038edc tempest-VolumesSnapshotTestJSON-1785130454 tempest-VolumesSnapshotTestJSON-1785130454-project] [instance: 0ad2fd7d-b264-4ed6-8c57-24b879740372] Fetching instance by UUID {{(pid=120799) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:28:53.978959 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-aa4a04a2-7b2a-410c-b615-bde5a0038edc tempest-VolumesSnapshotTestJSON-1785130454 tempest-VolumesSnapshotTestJSON-1785130454-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:28:53.979524 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-aa4a04a2-7b2a-410c-b615-bde5a0038edc tempest-VolumesSnapshotTestJSON-1785130454 tempest-VolumesSnapshotTestJSON-1785130454-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:28:53.980123 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-aa4a04a2-7b2a-410c-b615-bde5a0038edc tempest-VolumesSnapshotTestJSON-1785130454 tempest-VolumesSnapshotTestJSON-1785130454-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:28:53.980927 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-aa4a04a2-7b2a-410c-b615-bde5a0038edc tempest-VolumesSnapshotTestJSON-1785130454 tempest-VolumesSnapshotTestJSON-1785130454-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:28:53.981463 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-aa4a04a2-7b2a-410c-b615-bde5a0038edc tempest-VolumesSnapshotTestJSON-1785130454 tempest-VolumesSnapshotTestJSON-1785130454-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:28:53.981909 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-aa4a04a2-7b2a-410c-b615-bde5a0038edc tempest-VolumesSnapshotTestJSON-1785130454 tempest-VolumesSnapshotTestJSON-1785130454-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:28:54.015765 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-aa4a04a2-7b2a-410c-b615-bde5a0038edc tempest-VolumesSnapshotTestJSON-1785130454 tempest-VolumesSnapshotTestJSON-1785130454-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:28:54.016236 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-aa4a04a2-7b2a-410c-b615-bde5a0038edc tempest-VolumesSnapshotTestJSON-1785130454 tempest-VolumesSnapshotTestJSON-1785130454-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:28:54.016657 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG oslo_concurrency.lockutils [None req-aa4a04a2-7b2a-410c-b615-bde5a0038edc tempest-VolumesSnapshotTestJSON-1785130454 tempest-VolumesSnapshotTestJSON-1785130454-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:28:54.017098 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.objects.instance [None req-aa4a04a2-7b2a-410c-b615-bde5a0038edc tempest-VolumesSnapshotTestJSON-1785130454 tempest-VolumesSnapshotTestJSON-1785130454-project] Lazy-loading 'fault' on Instance uuid 0ad2fd7d-b264-4ed6-8c57-24b879740372 {{(pid=120799) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 07:28:54.062764 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: DEBUG nova.policy [None req-aa4a04a2-7b2a-410c-b615-bde5a0038edc tempest-VolumesSnapshotTestJSON-1785130454 tempest-VolumesSnapshotTestJSON-1785130454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac00970326df432bb130e44ed04db3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b02989040ab4080855af2e66c942060', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120799) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 07:28:54.073299 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO nova.api.openstack.requestlog [None req-aa4a04a2-7b2a-410c-b615-bde5a0038edc tempest-VolumesSnapshotTestJSON-1785130454 tempest-VolumesSnapshotTestJSON-1785130454-project] 10.222.0.17 "GET /compute/v2.1/servers/0ad2fd7d-b264-4ed6-8c57-24b879740372" status: 200 len: 1309 microversion: 2.1 time: 0.106158 Aug 23 07:28:54.074163 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: [pid: 120799|app: 0|req: 528/1030] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:28:53 2022] GET /compute/v2.1/servers/0ad2fd7d-b264-4ed6-8c57-24b879740372 => generated 1309 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 07:28:55.100655 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-cf58c59d-6868-494b-a532-0ebb654972b3 tempest-VolumesSnapshotTestJSON-1785130454 tempest-VolumesSnapshotTestJSON-1785130454-project] Calling method '>' {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 07:28:55.101617 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.compute.api [None req-cf58c59d-6868-494b-a532-0ebb654972b3 tempest-VolumesSnapshotTestJSON-1785130454 tempest-VolumesSnapshotTestJSON-1785130454-project] [instance: 0ad2fd7d-b264-4ed6-8c57-24b879740372] Fetching instance by UUID {{(pid=120798) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 07:28:55.110091 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-cf58c59d-6868-494b-a532-0ebb654972b3 tempest-VolumesSnapshotTestJSON-1785130454 tempest-VolumesSnapshotTestJSON-1785130454-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:28:55.110566 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-cf58c59d-6868-494b-a532-0ebb654972b3 tempest-VolumesSnapshotTestJSON-1785130454 tempest-VolumesSnapshotTestJSON-1785130454-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:28:55.111025 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-cf58c59d-6868-494b-a532-0ebb654972b3 tempest-VolumesSnapshotTestJSON-1785130454 tempest-VolumesSnapshotTestJSON-1785130454-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:28:55.111739 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-cf58c59d-6868-494b-a532-0ebb654972b3 tempest-VolumesSnapshotTestJSON-1785130454 tempest-VolumesSnapshotTestJSON-1785130454-project] Acquiring lock "f504f095-246c-45ec-9346-3a7c88a97f22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 07:28:55.112189 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-cf58c59d-6868-494b-a532-0ebb654972b3 tempest-VolumesSnapshotTestJSON-1785130454 tempest-VolumesSnapshotTestJSON-1785130454-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 07:28:55.112601 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG oslo_concurrency.lockutils [None req-cf58c59d-6868-494b-a532-0ebb654972b3 tempest-VolumesSnapshotTestJSON-1785130454 tempest-VolumesSnapshotTestJSON-1785130454-project] Lock "f504f095-246c-45ec-9346-3a7c88a97f22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 07:28:55.128370 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.wsgi [None req-cf58c59d-6868-494b-a532-0ebb654972b3 tempest-VolumesSnapshotTestJSON-1785130454 tempest-VolumesSnapshotTestJSON-1785130454-project] HTTP exception thrown: Instance 0ad2fd7d-b264-4ed6-8c57-24b879740372 could not be found. Aug 23 07:28:55.129972 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-cf58c59d-6868-494b-a532-0ebb654972b3 tempest-VolumesSnapshotTestJSON-1785130454 tempest-VolumesSnapshotTestJSON-1785130454-project] Request method failure captured: Aug 23 07:28:55.129972 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: request: GET /compute/v2.1/servers/0ad2fd7d-b264-4ed6-8c57-24b879740372 HTTP/1.1 Aug 23 07:28:55.129972 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: Accept: application/json Aug 23 07:28:55.129972 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: Accept-Encoding: identity Aug 23 07:28:55.129972 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: Connection: close Aug 23 07:28:55.129972 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: Content-Length: 0 Aug 23 07:28:55.129972 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: Content-Type: application/json Aug 23 07:28:55.129972 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: Host: 10.222.0.17 Aug 23 07:28:55.129972 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: Openstack-System-Scope: None Aug 23 07:28:55.129972 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: User-Agent: python-urllib3/1.26.11 Aug 23 07:28:55.129972 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-Auth-Token: gAAAAABjBIFdN0PkXBfBRZTsXbN90pvzkPqEoPf1WAaBD_Q_QmxvlpbUAhkGXdfGxcWgZGaBNgudOUd4R56C9MCFeHRHis93RpXpd4VSGa0QJ2VmUMFV_i55HJnSBmy04Wid4y9vHN9d9Hu-ZIoYDb5VogTCEHzfTQnveKRkU8VIhkXdn2sU5XM Aug 23 07:28:55.129972 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-Domain-Id: None Aug 23 07:28:55.129972 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-Domain-Name: None Aug 23 07:28:55.129972 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-Identity-Status: Confirmed Aug 23 07:28:55.129972 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-Is-Admin-Project: True Aug 23 07:28:55.129972 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-Project-Domain-Id: default Aug 23 07:28:55.129972 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-Project-Domain-Name: Default Aug 23 07:28:55.129972 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-Project-Id: 5b02989040ab4080855af2e66c942060 Aug 23 07:28:55.129972 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1785130454 Aug 23 07:28:55.129972 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-Role: reader,member Aug 23 07:28:55.129972 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-Roles: reader,member Aug 23 07:28:55.131789 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/5b02989040ab4080855af2e66c942060"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/5b02989040ab4080855af2e66c942060"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_5b02989040ab4080855af2e66c942060"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/5b02989040ab4080855af2e66c942060"}]}] Aug 23 07:28:55.131789 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-Tenant: tempest-VolumesSnapshotTestJSON-1785130454 Aug 23 07:28:55.131789 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-Tenant-Id: 5b02989040ab4080855af2e66c942060 Aug 23 07:28:55.131789 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1785130454 Aug 23 07:28:55.131789 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-User: tempest-VolumesSnapshotTestJSON-1785130454-project Aug 23 07:28:55.131789 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-User-Domain-Id: default Aug 23 07:28:55.131789 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-User-Domain-Name: Default Aug 23 07:28:55.131789 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-User-Id: ac00970326df432bb130e44ed04db3b5 Aug 23 07:28:55.131789 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: X-User-Name: tempest-VolumesSnapshotTestJSON-1785130454-project Aug 23 07:28:55.131789 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: method: > Aug 23 07:28:55.131789 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: exception: Instance 0ad2fd7d-b264-4ed6-8c57-24b879740372 could not be found. Aug 23 07:28:55.131789 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: action_args: {'id': '0ad2fd7d-b264-4ed6-8c57-24b879740372'} Aug 23 07:28:55.132834 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: {{(pid=120798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 07:28:55.132834 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 07:28:55.132834 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 07:28:55.132834 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 07:28:55.132834 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 07:28:55.132834 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 07:28:55.132834 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 07:28:55.132834 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 07:28:55.132834 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 07:28:55.132834 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 07:28:55.132834 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0ad2fd7d-b264-4ed6-8c57-24b879740372 could not be found. Aug 23 07:28:55.132834 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi Aug 23 07:28:55.132834 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 07:28:55.132834 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi Aug 23 07:28:55.132834 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 07:28:55.132834 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 07:28:55.132834 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 07:28:55.132834 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 07:28:55.132834 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 07:28:55.132834 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 07:28:55.134510 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 07:28:55.134510 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 07:28:55.134510 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 07:28:55.134510 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 07:28:55.134510 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 07:28:55.134510 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 07:28:55.134510 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 07:28:55.134510 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0ad2fd7d-b264-4ed6-8c57-24b879740372 could not be found. Aug 23 07:28:55.134510 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi Aug 23 07:28:55.134510 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 07:28:55.134510 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi Aug 23 07:28:55.134510 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 07:28:55.134510 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 07:28:55.134510 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 07:28:55.134510 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 07:28:55.134510 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 07:28:55.134510 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0ad2fd7d-b264-4ed6-8c57-24b879740372 could not be found. Aug 23 07:28:55.134510 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: ERROR nova.api.openstack.wsgi Aug 23 07:28:55.136147 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: DEBUG nova.api.openstack.wsgi [None req-cf58c59d-6868-494b-a532-0ebb654972b3 tempest-VolumesSnapshotTestJSON-1785130454 tempest-VolumesSnapshotTestJSON-1785130454-project] Returning 404 to user: Instance 0ad2fd7d-b264-4ed6-8c57-24b879740372 could not be found. {{(pid=120798) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 07:28:55.136147 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO nova.api.openstack.requestlog [None req-cf58c59d-6868-494b-a532-0ebb654972b3 tempest-VolumesSnapshotTestJSON-1785130454 tempest-VolumesSnapshotTestJSON-1785130454-project] 10.222.0.17 "GET /compute/v2.1/servers/0ad2fd7d-b264-4ed6-8c57-24b879740372" status: 404 len: 111 microversion: 2.1 time: 0.038070 Aug 23 07:28:55.136147 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: [pid: 120798|app: 0|req: 503/1031] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 23 07:28:55 2022] GET /compute/v2.1/servers/0ad2fd7d-b264-4ed6-8c57-24b879740372 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 07:30:40.719272 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 23 07:30:40.719977 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: Tue Aug 23 07:30:40 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 23 07:30:44.280853 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 23 07:30:44.281405 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: Tue Aug 23 07:30:44 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 23 07:30:47.311866 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 23 07:30:47.312427 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: Tue Aug 23 07:30:47 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 23 07:32:48.481745 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 23 07:32:48.482714 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: Tue Aug 23 07:32:48 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 23 07:34:00.730368 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 23 07:34:00.730972 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: Tue Aug 23 07:34:00 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 23 07:34:04.290462 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 23 07:34:04.291398 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: Tue Aug 23 07:34:04 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 23 07:34:07.322106 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 23 07:34:07.322715 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: Tue Aug 23 07:34:07 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 23 07:34:20.416947 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 23 07:34:20.418011 dv-cinder-854092-1-iscsi devstack@n-api.service[120799]: Tue Aug 23 07:34:20 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 23 07:34:21.303164 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 23 07:34:21.304219 dv-cinder-854092-1-iscsi devstack@n-api.service[120798]: Tue Aug 23 07:34:21 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!